OfflineOps: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(30 intermediate revisions by 2 users not shown)
Line 15: Line 15:
[https://fermi.servicenowservices.com/nav_to.do?uri=%2Fhome.do%3Fsysparm_view%3Dscd_outage_calendar outage calendar]<br>
[https://fermi.servicenowservices.com/nav_to.do?uri=%2Fhome.do%3Fsysparm_view%3Dscd_outage_calendar outage calendar]<br>
[http://mu2e.fnal.gov/atwork/computing/ops/diskMon.html disk space] <br>
[http://mu2e.fnal.gov/atwork/computing/ops/diskMon.html disk space] <br>
[http://metrics.fnal.gov/nas/metrics/exp-quota-reports/mu2e-app.html /mu2e/app usage and quotas] <br>
[https://landscape.fnal.gov/monitor/d/d4qZ8JSSz/cephfs-experiment-usage?orgId=1&var-group=mu2e&from=now-2d&to=now /exp/mu2e disks usage and quotas] <br>
[http://metrics.fnal.gov/nas/metrics/exp-quota-reports/mu2e-data.html /mu2e/data usage and quotas] <br>
[http://metrics.fnal.gov/nas/metrics/exp-quota-reports/mu2e-data2.html /mu2e/data2 usage and quotas] <br>
[http://ssiganglia.fnal.gov/ ganglia] <br>
[http://ssiganglia.fnal.gov/ ganglia] <br>
[https://ssimetrics.fnal.gov ssimetrics] <br>
[https://ssimetrics.fnal.gov ssimetrics] [https://ssimetrics-test.fnal.gov test]<br>
[https://ssimetrics.fnal.gov/ssi/d/000000005/problem-finder?orgId=1&var-zone=mu2e&var-role=All&var-hostname=All problems] [https://ssimetrics-test.fnal.gov/d/ae6exjkjelji8e/problem-finder?from=now-7d&to=now&timezone=America%2FChicago&var-zone=mu2e&var-role=interactive&var-subrole=$__all&var-hostname=$__all test]<br>
[http://metrics.fnal.gov/cws/apache.html web area quota]<br>
[http://metrics.fnal.gov/cws/apache.html web area quota]<br>
[https://mu2e.fnal.gov/awstats/awstats.pl website stats] <br>
[https://mu2e.fnal.gov/awstats/awstats.pl website stats] <br>
[https://metrics.fnal.gov/nas/metrics bluearc totals] <br>
[https://metrics.fnal.gov/nas/metrics bluearc totals] <br>
[https://dbweb0.fnal.gov/ECL/mu2e mu2e E-log (ECL)]<BR>
[https://mu2e-elog.physics.northwestern.edu/elog NW e-log]<br>
[https://mu2e.fnal.gov/cgi-bin/runs/search run search]<br>
|
|
[[Disks]] <BR>
[[Disks]] <BR>
Line 31: Line 33:
[https://cdcvs.fnal.gov/redmine/projects/fife/wiki/Introduction_to_FIFE_and_Component_Services FIFE redmine] <BR>
[https://cdcvs.fnal.gov/redmine/projects/fife/wiki/Introduction_to_FIFE_and_Component_Services FIFE redmine] <BR>
[https://web.fnal.gov/project/FIFE/notes/Pages/default.aspx FIFE news] <BR>
[https://web.fnal.gov/project/FIFE/notes/Pages/default.aspx FIFE news] <BR>
[https://dbweb0.fnal.gov/ECL/mu2e mu2e E-log (ECL)]<BR>
[https://authentication.fnal.gov/check-my-cert/ cert check]<br>
[https://authentication.fnal.gov/check-my-cert/ cert check]<br>
[https://fifewiki.fnal.gov/wiki/Main_Page FIFE Wiki] <br>
[https://fifewiki.fnal.gov/wiki/Main_Page FIFE Wiki] <br>
Line 37: Line 38:
[https://fermi.servicenowservices.com/$dashboards.do?sysparm_dashboard=3ddbafbb1bd22510d189426de54bcb92 CSAID dashboard]<br>
[https://fermi.servicenowservices.com/$dashboards.do?sysparm_dashboard=3ddbafbb1bd22510d189426de54bcb92 CSAID dashboard]<br>
[https://slack.com/help/articles/201658943-Export-your-workspace-data slack backup]<br>
[https://slack.com/help/articles/201658943-Export-your-workspace-data slack backup]<br>
[https://elog.psi.ch/elog/ elog docs]<br>
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 46: Line 48:
|
|
[https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?from=now-24h&to=now-5m&var-experiment=mu2e&orgId=1 grafana Mu2e]<BR>
[https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?from=now-24h&to=now-5m&var-experiment=mu2e&orgId=1 grafana Mu2e]<BR>
[https://fifemon.fnal.gov/monitor/dashboard/db/fifebatch grafana fifebatch]  
[https://fifemon.fnal.gov/monitor/d/JL6pUwB4k/submission-summary?orgId=1&var-cluster=&var-schedd=jobsub01.fnal.gov cluster summary]<BR>
[https://fifemon.fnal.gov/monitor/d/000000180/scd-summary-fife fife]
[https://fifemon.fnal.gov/monitor/d/000000180/scd-summary-fife fife]
[https://fifemon.fnal.gov/monitor/d/000000183/scd-summary-gpgrid gpgrid] <BR>
[https://fifemon.fnal.gov/monitor/d/000000183/scd-summary-gpgrid gpgrid] <BR>
[https://gracc.opensciencegrid.org/d/000000080/vo-summary?orgId=1&from=1526774400000&to=1539648000000&var-interval=$__auto_interval&var-vo=mu2e&var-type=Payload&var-Filter=RawVOName%7C%3D%7C%2Ffermilab%2Fmu2e%2FRole%3DProduction%2FCapability%3DNULL mu2epro sums] <BR>
[https://gracc.opensciencegrid.org/d/000000080/vo-summary?orgId=1&from=1526774400000&to=1539648000000&var-interval=$__auto_interval&var-vo=mu2e&var-type=Payload&var-Filter=RawVOName%7C%3D%7C%2Ffermilab%2Fmu2e%2FRole%3DProduction%2FCapability%3DNULL mu2epro sums] <BR>
[https://fifemon.fnal.gov/hcf hepcloud]  <BR>
[https://landscapeitb.fnal.gov/kibana kibana] <BR>
[https://landscapeitb.fnal.gov/kibana kibana] <BR>
[https://landscape.fnal.gov landscape] <BR>
[https://landscape.fnal.gov landscape] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/osgMon.html osgMon] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/conMon.html conMon] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/conMon.html conMon] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/jobMon.html jobMon] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/jobMon.html jobMon] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/osgMon.html osgMon] <BR>
[https://gracc.opensciencegrid.org FNAL GRACC] <BR>
[https://gracc.opensciencegrid.org FNAL GRACC] <BR>
[http://fermigrid.fnal.gov/monitor/fnpc11x2-condor-monitor-summary.html fifebatch condor],  
[http://fermigrid.fnal.gov/monitor/fnpc11x2-condor-monitor-summary.html fifebatch condor],  
Line 64: Line 65:
[https://twiki.opensciencegrid.org/bin/view/MonitoringInformation/WebHome OSG Monitor Wiki] <BR>
[https://twiki.opensciencegrid.org/bin/view/MonitoringInformation/WebHome OSG Monitor Wiki] <BR>
[http://grafana.mwt2.org:3000/dashboard/db/midwest-tier-2-opportunistic grafana (MWT2 gateway)] <BR>
[http://grafana.mwt2.org:3000/dashboard/db/midwest-tier-2-opportunistic grafana (MWT2 gateway)] <BR>
[https://pomsgpvm01.fnal.gov/poms/ POMS]
|
|
[[Grids|grids]]<br>
[[Grids|grids]]<br>
Line 97: Line 97:
[http://fermicloudrsv.fnal.gov/rsv/ gridftp pings] <BR>
[http://fermicloudrsv.fnal.gov/rsv/ gridftp pings] <BR>
[http://fndca3a.fnal.gov:2288/context/transfers.html Active transfers] <br>
[http://fndca3a.fnal.gov:2288/context/transfers.html Active transfers] <br>
[http://fndca3a.fnal.gov:2288/queueInfo Connections] <br>
[https://fndca.fnal.gov:22880/poolInfo/restoreHandler/lazy restore handler] <br>
[https://fndca.fnal.gov:22880/poolInfo/restoreHandler/lazy restore handler] <br>
[http://fndca.fnal.gov:2288/webadmin/queueinfo?11 pool queues] <br>
[http://fndca.fnal.gov:2288/webadmin/queueinfo?11 pool queues] <br>
Line 110: Line 109:
[https://fndca.fnal.gov:3880/#!/admin/pool-plots new lifetime]<br>
[https://fndca.fnal.gov:3880/#!/admin/pool-plots new lifetime]<br>
[https://www-stken.fnal.gov/cgi-bin/enstore_file_listing_cgi.py full file listing]<br>
[https://www-stken.fnal.gov/cgi-bin/enstore_file_listing_cgi.py full file listing]<br>
[https://fndca.fnal.gov:22880/queueInfo Pool request queues] <br>
staged: [https://mu2e.fnal.gov/atwork/computing/ops/datasetMon/datasets_dig.html dig][https://mu2e.fnal.gov/atwork/computing/ops/datasetMon/datasets_dts.html dts][https://mu2e.fnal.gov/atwork/computing/ops/datasetMon/datasets_mcs.html mcs][https://mu2e.fnal.gov/atwork/computing/ops/datasetMon/datasets_crv.html crv]<br>
|
|
[http://fndca.fnal.gov/ web top] <br>
[http://fndca.fnal.gov/ web top] <br>
Line 132: Line 133:
[https://fifemon.fnal.gov/monitor/d/000000173/dcache-transfer-overview?orgId=1&var-pool=readWritePools&var-protocol=storeQueue&viewPanel=9&from=now-6M&to=now grafana4]<br>
[https://fifemon.fnal.gov/monitor/d/000000173/dcache-transfer-overview?orgId=1&var-pool=readWritePools&var-protocol=storeQueue&viewPanel=9&from=now-6M&to=now grafana4]<br>
[https://fndca.fnal.gov:22880/poolInfo/restoreHandler/lazy restore handler] <br>
[https://fndca.fnal.gov:22880/poolInfo/restoreHandler/lazy restore handler] <br>
CTA tapes [https://landscape.fnal.gov/monitor/d/Fl5fYEHHz/experiment-cta-short-term short] [https://landscape.fnal.gov/monitor/d/j_SowPNHz/experiment-cta-long-term long]<br>
|
|
[[Enstore|enstore]] <br>
[[Enstore|enstore]] <br>
[http://www-ccf.fnal.gov/enstore/ web top] <br>
[https://www-stken.fnal.gov/enstore/enstore_system.html web top] <br>
[http://cd-docdb.fnal.gov/cgi-bin/ShowDocument?docid=5420 manual]<br>
[http://cd-docdb.fnal.gov/cgi-bin/ShowDocument?docid=5420 manual]<br>
[https://www-stken.fnal.gov/enstore/status_enstore_system.html tape queue] <BR>
[https://www-stken.fnal.gov/enstore/status_enstore_system.html tape queue] <BR>
Line 143: Line 145:
[https://www-stken.fnal.gov/enstore/TFF2-LTO9.library_manager-full.html TFF2] <BR>
[https://www-stken.fnal.gov/enstore/TFF2-LTO9.library_manager-full.html TFF2] <BR>
[http://www-stken.fnal.gov/cgi-bin/enstore_sfa_files_in_transition_cgi.py Active SFA] <BR>
[http://www-stken.fnal.gov/cgi-bin/enstore_sfa_files_in_transition_cgi.py Active SFA] <BR>
[https://cd-docdb.fnal.gov/cgi-bin/sso/ShowDocument?docid=4698 SFA doc]
[https://cd-docdb.fnal.gov/cgi-bin/sso/ShowDocument?docid=4698 SFA doc]<br>
[https://hepcloud-git.fnal.gov/scientific-storage/tape/cta-storageclass-mapping ff git repo]<br>
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 155: Line 158:
[https://mu2e.fnal.gov/cgi-bin/production/index monitor]<BR>
[https://mu2e.fnal.gov/cgi-bin/production/index monitor]<BR>
[https://landscape.fnal.gov/kibana/goto/4de839d0a732323c76477a77597fa676 trace a file]<br>
[https://landscape.fnal.gov/kibana/goto/4de839d0a732323c76477a77597fa676 trace a file]<br>
[https://landscape.fnal.gov/kibana/goto/6742cb6d9ca50da2bde68a9e59cf13d1 trace a file, with POMS]<br>
[http://fermicloud821.fnal.gov/poms POMS dev] <br>
[http://fermicloud821.fnal.gov/poms POMS dev] <br>
|
|
Line 164: Line 168:
[https://fermicloud821.fnal.gov/docs/gui_workflow_editor_user_guide/index.html POMS/ddisp] <BR>
[https://fermicloud821.fnal.gov/docs/gui_workflow_editor_user_guide/index.html POMS/ddisp] <BR>
[https://fermicloud821.fnal.gov/docs/experimenters_corner/data_dispatcher/index.html POMS/ddisp] <BR>
[https://fermicloud821.fnal.gov/docs/experimenters_corner/data_dispatcher/index.html POMS/ddisp] <BR>
[https://github.com/fermitools/poms/wiki POMS/ddisp github wiki]
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 172: Line 177:
|
|
Raw Data Mover [https://mu2e.fnal.gov/atwork/computing/ops/rdm/rdm.html RDM]<BR>
Raw Data Mover [https://mu2e.fnal.gov/atwork/computing/ops/rdm/rdm.html RDM]<BR>
[http://mu2esamgpvm01.fnal.gov:8787/fts/status 01]
[http://mu2eprodgpvm02.fnal.gov:8787/fts/status prod02] <br>
[http://mu2eprodgpvm02.fnal.gov:8787/fts/status prod02] <br>
[https://fifemon.fnal.gov/monitor/d/000000032/fts?refresh=5m&orgId=1&var-experiment=mu2e&var-instance=All grafana] <BR>
[https://fifemon.fnal.gov/monitor/d/000000032/fts?refresh=5m&orgId=1&var-experiment=mu2e&var-instance=All grafana] <BR>
Line 186: Line 190:
| declad
| declad
|
|
<BR>
[http://mu2eprodgpvm02.fnal.gov:8080/mu2eprodgpvm02-declad/index prod02] <br>
[https://landscape.fnal.gov/lens/view/declad/mu2e-offline0/index landscape] <br>
|
|
[https://github.com/fermitools/declad github]<br>
[https://github.com/fermitools/declad github]<br>
Line 200: Line 205:
[http://mu2e.fnal.gov/atwork/computing/ops/samTimeMon.html SAM Response Time] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/samTimeMon.html SAM Response Time] <BR>
[https://fifemon.fnal.gov/monitor/d/000000122/sam-by-experiment?orgId=1&var-experiment=mu2e&from=now-30d&to=now FifeMon ] <BR>
[https://fifemon.fnal.gov/monitor/d/000000122/sam-by-experiment?orgId=1&var-experiment=mu2e&from=now-30d&to=now FifeMon ] <BR>
[http://samweb.fnal.gov:8480/station_monitor/mu2e/stations/mu2e/projects station monitor] <BR>
[https://sammu2e.fnal.gov:8483/station_monitor/mu2e/stations/mu2e/projects station monitor] <BR>
[http://samweb.fnal.gov:8480/sam/mu2e/api/running/projects projects monitor] <BR>
[https://sammu2e.fnal.gov:8483/sam/mu2e/api/running/projects projects monitor] <BR>
[https://sammu2e.fnal.gov:8483/sam/mu2e/stations/mu2e/status?format=plain station text] <BR>
[https://sammu2e.fnal.gov:8483/sam/mu2e/stations/mu2e/status?format=plain station text] <BR>
[https://ssimetrics.fnal.gov/ssi/d/000000004/node-view?orgId=1&var-zone=sam&var-role=interactive&var-hostname=samwebgpvm05 server]<br>  
[https://ssimetrics.fnal.gov/ssi/d/000000004/node-view?orgId=1&var-zone=sam&var-role=interactive&var-hostname=samwebgpvm05 server]<br>  
Line 209: Line 214:
[https://cdcvs.fnal.gov/redmine/projects/sam-main SAM redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/sam-main SAM redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/sam-web samweb redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/sam-web samweb redmine]<br>
[https://samweb.fnal.gov:8483/sam/mu2e/api/files/list/dimensions dimensions]
[https://cdcvs.fnal.gov/redmine/projects/sam-web-client/wiki sam-web-client redmine]<br>
[https://sammu2e.fnal.gov:8483/sam/mu2e/api/files/list/dimensions dimensions]
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 264: Line 270:
|
|
[[ConditionsData]] <BR>
[[ConditionsData]] <BR>
[https://cdcvs.fnal.gov/redmine/projects/qengine/wiki QE redmine] <BR>
[https://cdcvs.fnal.gov/redmine/projects/qengine/wiki QE redmine] [https://github.com/fermisda/qengine/wiki github]<BR>
[https://cdcvs.fnal.gov/redmine/projects/condb/wiki/Web_Interface ConDB]
[https://cdcvs.fnal.gov/redmine/projects/condb/wiki/Web_Interface ConDB]
|-  
|-  
Line 295: Line 301:
[https://fermi.servicenowservices.com/wp/?id=evg_sc_cat_item&sys_id=97be09036f276d005232ce026e3ee435 Add UID or GID to user]<BR>
[https://fermi.servicenowservices.com/wp/?id=evg_sc_cat_item&sys_id=97be09036f276d005232ce026e3ee435 Add UID or GID to user]<BR>
|
|
[http://www-giduid.fnal.gov/cd/FUE/uidgid/uid.lis UID list] [http://www-giduid.fnal.gov/cd/FUE/uidgid/gid.lis GID list]
[http://www-giduid.fnal.gov/cd/FUE/uidgid/uid.lis UID list] [http://www-giduid.fnal.gov/cd/FUE/uidgid/gid.lis GID list]<BR>
[https://fifemon.fnal.gov/monitor/d/6WPVJ87Zz/user-info FERRY user info]<BR>
|
|
|style="height: 50px"|
|style="height: 50px"|

Latest revision as of 18:33, 13 March 2025


Topic

Monitors

References

General

service status
outage calendar
disk space
/exp/mu2e disks usage and quotas
ganglia
ssimetrics test
problems test
web area quota
website stats
bluearc totals
mu2e E-log (ECL)
NW e-log
run search

Disks
mu2epro
Redmine projects
Redmine mu2e
Redmine ops
FIFE redmine
FIFE news
cert check
FIFE Wiki
token privileges
CSAID dashboard
slack backup
elog docs

Grid

grafana Mu2e
cluster summary
fife gpgrid
mu2epro sums
kibana
landscape
osgMon
conMon
jobMon
FNAL GRACC
fifebatch condor, by VO
Gratia Web
OSG Display
OSG Monitors
OSG Monitor Wiki
grafana (MWT2 gateway)

grids
FermiCloud OpenStack Service
kibana tutorial
GOC ticket
jobsub client
jobsub_lite github
VOMS lookup
FIFE wiki
FIFE sharepoint
HEPCloud HEPCloud HEPCloud wiki
OSG Wiki
FIFE grid sites
POMS wiki
landscape curl interface
NERSC

dCache

grafana
grafana2
dCache Load
dCache Response Time
ganglia
dCache grafana doc
gridftp pings
Active transfers
restore handler
pool queues
total activity plot
Pool usage
Activity plots
Pool usage grouped
persistant usage
lifetimes scratch tape
new lifetime
full file listing
Pool request queues
staged: digdtsmcscrv

web top
web top2
dCache doc
persistent datasets
ifdh redmine
REST API
swagger API

enstore

tape load
grafana
grafana2
grafana3
grafana4
restore handler
CTA tapes short long

enstore
web top
manual
tape queue
10KC 10KD LTO8F1 LTO8G2 TFF2
Active SFA
SFA doc
ff git repo

POMS

POMS production
monitor
trace a file
trace a file, with POMS
POMS dev

github:fermitools/poms
POMS redmine
FIFE_Launch redmine
project.py redmine
POMS wiki
POMS/ddisp
POMS/ddisp
POMS/ddisp github wiki

FTS

Raw Data Mover RDM
prod02
grafana
FTS rates

redmine
SshTunnel to view offsite
FTS in sl7 container

declad

prod02
landscape

github
wiki

SAM

SAM Dataset Listing
SAM Response Time
FifeMon
station monitor
projects monitor
station text
server

SAM
SamMetadata
SAM redmine
samweb redmine
sam-web-client redmine
dimensions

Rucio

TBA

Rucio
Rucio
github
redmine
mattermost

metacat

datasetMon
GUI

Rucio
docs
github
redmine

Data Dispatcher

GUI

Rucio
docs
github
redmine

database

browser
dbMon
no-cache
cache

ConditionsData
QE redmine github
ConDB

Code

valJob nightly
jenkins
github status
the following CI is paused
ci nightly
mu2e CI
mu2e CI dev

Jenkins
ValidationNotes
redmine
Docker service
scisoft

User Accounts

Add UID or GID to user

UID list GID list
FERRY user info