OfflineOps: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
No edit summary
No edit summary
(48 intermediate revisions by 2 users not shown)
Line 15: Line 15:
[https://fermi.servicenowservices.com/nav_to.do?uri=%2Fhome.do%3Fsysparm_view%3Dscd_outage_calendar outage calendar]<br>
[https://fermi.servicenowservices.com/nav_to.do?uri=%2Fhome.do%3Fsysparm_view%3Dscd_outage_calendar outage calendar]<br>
[http://mu2e.fnal.gov/atwork/computing/ops/diskMon.html disk space] <br>
[http://mu2e.fnal.gov/atwork/computing/ops/diskMon.html disk space] <br>
[http://metrics.fnal.gov/nas/metrics/exp-quota-reports/mu2e-app.html /mu2e/app usage and quotas] <br>
[https://landscape.fnal.gov/monitor/d/d4qZ8JSSz/cephfs-experiment-usage?orgId=1&var-group=mu2e&from=now-2d&to=now /exp/mu2e disks usage and quotas] <br>
[http://metrics.fnal.gov/nas/metrics/exp-quota-reports/mu2e-data.html /mu2e/data usage and quotas] <br>
[http://metrics.fnal.gov/nas/metrics/exp-quota-reports/mu2e-data2.html /mu2e/data2 usage and quotas] <br>
[http://ssiganglia.fnal.gov/ ganglia] <br>
[http://ssiganglia.fnal.gov/ ganglia] <br>
[https://ssimetrics.fnal.gov ssimetrics] <br>
[https://ssimetrics.fnal.gov ssimetrics] [https://ssimetrics.fnal.gov/ssi/d/000000005/problem-finder?orgId=1&var-zone=mu2e&var-role=All&var-hostname=All problems] (Both fgz/VPN)<br>
[http://metrics.fnal.gov/cws/apache.html web area quota]<br>
[http://metrics.fnal.gov/cws/apache.html web area quota]<br>
[https://mu2e.fnal.gov/awstats/awstats.pl website stats] <br>
[https://mu2e.fnal.gov/awstats/awstats.pl website stats] <br>
Line 32: Line 30:
[https://web.fnal.gov/project/FIFE/notes/Pages/default.aspx FIFE news] <BR>
[https://web.fnal.gov/project/FIFE/notes/Pages/default.aspx FIFE news] <BR>
[https://dbweb0.fnal.gov/ECL/mu2e mu2e E-log (ECL)]<BR>
[https://dbweb0.fnal.gov/ECL/mu2e mu2e E-log (ECL)]<BR>
[https://mu2e-elog.physics.northwestern.edu/elog NW e-log]<br>
[https://authentication.fnal.gov/check-my-cert/ cert check]<br>
[https://authentication.fnal.gov/check-my-cert/ cert check]<br>
[https://fifewiki.fnal.gov/wiki/Main_Page FIFE Wiki] <br>
[https://fifewiki.fnal.gov/wiki/Main_Page FIFE Wiki] <br>
[https://landscape.fnal.gov/monitor/d/56WoQ2cVk/token-scopes-capability-sets?orgId=1&var-experiment=mu2e&var-role=All token privileges]<br>
[https://landscape.fnal.gov/monitor/d/56WoQ2cVk/token-scopes-capability-sets?orgId=1&var-experiment=mu2e&var-role=All token privileges]<br>
[https://fermi.servicenowservices.com/$dashboards.do?sysparm_dashboard=3ddbafbb1bd22510d189426de54bcb92 CSAID dashboard]
[https://fermi.servicenowservices.com/$dashboards.do?sysparm_dashboard=3ddbafbb1bd22510d189426de54bcb92 CSAID dashboard]<br>
[https://slack.com/help/articles/201658943-Export-your-workspace-data slack backup]<br>
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 70: Line 70:
[https://ticket.grid.iu.edu/submit GOC ticket] <BR>
[https://ticket.grid.iu.edu/submit GOC ticket] <BR>
[https://cdcvs.fnal.gov/redmine/projects/jobsub/wiki/Using_the_Client jobsub client] <BR>
[https://cdcvs.fnal.gov/redmine/projects/jobsub/wiki/Using_the_Client jobsub client] <BR>
[https://fifewiki.fnal.gov/wiki/Getting_started_with_jobsub_lite jobsub_lite] <br>
[https://fifewiki.fnal.gov/wiki/Getting_started_with_jobsub_lite jobsub_lite] [https://github.com/fermitools/jobsub_lite github]<br>
[https://voms.fnal.gov:8443/ VOMS lookup] <BR>
[https://voms.fnal.gov:8443/ VOMS lookup] <BR>
[https://cdcvs.fnal.gov/redmine/projects/fife/wiki/ FIFE wiki] <br>
[https://cdcvs.fnal.gov/redmine/projects/fife/wiki/ FIFE wiki] <br>
Line 78: Line 78:
[https://cdcvs.fnal.gov/redmine/projects/fife/wiki/Information_about_job_submission_to_OSG_sites FIFE grid sites] <BR>
[https://cdcvs.fnal.gov/redmine/projects/fife/wiki/Information_about_job_submission_to_OSG_sites FIFE grid sites] <BR>
[https://cdcvs.fnal.gov/redmine/projects/prod_mgmt_db POMS wiki] <BR>
[https://cdcvs.fnal.gov/redmine/projects/prod_mgmt_db POMS wiki] <BR>
[http://cd-docdb.fnal.gov/cgi-bin/RetrieveFile?docid=6411&filename=Landscape%20Data.pdf&version=1 landscape curl interface]
[http://cd-docdb.fnal.gov/cgi-bin/RetrieveFile?docid=6411&filename=Landscape%20Data.pdf&version=1 landscape curl interface]<br>
[https://www.nersc.gov/ NERSC]<br>
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 95: Line 96:
[http://fermicloudrsv.fnal.gov/rsv/ gridftp pings] <BR>
[http://fermicloudrsv.fnal.gov/rsv/ gridftp pings] <BR>
[http://fndca3a.fnal.gov:2288/context/transfers.html Active transfers] <br>
[http://fndca3a.fnal.gov:2288/context/transfers.html Active transfers] <br>
[http://fndca3a.fnal.gov:2288/queueInfo Connections] <br>
[https://fndca.fnal.gov:22880/poolInfo/restoreHandler/lazy restore handler] <br>
[http://fndca3a.fnal.gov:2288/poolInfo/restoreHandler/lazy restore handler] <br>
[http://fndca.fnal.gov:2288/webadmin/queueinfo?11 pool queues] <br>
[http://fndca.fnal.gov:2288/webadmin/queueinfo?11 pool queues] <br>
[http://fndca.fnal.gov:2288/webadmin/poolqueueplots total activity plot] <br>
[http://fndca.fnal.gov:2288/webadmin/poolqueueplots total activity plot] <br>
Line 106: Line 106:
[http://fndca.fnal.gov/dcache/lifetime//PublicScratchPools.jpg scratch]
[http://fndca.fnal.gov/dcache/lifetime//PublicScratchPools.jpg scratch]
[http://fndca.fnal.gov/dcache/lifetime//readWritePools.jpg tape]<br>
[http://fndca.fnal.gov/dcache/lifetime//readWritePools.jpg tape]<br>
[https://fndca.fnal.gov:3880/#!/admin/pool-plots new lifetime]
[https://fndca.fnal.gov:3880/#!/admin/pool-plots new lifetime]<br>
[https://www-stken.fnal.gov/cgi-bin/enstore_file_listing_cgi.py full file listing]<br>
[https://fndca.fnal.gov:22880/queueInfo Pool request queues] (VPN)
|
|
[http://fndca.fnal.gov/ web top] <br>
[http://fndca.fnal.gov/ web top] <br>
Line 112: Line 114:
[https://cd-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=5399 dCache doc] <br>
[https://cd-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=5399 dCache doc] <br>
[https://docs.google.com/spreadsheets/d/10BqW8WBnh0EzGUbr84J2GRdVFrMaLpgTNPb8imnW4Uk/edit#gid=0 persistent datasets]<br>
[https://docs.google.com/spreadsheets/d/10BqW8WBnh0EzGUbr84J2GRdVFrMaLpgTNPb8imnW4Uk/edit#gid=0 persistent datasets]<br>
[https://cdcvs.fnal.gov/redmine/projects/ifdhc ifdh redmine]
[https://cdcvs.fnal.gov/redmine/projects/ifdhc ifdh redmine]<BR>
[https://docs.google.com/document/d/1Zx_H5dRkQRfju3xIYZ2WgjKoOvmLtsafP2pKGpHqcfY/edit#heading=h.ozszs1lr7q93 REST API]<BR>
[https://fndca1.fnal.gov:3880/api/v1/# swagger API]
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 129: Line 133:
|
|
[[Enstore|enstore]] <br>
[[Enstore|enstore]] <br>
[http://www-ccf.fnal.gov/enstore/ web top] <br>
[https://www-stken.fnal.gov/enstore/enstore_system.html web top] <br>
[http://cd-docdb.fnal.gov/cgi-bin/ShowDocument?docid=5420 manual]<br>
[http://cd-docdb.fnal.gov/cgi-bin/ShowDocument?docid=5420 manual]<br>
[https://www-stken.fnal.gov/enstore/status_enstore_system.html tape queue] <BR>
[https://www-stken.fnal.gov/enstore/status_enstore_system.html tape queue] <BR>
Line 147: Line 151:
| POMS
| POMS
|
|
[https://pomsgpvm01.fnal.gov/poms/index/mu2e/production POMS production]<BR>
[https://pomsgpvm02.fnal.gov/poms/index/mu2e/production POMS production]<BR>
[https://mu2e.fnal.gov/cgi-bin/production/index monitor]<BR>
[https://landscape.fnal.gov/kibana/goto/4de839d0a732323c76477a77597fa676 trace a file]<br>
[https://landscape.fnal.gov/kibana/goto/6742cb6d9ca50da2bde68a9e59cf13d1 trace a file, with POMS]<br>
[http://fermicloud821.fnal.gov/poms POMS dev] <br>
|
|
[https://github.com/fermitools/poms github:fermitools/poms ] <br>
[https://cdcvs.fnal.gov/redmine/projects/prod_mgmt_db/wiki POMS redmine ]<BR>
[https://cdcvs.fnal.gov/redmine/projects/prod_mgmt_db/wiki POMS redmine ]<BR>
[https://cdcvs.fnal.gov/redmine/projects/fife_utils/wiki/Fife_launchfife_wrap FIFE_Launch redmine ]<BR>
[https://cdcvs.fnal.gov/redmine/projects/fife_utils/wiki/Fife_launchfife_wrap FIFE_Launch redmine ]<BR>
[https://cdcvs.fnal.gov/redmine/projects/project-py/wiki project.py redmine] <BR>
[https://cdcvs.fnal.gov/redmine/projects/project-py/wiki project.py redmine] <BR>
[[POMS|POMS wiki]] <BR>
[[POMS|POMS wiki]] <BR>
[https://fermicloud821.fnal.gov/docs/gui_workflow_editor_user_guide/index.html POMS/ddisp] <BR>
[https://fermicloud821.fnal.gov/docs/experimenters_corner/data_dispatcher/index.html POMS/ddisp] <BR>
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 160: Line 171:
| FTS
| FTS
|
|
Raw Data Mover [https://mu2e.fnal.gov/atwork/computing/ops/rdm/rdm.html trk]<BR>
Raw Data Mover [https://mu2e.fnal.gov/atwork/computing/ops/rdm/rdm.html RDM]<BR>
[http://mu2e.fnal.gov/atwork/computing/ops/ftsMon.html FTS listing] <BR>
[http://mu2eprodgpvm02.fnal.gov:8787/fts/status prod02] <br>
[http://mu2esamgpvm01.fnal.gov:8787/fts/status 01]
[http://mu2esamgpvm02.fnal.gov:8787/fts/status 02]
[http://mu2esamgpvm03.fnal.gov:8787/fts/status 03] <br>
[https://fifemon.fnal.gov/monitor/d/000000032/fts?refresh=5m&orgId=1&var-experiment=mu2e&var-instance=All grafana] <BR>
[https://fifemon.fnal.gov/monitor/d/000000032/fts?refresh=5m&orgId=1&var-experiment=mu2e&var-instance=All grafana] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/ftsMonLog.html FTS rates] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/ftsMonLog.html FTS rates] <BR>
|
|
[https://cdcvs.fnal.gov/redmine/projects/filetransferservice redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/filetransferservice redmine]<br>
[[SshTunnel]] to view offsite  
[[SshTunnel]] to view offsite <br>
[https://cdcvs.fnal.gov/redmine/projects/filetransferservice/wiki FTS in sl7 container]
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
|  
|  
|-
| declad
|
[http://mu2eprodgpvm02.fnal.gov:8080/mu2eprodgpvm02-declad/index prod02] <br>
[https://landscape.fnal.gov/lens/view/declad/mu2e-offline0/index landscape] <br>
|
[https://github.com/fermitools/declad github]<br>
[https://github.com/fermitools/declad/wiki wiki]<br>
|-
|style="height: 50px"|
|
|  
|  
|-
|-
Line 180: Line 200:
[http://mu2e.fnal.gov/atwork/computing/ops/samTimeMon.html SAM Response Time] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/samTimeMon.html SAM Response Time] <BR>
[https://fifemon.fnal.gov/monitor/d/000000122/sam-by-experiment?orgId=1&var-experiment=mu2e&from=now-30d&to=now FifeMon ] <BR>
[https://fifemon.fnal.gov/monitor/d/000000122/sam-by-experiment?orgId=1&var-experiment=mu2e&from=now-30d&to=now FifeMon ] <BR>
[http://samweb.fnal.gov:8480/station_monitor/mu2e/stations/mu2e/projects station monitor] <BR>
[https://sammu2e.fnal.gov:8483/station_monitor/sammu2e/stations/mu2e/projects station monitor] <BR>
[http://samweb.fnal.gov:8480/sam/mu2e/api/running/projects projects monitor] <BR>
[https://sammu2e.fnal.gov:8483/sam/mu2e/api/running/projects projects monitor] <BR>
[https://samwebgpvm05.fnal.gov:8483/sam/mu2e/stations/mu2e/status?format=plain station text] <BR>
[https://sammu2e.fnal.gov:8483/sam/mu2e/stations/mu2e/status?format=plain station text] <BR>
[https://ssimetrics.fnal.gov/ssi/d/000000004/node-view?orgId=1&var-zone=sam&var-role=interactive&var-hostname=samwebgpvm05 server]<br>  
[https://ssimetrics.fnal.gov/ssi/d/000000004/node-view?orgId=1&var-zone=sam&var-role=interactive&var-hostname=samwebgpvm05 server]<br>  
|
|
Line 189: Line 209:
[https://cdcvs.fnal.gov/redmine/projects/sam-main SAM redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/sam-main SAM redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/sam-web samweb redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/sam-web samweb redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/sam-web-client/wiki sam-web-client redmine]<br>
[https://samweb.fnal.gov:8483/sam/mu2e/api/files/list/dimensions dimensions]
[https://samweb.fnal.gov:8483/sam/mu2e/api/files/list/dimensions dimensions]
|-  
|-  
Line 199: Line 220:
TBA <BR>
TBA <BR>
|
|
[[Rucio]] [https://rucio.cern.ch/ Rucio] <br>
[[Rucio]]<br>
[https://github.com/rucio github]   [https://cdcvs.fnal.gov/redmine/projects/rucio-bde redmine]<br>
[https://rucio.cern.ch/ Rucio] <br>
[https://github.com/rucio github]<br>
[https://cdcvs.fnal.gov/redmine/projects/rucio-bde redmine]<br>
[https://mattermost.web.cern.ch/rucio/channels/support mattermost] <br>
|-  
|-  
|style="height: 50px"|
|style="height: 50px"|
Line 208: Line 232:
| metacat
| metacat
|
|
TBA <BR>
[https://mu2e.fnal.gov/atwork/computing/ops/datasetMon.html datasetMon]<BR>
[https://metacat.fnal.gov:9443/mu2e_meta_prod/app/gui/datasets GUI] <BR>
|
|
[[Rucio]]<br>
[[Rucio]]<br>
[https://metacat.readthedocs.io/en/latest/ docs] <br>
[https://metacat.readthedocs.io/en/latest/ docs] <br>
[https://github.com/fermitools/metacat github]<br>
[https://cdcvs.fnal.gov/redmine/projects/metacat redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/metacat redmine]<br>
|-  
|-  
Line 220: Line 246:
| Data Dispatcher
| Data Dispatcher
|
|
TBA <BR>
[https://metacat.fnal.gov:9443/mu2e_dd_prod/gui/index GUI] <BR>
|
|
[[Rucio]]<br>
[[Rucio]]<br>
[https://data-dispatcher.readthedocs.io/en/latest/ docs]<br>
[https://github.com/fermitools/data_dispatcher github]<br>
[https://cdcvs.fnal.gov/redmine/projects/data-dispatcher redmine]<br>
[https://cdcvs.fnal.gov/redmine/projects/data-dispatcher redmine]<br>
|-  
|-  
Line 246: Line 274:
| Code
| Code
|
|
[http://mu2e.fnal.gov/atwork/computing/ops/val/valJob/nightly/nightly.html valJob nightly] <BR>
[http://mu2e.fnal.gov/atwork/computing/ops/val/valJob2/nightly/nightly.html valJob nightly] <BR>
[https://buildmaster.fnal.gov/buildmaster jenkins] <br>
[https://buildmaster.fnal.gov/buildmaster jenkins] <br>
[https://www.githubstatus.com/ github status]<br>
[https://www.githubstatus.com/ github status]<br>
Line 267: Line 295:
|
|
[https://fermi.servicenowservices.com/wp/?id=evg_sc_cat_item&sys_id=97be09036f276d005232ce026e3ee435 Add UID or GID to user]<BR>
[https://fermi.servicenowservices.com/wp/?id=evg_sc_cat_item&sys_id=97be09036f276d005232ce026e3ee435 Add UID or GID to user]<BR>
|
[http://www-giduid.fnal.gov/cd/FUE/uidgid/uid.lis UID list] [http://www-giduid.fnal.gov/cd/FUE/uidgid/gid.lis GID list]<BR>
[https://fifemon.fnal.gov/monitor/d/6WPVJ87Zz/user-info FERRY user info]<BR>
|
|
|style="height: 50px"|
|style="height: 50px"|

Revision as of 20:20, 14 November 2024


Topic

Monitors

References

General

service status
outage calendar
disk space
/exp/mu2e disks usage and quotas
ganglia
ssimetrics problems (Both fgz/VPN)
web area quota
website stats
bluearc totals

Disks
mu2epro
Redmine projects
Redmine mu2e
Redmine ops
FIFE redmine
FIFE news
mu2e E-log (ECL)
NW e-log
cert check
FIFE Wiki
token privileges
CSAID dashboard
slack backup

Grid

grafana Mu2e
grafana fifebatch fife gpgrid
mu2epro sums
hepcloud
kibana
landscape
conMon
jobMon
osgMon
FNAL GRACC
fifebatch condor, by VO
Gratia Web
OSG Display
OSG Monitors
OSG Monitor Wiki
grafana (MWT2 gateway)
POMS

grids
FermiCloud OpenStack Service
kibana tutorial
GOC ticket
jobsub client
jobsub_lite github
VOMS lookup
FIFE wiki
FIFE sharepoint
HEPCloud HEPCloud HEPCloud wiki
OSG Wiki
FIFE grid sites
POMS wiki
landscape curl interface
NERSC

dCache

grafana
grafana2
dCache Load
dCache Response Time
ganglia
dCache grafana doc
gridftp pings
Active transfers
restore handler
pool queues
total activity plot
Pool usage
Activity plots
Pool usage grouped
persistant usage
lifetimes scratch tape
new lifetime
full file listing
Pool request queues (VPN)

web top
web top2
dCache doc
persistent datasets
ifdh redmine
REST API
swagger API

enstore

tape load
grafana
grafana2
grafana3
grafana4
restore handler

enstore
web top
manual
tape queue
10KC 10KD LTO8F1 LTO8G2 TFF2
Active SFA
SFA doc

POMS

POMS production
monitor
trace a file
trace a file, with POMS
POMS dev

github:fermitools/poms
POMS redmine
FIFE_Launch redmine
project.py redmine
POMS wiki
POMS/ddisp
POMS/ddisp

FTS

Raw Data Mover RDM
prod02
grafana
FTS rates

redmine
SshTunnel to view offsite
FTS in sl7 container

declad

prod02
landscape

github
wiki

SAM

SAM Dataset Listing
SAM Response Time
FifeMon
station monitor
projects monitor
station text
server

SAM
SamMetadata
SAM redmine
samweb redmine
sam-web-client redmine
dimensions

Rucio

TBA

Rucio
Rucio
github
redmine
mattermost

metacat

datasetMon
GUI

Rucio
docs
github
redmine

Data Dispatcher

GUI

Rucio
docs
github
redmine

database

browser
dbMon
no-cache
cache

ConditionsData
QE redmine
ConDB

Code

valJob nightly
jenkins
github status
the following CI is paused
ci nightly
mu2e CI
mu2e CI dev

Jenkins
ValidationNotes
redmine
Docker service
scisoft

User Accounts

Add UID or GID to user

UID list GID list
FERRY user info
Retrieved from "http://mu2ewiki.fnal.gov/w/index.php?title=OfflineOps&oldid=26508"