Workflows: Difference between revisions

Revision as of 17:46, 4 April 2017

Grids - overview of the computing farms and job submission
production simulation workflow - how to run simulation, concatenate and upload the files
scratch simulation workflow - how to run simulation to scratch areas for smaller jobs
MARS and G4Beamline workflow - these are not in the art framework
Prestage - make sure files have been retrieved off tape and are ready to use
GenerateFcl - generate fcl for simulation jobs
Concatenate - concatenation of art files
Upload - upload files outside of standard simulation workflows
mu2egrid - scripts for submission of common, structured jobs

dCache - the large aggregated data disk system
enstore - the mass storage tape system
Data transfer - how to move larger datasets, necessary for grid jobs
File names - how to name files for upload or for production
File families - the logical grouping of data on tapes
SAM - file metadata and data handling management system
- SAM metadata - the metadata stored for each file
- SAM expert - some notes for the future, not of general interest
File tools - tools for manipulating large file datasets and metadata
FTS Upload - deprecated method to upload by the FTS area

@@ Line 5: / Line 5: @@
 * [[MCProdWorkflow| production simulation workflow]] - how to run simulation, concatenate and upload the files
 * [[MCScrWorkflow| scratch simulation workflow]] - how to run simulation to scratch areas for smaller jobs
+* [[MARSWorkflow| MARS and G4Beamline workflow]] - these are not in the art framework
 * [[Prestage]] - make sure files have been retrieved off tape and are ready to use
 * [[GenerateFcl]] - generate fcl for simulation jobs