Workflows: Difference between revisions
Jump to navigation
Jump to search
| Line 3: | Line 3: | ||
== Workflow for jobs == | == Workflow for jobs == | ||
* [[Grids|Grids]] - overview of the computing farms and job submission | * [[Grids|Grids]] - overview of the computing farms and job submission | ||
* [https://cdcvs.fnal.gov/redmine/projects/mu2egrid/wiki mu2egrid] - submission of common, structured jobs | * [https://cdcvs.fnal.gov/redmine/projects/mu2egrid/wiki mu2egrid] - scripts for submission of common, structured jobs | ||
* [[MCWorkflow| MC workflow]] - how to run simulation and optionally concatenate and upload the files | * [[MCWorkflow| MC workflow]] - how to run simulation and optionally concatenate and upload the files | ||
* [[Prestage]] - make sure files have been retrieved off tape and are ready to use | * [[Prestage]] - make sure files have been retrieved off tape and are ready to use | ||
Revision as of 19:23, 3 April 2017
Workflow for jobs
- Grids - overview of the computing farms and job submission
- mu2egrid - scripts for submission of common, structured jobs
- MC workflow - how to run simulation and optionally concatenate and upload the files
- Prestage - make sure files have been retrieved off tape and are ready to use
Data Handling
- dCache - the large aggregated data disk system
- enstore - the mass storage tape system
- Data transfer - how to move larger datasets, necessary for grid jobs
- File names - how to name files for upload or for production
- File families - the logical grouping of data on tapes
- SAM - file metadata and data handling management system
- SAM metadata - the metadata stored for each file
- SAM expert - some notes for the future, not of general interest
- Upload - writing files to mass storage tape
- MC workflow - how to run simulation and optionally concatenate and upload the files
- Upload files - how to upload existing files
- File tools - tools for manipulating large file datasets and metadata
- FTS Upload - deprecated method to upload by the FTS area