Workflows: Difference between revisions
Jump to navigation
Jump to search
| Line 20: | Line 20: | ||
** [[SamMetadata|SAM metadata]] - the metadata stored for each file | ** [[SamMetadata|SAM metadata]] - the metadata stored for each file | ||
** [[SamExpert|SAM expert]] - some notes for the future, not of general interest | ** [[SamExpert|SAM expert]] - some notes for the future, not of general interest | ||
* [[FileTools|File tools]] - tools for manipulating large file datasets and metadata | |||
* [[UploadFTS|FTS Upload]] - deprecated method to upload by the FTS area | * [[UploadFTS|FTS Upload]] - deprecated method to upload by the FTS area | ||
Revision as of 20:27, 3 April 2017
Workflow for jobs
- Grids - overview of the computing farms and job submission
- production simulation workflow - how to run simulation, concatenate and upload the files
- scratch simulation workflow - how to run simulation to scratch areas for smaller jobs
- Prestage - make sure files have been retrieved off tape and are ready to use
- GenerateFcl - generate fcl for simulation jobs
- Concatenate - concatenation of art files
- Upload - upload files outside of standard simulation workflows
- mu2egrid - scripts for submission of common, structured jobs
Data Handling
- dCache - the large aggregated data disk system
- enstore - the mass storage tape system
- Data transfer - how to move larger datasets, necessary for grid jobs
- File names - how to name files for upload or for production
- File families - the logical grouping of data on tapes
- SAM - file metadata and data handling management system
- SAM metadata - the metadata stored for each file
- SAM expert - some notes for the future, not of general interest
- File tools - tools for manipulating large file datasets and metadata
- FTS Upload - deprecated method to upload by the FTS area