Workflows: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
No edit summary
Line 4: Line 4:
* [[Grids|Grids]] - overview of the computing farms and job submission
* [[Grids|Grids]] - overview of the computing farms and job submission
* [[MCProdWorkflow| production simulation workflow]] - how to run simulation, concatenate and upload the files
* [[MCProdWorkflow| production simulation workflow]] - how to run simulation, concatenate and upload the files
* [[MCScrWorkflow| scratch simulation workflow]] - how to run simulation to scratch areas for smaller jobs
* [[MARSWorkflow| MARS and G4Beamline workflow]] - these are not in the art framework
* [[MARSWorkflow| MARS and G4Beamline workflow]] - these are not in the art framework
* [[JobPlan|Job planning]] - considerations of project CPU, disk,  memory and file size  
* [[JobPlan|Job planning]] - considerations of project CPU, disk,  memory and file size  

Revision as of 15:32, 14 April 2017


Workflow for jobs

Data Handling

  • dCache - the large aggregated data disk system
  • enstore - the mass storage tape system
  • Data transfer - how to move larger datasets, necessary for grid jobs
  • File names - how to name files for upload or for production
  • File families - the logical grouping of data on tapes
  • SAM - file metadata and data handling management system
    • SAM metadata - the metadata stored for each file
    • SAM expert - some notes for the future, not of general interest
  • File tools - tools for manipulating large file datasets and metadata
  • FTS Upload - deprecated method to upload by the FTS area

Operations