MCProdWorkflow: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
(Created page with "The <code>mu2egrid</code> package provides Mu2e-specific code required for using jobsub. All scripts in the package support the <code>--help</code> option. If it is present o...")
 
No edit summary
Line 5: Line 5:
support <code>--dry-run</code> and <code>--verbose</code> options to
support <code>--dry-run</code> and <code>--verbose</code> options to
show what will be done without performing the action.
show what will be done without performing the action.
To be able to use the full functionality of the system, such as
recovering failed jobs and/or storing outputs on tape, more steps are required:
<ol>
  <li>[generate_fcl.shtml Generate a set of fcl files]  that completely define the jobs to be run.
  <li>[fcl_upload.shtml Register]  the fcl dataset with SAM, and make fcl files available on /pnfs.
  <li>Make sure that input data files, if any, are [prestage.shtml pre-staged to disk] .
  <li>[mu2eprodsys.shtml Submit mu2eprodsys grid jobs] .
  <li>[postprocess.shtml#check Check results] , identify and re-run failed jobs.
  <li>[postprocess.shtml#store Store]  outputs on tape:
</ol>

Revision as of 19:43, 4 April 2017

The mu2egrid package provides Mu2e-specific code required for using jobsub. All scripts in the package support the --help option. If it is present on the command line, all other options will be ignored. All scripts also support --dry-run and --verbose options to show what will be done without performing the action.


To be able to use the full functionality of the system, such as recovering failed jobs and/or storing outputs on tape, more steps are required:

  1. [generate_fcl.shtml Generate a set of fcl files] that completely define the jobs to be run.
  2. [fcl_upload.shtml Register] the fcl dataset with SAM, and make fcl files available on /pnfs.
  3. Make sure that input data files, if any, are [prestage.shtml pre-staged to disk] .
  4. [mu2eprodsys.shtml Submit mu2eprodsys grid jobs] .
  5. [postprocess.shtml#check Check results] , identify and re-run failed jobs.
  6. [postprocess.shtml#store Store] outputs on tape: