MDC2020: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
 
(102 intermediate revisions by 6 users not shown)
Line 4: Line 4:
complete and accurate model of what Mu2e will record during commissioning and first running period ('Run 1', add reference),
complete and accurate model of what Mu2e will record during commissioning and first running period ('Run 1', add reference),
including OnSpill, OffSpill, and Extracted Position samples.  The primary intended use case of these samples are:
including OnSpill, OffSpill, and Extracted Position samples.  The primary intended use case of these samples are:
* General Notes and Updates
* Detector calibration and alignment, including cross-system (ie CRV to Calo) calibrations
* Detector calibration and alignment, including cross-system (ie CRV to Calo) calibrations
* Detector commissioning
* Detector commissioning
Line 11: Line 12:
* Science extraction framework and algorithm development
* Science extraction framework and algorithm development


The samples have been produced using [[POMS]].
The detailed technical documentation of MDC2020 is in [https://mu2e-docdb.fnal.gov/cgi-bin/sso/ShowDocument?docid=44084 Doc-DB 44084].  These pages provide a list of the datasets produced and give
time-dependent information.


==Detector Geometry==
==General Notes and Updates==
The detector geometry and material configuration used in MDC2020 is documented in X (add reference).  A brief description
As reported in [https://mu2e-docdb.fnal.gov/cgi-bin/sso/ShowDocument?docid=48705 this presentation] the G4 code used in all the MDC2020 simulations had missing contributions from delta rays in the calorimeter.  This appears to mostly affect signals from cosmic muons.  For precision studies using cosmic muons please contact the experts.
of the major features is included below.


==Detector Response Simulation==
==Simulation Workflow==
The detector response simulations used for MDC2020 include detailed models of the micro-physics (below the level of the Geant4
The samples described on this page were produced using the following workflows.  Jobs were submitted using [[POMS]].
energy deposition), and the translation of those processes into digital signals.  Details are described in the notes
referenced in the table below.  Note that a detailed model of the timing distribution system is also part of the digitization
model.


==Simulation Workflow==
[[File:SimulationWorkflow.png|1024px|center|The workflow used for MDC2020.]]
[[File:SimulationWorkflow.png|1024px|center|The workflow used for MDC2020.]]


 
===Cosmic Simulation campaigns===
===Cosmic Simulation POMS campaign===
[[File:Corsika poms.png|1024px|center|POMS campaign for cosmic rays.]]
 
 
The cosmic simulation creates a sample of cosmic rays with three different configurations:  
The cosmic simulation creates a sample of cosmic rays with three different configurations:  


Line 37: Line 30:
* Extracted position, magnetic field off
* Extracted position, magnetic field off


The current available datasets are:


'''Standard position, magnetic field on'''
====Standard position, magnetic field on - CORSIKA====
    dts.mu2e.CosmicCORSIKACat.MDC2020n_10h.art
 
    dig.mu2e.CosmicCORSIKADigiTriggered.MDC2020n_10h.art
{| class="wikitable"
    dig.mu2e.CosmicCORSIKADigiUntriggered.MDC2020n_10h.art
! Stage !! S1 !! Size [T] !! Event count [1M] !! Event count/per file !! Livetime [s] per file !! nFiles !! Version !! Live-time [sec] !! Resampling factor
    mcs.mu2e.CosmicCORSIKADigiTriggered.MDC2020n_10h.art
|-
    dig.mu2e.CosmicCORSIKAMixTriggered.MDC2020kn_10h.art
| S1 || sim.mu2e.CosmicDSStopsCORSIKA.MDC2020ab.art || 0.122 || 1.8E+07 || 215.1 || 0.0534 || 82,330 || MDC2020ab || 4394 || NA
    dig.mu2e.CosmicCORSIKAMixUntriggered.MDC2020kn_10h.art
|-
    mcs.mu2e.CosmicCORSIKAMixTriggered.MDC2020kn_10h.art
| S1 || sim.mu2e.CosmicDSStopsCORSIKALow.MDC2020ab.art || 0.019 || 2.7E+06 || 32.6 || 0.0534 || 82,332 || MDC2020ab || 4394 || NA
|-
| S2 || dts.mu2e.CosmicCORSIKALow.MDC2020ae.art || 30 || 0.6E+09 || 7372 || 850 || 78,942 || MDC2020ae || 6.7E7 || 15000
|-
 
| S2 || dts.mu2e.CosmicCORSIKAAll.MDC2020ae.art || 36 || 4.3E+09 || 53346 || 123 || 81,134 || MDC2020ae || 1.0E+07 || 2,278
|-
 
| S2 filt || dts.mu2e.CosmicCORSIKASignalAll.MDC2020ae.art || 0.33 || 9.6E+06 || 11792 || 12469 || 812 || MDC2020ae || 1.0E+07 || 2,278
|-
| S2 filt || dts.mu2e.CosmicCORSIKACalibAll.MDC2020ae.art || 0.10 || 1.1E+07 || 13833 || 125 || 812 || MDC2020ae || 1.0E+05 ||
|-
| S2 filt || dts.mu2e.CosmicCORSIKASignalAll.MDC2020ag.art || 0.33 || 9.6E+06 || 11792 || 12469 || 81,134 || MDC2020ag || 1.0E+07 || 2,278
|-
| S2 filt || dts.mu2e.CosmicCORSIKACalibAll.MDC2020ag.art || 0.10 || 1.1E+07 || 13833 || 125 || 81,134 || MDC2020ag || 1.0E+05 ||
|}
 
====Standard position, magnetic field on - CRY====


'''Extracted position, magnetic field off'''
{| class="wikitable"
    dts.mu2e.CosmicCORSIKAExtractedNoFieldCat.MDC2020p.art
! Stage !! S1 !! Size [T] !! Event count !! Event count/per file !! Livetime [s] per file !! nFiles !! Version !! Live-time [sec] !! Resampling factor
    dig.mu2e.CosmicCORSIKAExtractedNoFieldCatTrk.MDC2020pq.art
|-
    dig.mu2e.CosmicCORSIKAExtractedNoFieldCatCalo.MDC2020pq.art
| S1 || sim.mu2e.CosmicDSStopsCRY.010622.art || 13.6 || 2.0E+09 || 42280.9 || 11.835 || 46,981 || MDC2020n || 556000 || NA
    dig.mu2e.CosmicCORSIKAExtractedNoFieldCatUntriggered.MDC2020pq.art
|-
| S1 || sim.mu2e.CosmicDSStopsLowCRY.010622.art || 0.71 || 2.4E+08 || 5204.2 || 11.835 || 46,981 || MDC2020n || 556000 || NA
|-
| S2 || dts.mu2e.CosmicCRYAll.MDC2020ae.art || 39 || 4.4E+09 || 54007 || 130 || 82,141 || MDC2020ae || 1.1E+07 || 19
|-
| S2 filt || dts.mu2e.CosmicCRYSignalAll.MDC2020ae.art || 0.36 || 1E7 || 12226 || 12991 || 822 || MDC2020ae || 1.1E+07 || 19
|-
| S2 filt || dts.mu2e.CosmicCRYCalibAll.MDC2020ae.art || 0.11 || 1.2E7 || 14150 || 130 || 822 || MDC2020ae || 1.1E+05 ||
|}


===Beam Simulation POMS campaign===
===Beam Simulation POMS campaign===
Line 62: Line 79:
For each primary (e.g. DIO, CeEndpoint, CePlusEndpoint, etc.) we run digitization and reconstruction with ("mix" output) and without beam mixing ("digi" output). The beam mixing stream is divided into three branches one per configuration ("perfect", "best", "reco").
For each primary (e.g. DIO, CeEndpoint, CePlusEndpoint, etc.) we run digitization and reconstruction with ("mix" output) and without beam mixing ("digi" output). The beam mixing stream is divided into three branches one per configuration ("perfect", "best", "reco").


===Datasets===
To run mixing on a new primary you should use a clone of the production POMS campaign, substituting your primary for one of the existing (CeEndpont, etc).  Note that the new primary must have been entered into the SAM database as part of MDC2020 production, preferably using a clone of the primary POMS campaign.
 
to TEST mixing, you can manually invoke the scripts, as in the following example:
> cd mymusedir
> muse setup
> setup dhtools
> setup mu2etools
> kx509
> vomsCert
> git clone git@github.com:Mu2e/Production.git
> source Production/Scripts/gen_Mix.sh CeEndpoint MDC2020 p r v perfect v2_0 1BB
> mu2e -c CeEndpointMix1BB_000/cnf.mu2e.CeEndpointMix1BB.MDC2020v_perfect_v2_0.001210_00000000.fcl --nevts 10
 
== Recent Campaigns ==
 
The most recent MDC2020 campaigns are detailed below along with their Offline and Production versions as well as any useful information:
 
{| class="wikitable"
|-
!| Campaign
!| Offline ver
!| Production ver
!| mu2e_trig_config ver
!| Comments
|-
|<tt>MDC2020ae</tt>
|<tt>v10_29_00</tt>
|<tt>v00_21_00</tt>
|<tt>v01_02_00</tt>
|<tt>Re-digitization and re-reconstruction of all datasets, new CORSIKA datasets </tt>
|-
|<tt>MDC2020z</tt>
|<tt>v10_23_01</tt>
|<tt>v00_16_00</tt>
|<tt>-</tt>
|<tt>Re-reconstruction of some datasets</tt>
|-
|<tt>MDC2020v</tt>
|<tt>v10_20_00</tt>
|<tt>v00_12_00</tt>
|<tt>-</tt>
|<tt>Special run (see below), not for standard physics studies! </tt>
|-
|<tt>MDC2020t</tt>
|<tt>v10_17_00</tt>
|<tt>v00_09_11 </tt>
|<tt>-</tt>
|<tt>several updates to many directories </tt>
|-
|<tt>MDC2020r</tt>
|<tt>v00_09_02</tt>
|<tt>v10_15_01</tt>
|<tt>-</tt>
|<tt>bug fix for digi stage</tt>
|-
|}
 
==Current Datasets==
These are the datasets currently available which correspond to the full 100% campaign. The three digi and reco configurations ("perfect", "best", "reco") correspond to three different detector conditions as described in [https://mu2e-docdb.fnal.gov/cgi-bin/private/RetrieveFile?docid=42036&filename=purpose.key.pdf&version=1 DocDB 42036].   
These are the datasets currently available which correspond to the full 100% campaign. The three digi and reco configurations ("perfect", "best", "reco") correspond to three different detector conditions as described in [https://mu2e-docdb.fnal.gov/cgi-bin/private/RetrieveFile?docid=42036&filename=purpose.key.pdf&version=1 DocDB 42036].   


To obtain details (number of events, number of files, GB, etc.) about a dataset you can use the <tt>datasetSummary.sh</tt> script, available in the Production repository.
Note that, to obtain consistent results, you should use the same database version to process a dataset as it was produced with.  Thus to read dig.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art, you should configure your job to use database purpose 'best', version v1_3.  For more details see the description of the [[ConditionsData#Using_the_conditions_database|conditions database]].
Note that datasets can require specific versions of our codes to process, as documented in the following table.  Use of an inconsistent code version may result in job failure (exception) or incorrect results.
{| class="wikitable"
|-
| Database version of dataset
| Offline tag for processing dig (digis)
| TrkAna tag for processing mcs (reco)
|-
|<tt>v1_3.art</tt>
|>= v10_29_00 or HEAD
|>= v05_02_00 or HEAD
|-
|<tt>v1_1.art</tt>
|<= v10_28_00 *
|<= v05_01_00
|}
* Note that v1_1 and older digi datasets may still be processed by modern versions of Offline using additional fcl overrides described [[CalibrationSets#Working_with_incompatible_older_data_sets|here]]. mcs files produced this way can be used with any version of TrkAna.
=== Reprocessed digitization and reconstruction datasets [2024]===
In May 2024 several samples were remade from the dts->digi and digi-->reco stages to incorporate updates in digitization algorithms, triggering, trigger streams, reconstruction, and db changes.
The digitization stream is divided into 'Triggered', ie events which passed at least one reco-object based trigger selections, and 'Triggerable', ie events which pass a MC-truth based filter similar to the trigger selection.  Note that these sets are not miscible (cannot be read in the same job) and the events selected do not have any pre-determined relation, ie one is not a subset of the other.
Mixed:
{| class="wikitable"
! Digi !! Reco !! NTuple !! Comments
|-
| dig.mu2e.CeEndpointMix1BBTriggered.MDC2020ae_best_v1_3.art || None ||  ||
|-
| dig.mu2e.CeEndpointMix1BBTriggered.MDC2020ae_perfect_v1_3.art || None ||  ||
|-
| dig.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_best_v1_3.art ||  ||
|-
| dig.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.CePlusEndpointMix1BBTriggered.MDC2020ae_best_v1_3.art || None ||  ||
|-
| dig.mu2e.CePlusEndpointMix1BBTriggered.MDC2020ae_perfect_v1_3.art || None ||  ||
|-
| dig.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_best_v1_3.art ||  ||
|-
| dig.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_best_v1_3.art ||  ||
|-
| dig.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|}
Primaries:
{| class="wikitable"
! Digi !! Reco !! NTuple !! Comments
|-
| dig.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art ||  ||
|-
| dig.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art ||  ||
|-
| dig.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_best_v1_3.art ||  ||
|-
| dig.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_best_v1_3.art ||  ||
|-
| dig.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.CosmicCORSIKASignalAllOffSpillTriggered.MDC2020ae_best_v1_3.art || None ||  ||
|-
| dig.mu2e.CosmicCORSIKASignalAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.CosmicCORSIKASignalAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.CosmicCORSIKASignalAllOnSpillTriggered.MDC2020ae_best_v1_3.art || None ||  ||
|-
| dig.mu2e.CosmicCORSIKASignalAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art || mcs.mu2e.CosmicCORSIKASignalAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art ||  ||
|-
| dig.mu2e.CosmicCRYExtractedCatTriggered.MDC2020ae_best_v1_3.art || mcs.mu2e.CosmicCRYExtractedCatTriggered.MDC2020ae_best_v1_3.art ||  ||
|}
=== Reprocessed reconstruction datasets [2023]===
In Sept 2023 several samples were remade from the digi-->reco stage to incorporate updates in reconstruction and db changes.
{| class="wikitable"
|-
!| Digi
!| Reco
!| NTuple
!| Comments
|-
|<tt>dig.mu2e.CeEndpointMix1BBSignal.MDC2020r_best_v1_0.art</tt>
|<tt>mcs.mu2e.CeEndpointMix1BBSignal.MDC2020z_best_v1_1.art</tt>
|<tt>nts.mu2e.CeEndpointMix1BBSignalMix1BB.MDC2020z1_best_v1_1_std_v04_01_00.tka</tt>
|<tt></tt>
|-
|-
|<tt>dig.mu2e.FlateminusMix1BBSignal.MDC2020r_best_v1_0.art</tt>
|<tt>mcs.mu2e.FlateminusMix1BBSignal.MDC2020z_best_v1_1.art</tt>
|<tt></tt>
|<tt></tt>
|-
|-
|<tt>dig.mu2e.CosmicCRYExtractedCatDigiTrk.MDC2020r.art</tt>
|<tt>mcs.mu2e.CosmicCRYExtractedCatDigiTrk.MDC2020z.art</tt>
|<tt>nts.mu2e.CosmicCRYExtractedTrk.MDC2020z1_best_v1_1_std_v04_01_00.tka</tt>
|<tt>naming issue: best, v1_1</tt>
|}
=== Original datasets; most of these have been supersceded.  You must use an appropriate tag of Mu2e code to process these datasets, see the table above  ===
The digitization stream is divided into five parts: Signal, Diag, Trk, Calo, Untriggered, which are described in [https://mu2e-docdb.fnal.gov/cgi-bin/sso/ShowDocument?docid=41757 DocDB 41757]. To obtain details (number of events, number of files, GB, etc.) about a dataset you can use the <tt>datasetSummary.sh</tt> script, available in the Production repository.  
The digitization stream is divided into five parts: Signal, Diag, Trk, Calo, Untriggered, which are described in [https://mu2e-docdb.fnal.gov/cgi-bin/sso/ShowDocument?docid=41757 DocDB 41757]. To obtain details (number of events, number of files, GB, etc.) about a dataset you can use the <tt>datasetSummary.sh</tt> script, available in the Production repository.  


In the following summary, <tt>[stream]</tt> can be '''Untriggered''', '''Calo''', '''Signal''', '''Diag''', '''Trk''' and <tt>[purpose]</tt> can be '''perfect''', '''best''', '''startup'''. The digitization <tt>[digi]</tt> can be '''Mix''' for mixed samples, '''OnSpill''' for unmixed samples. '''1BB''' means 1-bunch beam and '''2BB''' means 2-bunch beam.
In the following summary, <tt>[stream]</tt> can be '''Untriggered''', '''Calo''', '''Signal''', '''Diag''', '''Trk''' and <tt>[purpose]</tt> can be '''perfect''', '''best''', '''startup'''. The digitization <tt>[digi]</tt> can be '''Mix<tt>[intensity]</tt>''' for mixed samples, '''OnSpill''' for unmixed samples. An <tt>[intensity]</tt> of '''1BB''' corresponds to 1 booster proton batch, '''2BB''' means 2 booster proton batches.  MDC2020 also supports 'Low' intensity, but no production samples of that have been produced yet.  'Sequential' mixing is a special case where a fixed pattern of individual proton bunch intensities from a detailed beam slow extraction simulation is used instead of the lognormal intensity generator.  Reconstructed (mcs) datasets are currently only available for '''Signal''' the stream.
 
NB: due to a configuration bug the CosmicLivetime data product was dropped from the dig and mcs datasets for MDC2020v production and earlier.


{| class="wikitable"
{| class="wikitable"
Line 74: Line 265:
!| Reco
!| Reco
|-
|-
|<tt>dig.mu2e.CeEndpoint'''[digi]'''1BB'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>dig.mu2e.CeEndpoint'''[digi]'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.CeEndpoint'''[digi]'''1BBSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.CeEndpoint'''[digi]'''Signal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|-
|<tt>dig.mu2e.CeEndpointMix2BB'''[stream]'''.MDC2020r_perfect_v1_0.art</tt>
|<tt>dig.mu2e.CePlusEndpoint'''[digi]'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.CeEndpointMix2BBSignal.MDC2020r_perfect_v1_0.art</tt>
|<tt>mcs.mu2e.CePlusEndpoint'''[digi]Signal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|-
|<tt>dig.mu2e.CePlusEndpoint'''[digi]'''1BB'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>dig.mu2e.FlateMinus'''[digi]'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.CePlusEndpoint'''[digi]'''1BBSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.FlateMinus'''[digi]Signal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|-
|<tt>dig.mu2e.FlateMinus'''[digi]'''1BB'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>dig.mu2e.FlatePlus'''[digi]'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.FlateMinus'''[digi]'''1BBSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.FlatePlus'''[digi]Signal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|-
|<tt>dig.mu2e.FlatePlus'''[digi]'''1BB'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>dig.mu2e.NoPrimary'''[digi]'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.FlatePlus'''[digi]'''1BBSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.NoPrimary'''[digi]'''Signal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|<tt>dig.mu2e.NoPrimaryMix1BB'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.NoPrimaryMix1BBSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|-
|<tt>dig.mu2e.PBINormal_33344MixSeq'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt><br/>
|<tt>dig.mu2e.PBINormal_33344MixSeq'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt><br/>
Line 98: Line 286:
|<tt>mcs.mu2e.PBIPathological_33344MixSeqSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.PBIPathological_33344MixSeqSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|-
|<tt>dig.mu2e.IPAMuminusMichel'''[digi]'''1BB'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>dig.mu2e.IPAMuminusMichel'''[digi]'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.IPAMuminusMichelMix1BBSignal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.IPAMuminusMichel'''[digi]'''Signal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|<tt>dig.mu2e.IPAFlateMinus'''[digi]'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.IPAFlateMinus'''[digi]'''Signal.MDC2020r_'''[purpose]'''_v1_0.art</tt>
|-
|<tt>dig.mu2e.NoPrimaryMix2BB'''[digi]'''[stream]'''.MDC2020v.art</tt>
|<tt>...</tt>
|-
|<tt>dig.mu2e.CosmicCORSIKAExtractedNoFieldTrk'''[stream]'''.MDC2020r_'''[purpose]'''_v1_0.art (~1 hour of cosmic livetime)</tt>
|-
|<tt>dig.mu2e.CosmicCRYExtractedCatDigi*.MDC2020y_'''[stream]'''_v1_1.art (~10 hour of cosmic livetime)</tt>
|<tt></tt>
|}
|}


==Job Management==
=== Special datasets ===
==Validation==
===1% test===
We have produced the equivalent of 1% campaign for the Beam and Digitization and mixing campaigns using the MDC2020k SimJob Musing.


                        dataset                                    N ev N files totGB  MB/file  ev/file
In order to assess the impact of a degraded field from coil 11 in the DS a special CeEndpoint campaign was run. In total 100K CeEndpoints were ran with the updated field map which was passed to the Mu2e/Offline code via the Production scripts. This is currently tagged as MDC2020v. Mixed and OnSpill samples were produced assuming 1BB mode of operation.  The datasets with degraded DS field are:
 
{| class="wikitable"
|-
!| Digi
!| Reco
|-
|<tt>dig.mu2e.CeEndpoint'''[digi]'''[stream]'''.MDC2020v_'''[purpose]'''_v1_0.art</tt>
|<tt>mcs.mu2e.CeEndpoint'''[digi]'''Signal.MDC2020v_'''[purpose]'''_v1_0.art</tt>
|-
|<tt></tt>
|}
 
===Argonne CRY datasets===
These are CRY datasets produced by Yuri Oksuzian on the Argonne supercomputer
 
location records files     MB       events    dataset
---------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------
                                  sim.mu2e.Beam.MDC2020k.art     337915    500      1      2      675
  T    2237    2237      559            0  dig.mu2e.CosmicCRYhiOnSpillCalo.MDC2020r_perfect_v1_0.art
                              sim.mu2e.Neutrals.MDC2020k.art   1331172    500      2      5     2662
   T    2237     2237      559            0   dig.mu2e.CosmicCRYhiOnSpillDiag.MDC2020r_perfect_v1_0.art
                          sim.mu2e.NeutralsCat.MDC2020k.art    1331172      1      2   2407  1331172
   T    2237    2237    10494       137638   dig.mu2e.CosmicCRYhiOnSpillSignal.MDC2020r_perfect_v1_0.art
                    dts.mu2e.EarlyEleBeamFlash.MDC2020k.art       1307    495      0      0        2
  T     2237     2237     2275       19387  dig.mu2e.CosmicCRYhiOnSpillTrk.MDC2020r_perfect_v1_0.art
                          dts.mu2e.EleBeamFlash.MDC2020k.art      25596   495      0      0       51
   T     2237     2237     14472      891925  dig.mu2e.CosmicCRYhiOnSpillUntriggered.MDC2020r_perfect_v1_0.art
                            sim.mu2e.EleBeamCat.MDC2020k.art    328981      1      1   1064  328981
  T      200     200     1099          169   dig.mu2e.CosmicCRYhiSigFiltMix2BBCalo.MDC2020s_perfect_v1_0.art
                            sim.mu2e.MuBeamCat.MDC2020k.art       8934      1      0    25    8934
   T     200     200       145            0   dig.mu2e.CosmicCRYhiSigFiltMix2BBDiag.MDC2020s_perfect_v1_0.art
                  dts.mu2e.EarlyEleBeamFlashCat.MDC2020k.art      1307      1      0     12     1307
   T     200     200    370173       87358  dig.mu2e.CosmicCRYhiSigFiltMix2BBSignal.MDC2020s_perfect_v1_0.art
                              sim.mu2e.IPAStops.MDC2020k.art        196    98      0     0       2
  T     200     200     39523         9099  dig.mu2e.CosmicCRYhiSigFiltMix2BBTrk.MDC2020s_perfect_v1_0.art
                          sim.mu2e.TargetStops.MDC2020k.art     14094    98      0      0      143
  T     200     200   137872        30371   dig.mu2e.CosmicCRYhiSigFiltMix2BBUntriggered.MDC2020s_perfect_v1_0.art
                          sim.mu2e.IPAStopsCat.MDC2020k.art        196      1      0      2      196
   T     7897     7896     1964            0   dig.mu2e.CosmicCRYloOnSpillCalo.MDC2020r_perfect_v1_0.art
                        sim.mu2e.TargetStopsCat.MDC2020k.art      14094      1      0    32   14094
  T     7897     7897     1964            0  dig.mu2e.CosmicCRYloOnSpillDiag.MDC2020r_perfect_v1_0.art
                          dts.mu2e.MuBeamFlash.MDC2020k.art     217395     98      0      2     2218
   T     7897     7897     25841       392295  dig.mu2e.CosmicCRYloOnSpillSignal.MDC2020r_perfect_v1_0.art
                        dts.mu2e.MuBeamFlashCat.MDC2020k.art     217395     1     0    165   217395
   T     7897     7896     5609        45496   dig.mu2e.CosmicCRYloOnSpillTrk.MDC2020r_perfect_v1_0.art
                        dts.mu2e.NeutralsFlash.MDC2020k.art     90630   981     0     0       92
   T     7897     7897     51348     4324567  dig.mu2e.CosmicCRYloOnSpillUntriggered.MDC2020r_perfect_v1_0.art
                      dts.mu2e.EarlyMuBeamFlash.MDC2020k.art      11541    98      0     0      117
   T     213     213     14993      126613   mcs.mu2e.CosmicCRYhiOnSpillSignal.MDC2020r_perfect_v1_0.art
                  dts.mu2e.EarlyMuBeamFlashCat.MDC2020k.art     11541      1      0    11    11541
  T     196     196     29577       82601   mcs.mu2e.CosmicCRYhiSigFiltMix2BBSignal.MDC2020s_perfect_v1_0.art
                    dts.mu2e.EarlyNeutralsFlash.MDC2020k.art      5904   981     0     0       6
   T     781     781     43287       379186  mcs.mu2e.CosmicCRYloOnSpillSignal.MDC2020r_perfect_v1_0.art
                      sim.mu2e.MuminusStopsCat.MDC2020k.art      14057      1     0     30    14057
 
                        sim.mu2e.MuplusStopsCat.MDC2020k.art         37      1      0      0      37
===Flat Gamma Samples===
                dts.mu2e.EarlyNeutralsFlashCat.MDC2020k.art       5904      2      0    21    2952
                          dts.mu2e.MuStopPileup.MDC2020k.art    429692    49     0    10    8769
                      dts.mu2e.MuStopPileupCat.MDC2020k.art    429692     1      0   501   429692
                      dts.mu2e.EleBeamFlashCat.MDC2020k.art     255960    10      0    33   25596
                      dts.mu2e.NeutralsFlashCat.MDC2020k.art     906300     10      3    309    90630
                            dts.mu2e.CeEndpoint.MDC2020k.art      21814    10     0     43    2181
            dig.mu2e.CeEndpointDigiUntriggered.MDC2020k.art       818     10      0      3      81
              dig.mu2e.CeEndpointDigiTriggered.MDC2020k.art      13361     10     0     52    1336
                dig.mu2e.CeEndpointMixTriggered.MDC2020k.art      13378    10    20   2020    1337
              dig.mu2e.CeEndpointMixUntriggered.MDC2020k.art       888    10      1    146      88
                dig.mu2e.NoPrimaryMixTriggered.MDC2020k.art        447    10      1   102      44
              dig.mu2e.NoPrimaryMixUntriggered.MDC2020k.art      19553     10     28  2871     1955
       dig.mu2e.NoPrimaryPBISequenceMixTriggered.MDC2020k.art       716    10      2    280      71
    dig.mu2e.NoPrimaryPBISequenceMixUntriggered.MDC2020k.art      18722    10    51  5110    1872
                            dts.mu2e.FlateMinus.MDC2020k.art    141233   100      2     28     1412
                dig.mu2e.FlateMinusMixTriggered.MDC2020k.art     70735    100    105   1054      707
              dig.mu2e.FlateMinusMixUntriggered.MDC2020k.art     17471   100     28    285      174
                  sim.mu2e.CosmicDSStopsCORSIKA.MDC2020k.art      10894     50      0     14     217
              sim.mu2e.CosmicDSStopsCORSIKACat.MDC2020k.art     10894      1      0    715    10894
                        dts.mu2e.CosmicCORSIKA.MDC2020k.art    2151211    293    42   144    7342
            dig.mu2e.CeEndpointMixUntriggered.MDC2020km.art        815    10     1    140      81
              dig.mu2e.CeEndpointMixTriggered.MDC2020km.art     13460     10    20   2094    1346
          dig.mu2e.CePlusEndpointMixTriggered.MDC2020km.art       8572    10    13  1339      857
        dig.mu2e.CePlusEndpointMixUntriggered.MDC2020km.art      1677    10     2    287     167
                dig.mu2e.NoPrimaryMixTriggered.MDC2020km.art        33     10      0      7       3
              dig.mu2e.NoPrimaryMixUntriggered.MDC2020km.art      19967    10    30   3060    1996
              mcs.mu2e.CeEndpointMixTriggered.MDC2020km.art     11997      9      1    137    1333
            dig.mu2e.CosmicCORSIKAMixTriggered.MDC2020km.art      4205   293     1     4      14
          dig.mu2e.CosmicCORSIKAMixUntriggered.MDC2020km.art      5392    293      8     28       18
          dig.mu2e.CosmicCORSIKADigiTriggered.MDC2020km.art       254    293      0      0        0
        dig.mu2e.CosmicCORSIKADigiUntriggered.MDC2020km.art      5511    293      0      1      18
          mcs.mu2e.CosmicCORSIKADigiTriggered.MDC2020km.art        243    293      0      0        0


===10% test===
The following samples were made with these changes to the ``PrimaryFilter":
                        dataset                                    N ev N files totGB  MB/file  ev/file
 
* MinimumPartMom : 20.0 # MeV/c (nominal = 50)
* MinimumTrkSteps : 2 # primary must produce at least this many TrkSteps (nominal = 12)
* MinimumSumCaloStepE : 5.0 # or at least this much calo energy (nominal = 5)
 
A Flat photon 70-102 MeV/c spectrum was generated from initial stopped muons, detector steps and digi files are available:
 
* dts.mu2e.FlatGamma.MDC2020z_sm3.art
* dig.mu2e.FlatGammaOnSpillConv.MDC2020z_sm3_perfect_v1_0.art
 
===DIOtail ===
 
Two DIOtail test samples are available at dts stage. These use a binned spectrum based on Czarnecki et al.
 
 
{| class="wikitable"
|-
!| momentum cut
!| release
!| filename
!| files
!| events
|-
|<tt>p > 95 MeV/c</tt>
|<tt>MDC2020ad</tt>
|<tt>dts.mu2e.DIOtail.MDC2020ad.art</tt>
|<tt>99</tt>
|<tt>1534077</tt>
|-
|<tt>p > 75 MeV/c</tt>
|<tt>MDC2020ad_sm0</tt>
|<tt>dts.mu2e.DIOtail.MDC2020ad_sm0.art</tt>
|<tt>83</tt>
|<tt>30357435</tt>
|-
|<tt></tt>
|}
 
===Beam Pileup datasets===
The final production beam pileup (detector signals from beam particles) datasets for normal mixing are listed below.  Note that normal workflows do not require
you to ever directly access these: mixing jobs to use these should be configured using the Production/Scripts/gen_Mix.sh
script.
 
  files     MB     events    dataset
---------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------
                  sim.mu2e.CosmicDSStopsCRY.MDC2020n_10h.art    126800    500      8    17      253
  9598 2948814  874688822  dts.mu2e.NeutralsFlashCat.MDC2020p.art
              sim.mu2e.CosmicDSStopsCORSIKA.MDC2020n_10h.art    126105    500      8    16      252
   9700  211960  248809400   dts.mu2e.EleBeamFlashCat.MDC2020p.art
                        dts.mu2e.CosmicCRY.MDC2020n_10h.art     444334    489      6    13      908
     50  47481  43638457  dts.mu2e.MuStopPileupCat.MDC2020p.art
                    dts.mu2e.CosmicLooseCRY.MDC2020n_10h.art   14700503    489    277    568    30062
     20  15659   22262973   dts.mu2e.MuBeamFlashCat.MDC2020p.art
                dts.mu2e.CosmicLooseCORSIKA.MDC2020n_10h.art   15641333    500    290    581    31282
 
                    dts.mu2e.CosmicCORSIKA.MDC2020n_10h.art     483468    500      6    13      966
The NeutralsFlashCat and EleBeamFlash datasets are quite large and require a lot of staging time and space
                      dts.mu2e.CosmicCRYCat.MDC2020n_10h.art     444334    10      6    624    44433
 
                  dts.mu2e.CosmicCORSIKACat.MDC2020n_10h.art     483468    10      6    654    48346
In addition, there are production background datasets for early digitization mixing listed below.  Note
        dig.mu2e.CosmicCORSIKADigiTriggered.MDC2020n_10h.art      1781    10      0    12      178
there are no 'Early' MuStopPileup, as the standard dataset version of those works fine for early (>200ns)
      dig.mu2e.CosmicCORSIKADigiUntriggered.MDC2020n_10h.art      45584    10      0    89    4558
digitization mixing.
        mcs.mu2e.CosmicCORSIKADigiTriggered.MDC2020n_10h.art      1726    10      0     20     172
 
        dig.mu2e.CosmicCORSIKAMixTriggered.MDC2020kn_10h.art      2817    497      5    11        5
files     MB     events     dataset
      dig.mu2e.CosmicCORSIKAMixUntriggered.MDC2020kn_10h.art      43890    497    67    136      88
---------------------------------------------------------------------------------------------------------
                        sim.mu2e.Neutrals.MDC2020n_10pc.art   13303464   5000    25      5    2660
   179    2279     521442   dts.mu2e.EarlyNeutralsFlashCat.MDC2020p.art
                            sim.mu2e.Beam.MDC2020n_10pc.art    3374405   5000    13      2      674
     92     425     113819  dts.mu2e.EarlyEleBeamFlashCat.MDC2020p.art
          dig.mu2e.CosmicCRYMixUntriggered.MDC2020kn_10h.art     39695    487    61    125      81
     19     859   1151125   dts.mu2e.EarlyMuBeamFlashCat.MDC2020p.art
            dig.mu2e.CosmicCRYMixTriggered.MDC2020kn_10h.art      2868    487      5    11        5
 
                        sim.mu2e.MuBeamCat.MDC2020n_10pc.art      86814    10      0    25    8681
==Sim Datasets==
                      sim.mu2e.EleBeamCat.MDC2020n_10pc.art    3287591    10    10  1065  328759
Datasets from early stages of production are available for testing, including:
                      sim.mu2e.NeutralsCat.MDC2020n_10pc.art  13303464    10    24  2405 1330346
 
                      dts.mu2e.MuBeamFlash.MDC2020n_10pc.art    2079340    929      2      2    2238
===Beam===
                      sim.mu2e.TargetStops.MDC2020n_10pc.art    132728    929      0      0      142
TODO
                        sim.mu2e.IPAStops.MDC2020n_10pc.art      1752    929      0      0        1
 
                dts.mu2e.EarlyMuBeamFlash.MDC2020n_10pc.art     113298    929      0      0      121
===Stops===
            mcs.mu2e.CosmicCRYMixTriggered.MDC2020kn_10h.art      2184    487      0     1        4
{| class="wikitable"
                    dts.mu2e.EleBeamFlash.MDC2020n_10pc.art     259987  4994      1      0      52
|-
                dts.mu2e.EarlyEleBeamFlash.MDC2020n_10pc.art      12442  4994      0      0        2
! Dataset !! Description
        mcs.mu2e.CosmicCORSIKAMixTriggered.MDC2020kn_10h.art      2147   497      0      1        4
|-
                    dts.mu2e.NeutralsFlash.MDC2020n_10pc.art     911122   9993      6      0      91
| sim.mu2e.MuminusStopsCat.MDC2020p.art || Negative muon stops in the stopping target, used in muon daughter primary and pileup production campaigns
              dts.mu2e.EarlyNeutralsFlash.MDC2020n_10pc.art     58465  9993      1      0        5
|-
                      sim.mu2e.IPAStopsCat.MDC2020n_10pc.art      1752      2      0     10      876
| sim.mu2e.IPAMuminusStopsCat.MDC2020r.art ||Negative muon stops in the IPA, used to produce calibration samples of Michel electrons
              dts.mu2e.EarlyMuBeamFlashCat.MDC2020n_10pc.art     113298      2      0     53    56649
|-
                  dts.mu2e.MuBeamFlashCat.MDC2020n_10pc.art   2079340      2      1    795  1039670
| sim.mu2e.MuplusStopsCat.MDC2020t.art || Positive muon stops in the stopping target. There are only a few thousand of these and they are highly asymmetric
                  sim.mu2e.TargetStopsCat.MDC2020n_10pc.art     132728      2      0    151    66364
|}
                  sim.mu2e.MuminusStopsCat.MDC2020n_10pc.art     132176      1      0   289   132176
 
                  sim.mu2e.MuplusStopsCat.MDC2020n_10pc.art       555      1      0      6      555
==Pions==
                    dts.mu2e.MuStopPileup.MDC2020n_10pc.art    4362689    500      5    10    8725
 
            dig.mu2e.CosmicCRYDigiTriggered.MDC2020n_10h.art      1917    10      0    13      191
The pion beam campaign is a separate one from the main muon campaign. The naming convention for the various stages follows that of the muon beam campaign. Two pion beam campaigns were carried out: MDC2020r and MDC2020t
          dig.mu2e.CosmicCRYDigiUntriggered.MDC2020n_10h.art      41282    10      0    83    4128
 
            mcs.mu2e.CosmicCRYDigiTriggered.MDC2020n_10h.art      1843    10      0    22      184
{| class="wikitable"
                  dts.mu2e.MuStopPileupCat.MDC2020n_10pc.art    4362689      5      4    987  872537
|-
            dts.mu2e.EarlyEleBeamFlashCat.MDC2020n_10pc.art      12442    10      0    12    1244
! Dataset !! Description
            dts.mu2e.EarlyNeutralsFlashCat.MDC2020n_10pc.art      58465    20      0    21    2923
|-
                  dts.mu2e.EleBeamFlashCat.MDC2020n_10pc.art  25998700  1000    33    33    25998
| sim.mu2e.PiminusStopsCat.MDC2020t.art || Negative pion stops in the stopping target, pions have an infinite lifetime
                dts.mu2e.NeutralsFlashCat.MDC2020n_10pc.art  91112200  1000    307    307    91112
|-
                      dts.mu2e.CeEndpoint.MDC2020n_10pc.art      21853    10      0    43    2185
| sim.mu2e.PiplusStopsCat.MDC2020t.art || positive pion stops in the stopping target, pions have an infinite lifetime
        dig.mu2e.CeEndpointDigiUntriggered.MDC2020n_10pc.art       814    10      0      3      81
 
          dig.mu2e.CeEndpointDigiTriggered.MDC2020n_10pc.art      14538    10      0    57    1453
|}
          mcs.mu2e.CeEndpointDigiTriggered.MDC2020n_10pc.art     14430    10      1    109    1443
 
              dts.mu2e.CosmicCORSIKANoField.MDC2020n_10h.art    565849    499      7    14    1133
==Older Datasets==
    sim.mu2e.CosmicCORSIKANoFieldExtracted.MDC2020n_10h.art     20217    496      0      0      40
1% and 10% test datasets were produced when testing MDC2020, these still show up in samweb listings but
                      dts.mu2e.FlateMinus.MDC2020n_10pc.art      4664    10      0    18      466
have been superseded and should not be used anymore. This includes datasets with the following descriptions:
          dig.mu2e.FlateMinusDigiTriggered.MDC2020n_10pc.art      2261    10      0    12      226
MDC2020k
        dig.mu2e.FlateMinusDigiUntriggered.MDC2020n_10pc.art        422    10      0      2      42
MDC2020km
          mcs.mu2e.FlateMinusDigiTriggered.MDC2020n_10pc.art      2225    10      0    20      222
MDC2020n_10h
          dig.mu2e.FlateMinusMixTriggered.MDC2020n_10pc.art      1976      9      3    338      219
MDC2020n_10pc
        dig.mu2e.FlateMinusMixUntriggered.MDC2020n_10pc.art        397      9      0    76      44
          mcs.mu2e.FlateMinusMixTriggered.MDC2020n_10pc.art      1908      9      0    24      212
          mcs.mu2e.CeEndpointMixTriggered.MDC2020n_10pc.art      9904      7      0    141    1414
                        dts.mu2e.FlatePlus.MDC2020n_10pc.art      4600    10      0    18      460
                  dts.mu2e.CePlusEndpoint.MDC2020n_10pc.art      17187    10      0    71    1718
        dig.mu2e.CeEndpointMixUntriggered.MDC2020n_10pc.art        871      9      1    164      96
          dig.mu2e.CeEndpointMixTriggered.MDC2020n_10pc.art     12939      9    19  2200    1437
        dig.mu2e.FlatePlusDigiUntriggered.MDC2020n_10pc.art        367    10      0      2      36
          dig.mu2e.FlatePlusDigiTriggered.MDC2020n_10pc.art       2245    10      0    13      224
      dig.mu2e.CePlusEndpointDigiTriggered.MDC2020n_10pc.art      9609    10      0    56      960
    dig.mu2e.CePlusEndpointDigiUntriggered.MDC2020n_10pc.art      1740    10      0      9      174
            dig.mu2e.FlatePlusMixTriggered.MDC2020n_10pc.art      1976      9      2    330      219
          dig.mu2e.FlatePlusMixUntriggered.MDC2020n_10pc.art        354      9      0    66      39
          mcs.mu2e.FlatePlusDigiTriggered.MDC2020n_10pc.art      2202    10     0    20      220
      mcs.mu2e.CePlusEndpointDigiTriggered.MDC2020n_10pc.art      9414    10      0    85      941
    dig.mu2e.CePlusEndpointMixUntriggered.MDC2020n_10pc.art      1297      7      2    306      185
      dig.mu2e.CePlusEndpointMixTriggered.MDC2020n_10pc.art      6638      7    10  1437      948
            mcs.mu2e.FlatePlusMixTriggered.MDC2020n_10pc.art      1910      9      0    24      212
      mcs.mu2e.CePlusEndpointMixTriggered.MDC2020n_10pc.art      6404      7      0    102      914

Latest revision as of 13:50, 17 October 2024

Introduction

MDC2020 is an end-to-end production using updated geometry, detector simulations, persistent schema, and simulation workflows compared to MDC2018. The goal is to provide a reasonably complete and accurate model of what Mu2e will record during commissioning and first running period ('Run 1', add reference), including OnSpill, OffSpill, and Extracted Position samples. The primary intended use case of these samples are:

  • General Notes and Updates
  • Detector calibration and alignment, including cross-system (ie CRV to Calo) calibrations
  • Detector commissioning
  • Trigger algorithm testing and development
  • TDAQ to Offline data transfer workflows
  • Offline reconstruction algorithm development
  • Science extraction framework and algorithm development

The detailed technical documentation of MDC2020 is in Doc-DB 44084. These pages provide a list of the datasets produced and give time-dependent information.

General Notes and Updates

As reported in this presentation the G4 code used in all the MDC2020 simulations had missing contributions from delta rays in the calorimeter. This appears to mostly affect signals from cosmic muons. For precision studies using cosmic muons please contact the experts.

Simulation Workflow

The samples described on this page were produced using the following workflows. Jobs were submitted using POMS.

The workflow used for MDC2020.

Cosmic Simulation campaigns

The cosmic simulation creates a sample of cosmic rays with three different configurations:

  • Standard position, magnetic field on
  • Standard position, magnetic field off
  • Extracted position, magnetic field off


Standard position, magnetic field on - CORSIKA

Stage S1 Size [T] Event count [1M] Event count/per file Livetime [s] per file nFiles Version Live-time [sec] Resampling factor
S1 sim.mu2e.CosmicDSStopsCORSIKA.MDC2020ab.art 0.122 1.8E+07 215.1 0.0534 82,330 MDC2020ab 4394 NA
S1 sim.mu2e.CosmicDSStopsCORSIKALow.MDC2020ab.art 0.019 2.7E+06 32.6 0.0534 82,332 MDC2020ab 4394 NA
S2 dts.mu2e.CosmicCORSIKALow.MDC2020ae.art 30 0.6E+09 7372 850 78,942 MDC2020ae 6.7E7 15000
S2 dts.mu2e.CosmicCORSIKAAll.MDC2020ae.art 36 4.3E+09 53346 123 81,134 MDC2020ae 1.0E+07 2,278
S2 filt dts.mu2e.CosmicCORSIKASignalAll.MDC2020ae.art 0.33 9.6E+06 11792 12469 812 MDC2020ae 1.0E+07 2,278
S2 filt dts.mu2e.CosmicCORSIKACalibAll.MDC2020ae.art 0.10 1.1E+07 13833 125 812 MDC2020ae 1.0E+05
S2 filt dts.mu2e.CosmicCORSIKASignalAll.MDC2020ag.art 0.33 9.6E+06 11792 12469 81,134 MDC2020ag 1.0E+07 2,278
S2 filt dts.mu2e.CosmicCORSIKACalibAll.MDC2020ag.art 0.10 1.1E+07 13833 125 81,134 MDC2020ag 1.0E+05

Standard position, magnetic field on - CRY

Stage S1 Size [T] Event count Event count/per file Livetime [s] per file nFiles Version Live-time [sec] Resampling factor
S1 sim.mu2e.CosmicDSStopsCRY.010622.art 13.6 2.0E+09 42280.9 11.835 46,981 MDC2020n 556000 NA
S1 sim.mu2e.CosmicDSStopsLowCRY.010622.art 0.71 2.4E+08 5204.2 11.835 46,981 MDC2020n 556000 NA
S2 dts.mu2e.CosmicCRYAll.MDC2020ae.art 39 4.4E+09 54007 130 82,141 MDC2020ae 1.1E+07 19
S2 filt dts.mu2e.CosmicCRYSignalAll.MDC2020ae.art 0.36 1E7 12226 12991 822 MDC2020ae 1.1E+07 19
S2 filt dts.mu2e.CosmicCRYCalibAll.MDC2020ae.art 0.11 1.2E7 14150 130 822 MDC2020ae 1.1E+05

Beam Simulation POMS campaign

The goal of the beam campaign is to generate the particles needed for mixing (muons, electrons, neutrals) starting from the protons on target (POT stage).

Digitization and mixing POMS campaign

POMS campaign for primary particle.

For each primary (e.g. DIO, CeEndpoint, CePlusEndpoint, etc.) we run digitization and reconstruction with ("mix" output) and without beam mixing ("digi" output). The beam mixing stream is divided into three branches one per configuration ("perfect", "best", "reco").

To run mixing on a new primary you should use a clone of the production POMS campaign, substituting your primary for one of the existing (CeEndpont, etc). Note that the new primary must have been entered into the SAM database as part of MDC2020 production, preferably using a clone of the primary POMS campaign.

to TEST mixing, you can manually invoke the scripts, as in the following example: 

> cd mymusedir
> muse setup
> setup dhtools
> setup mu2etools
> kx509
> vomsCert
> git clone git@github.com:Mu2e/Production.git
> source Production/Scripts/gen_Mix.sh CeEndpoint MDC2020 p r v perfect v2_0 1BB
> mu2e -c CeEndpointMix1BB_000/cnf.mu2e.CeEndpointMix1BB.MDC2020v_perfect_v2_0.001210_00000000.fcl --nevts 10

Recent Campaigns

The most recent MDC2020 campaigns are detailed below along with their Offline and Production versions as well as any useful information:

Campaign Offline ver Production ver mu2e_trig_config ver Comments
MDC2020ae v10_29_00 v00_21_00 v01_02_00 Re-digitization and re-reconstruction of all datasets, new CORSIKA datasets
MDC2020z v10_23_01 v00_16_00 - Re-reconstruction of some datasets
MDC2020v v10_20_00 v00_12_00 - Special run (see below), not for standard physics studies!
MDC2020t v10_17_00 v00_09_11 - several updates to many directories
MDC2020r v00_09_02 v10_15_01 - bug fix for digi stage

Current Datasets

These are the datasets currently available which correspond to the full 100% campaign. The three digi and reco configurations ("perfect", "best", "reco") correspond to three different detector conditions as described in DocDB 42036.

To obtain details (number of events, number of files, GB, etc.) about a dataset you can use the datasetSummary.sh script, available in the Production repository.

Note that, to obtain consistent results, you should use the same database version to process a dataset as it was produced with. Thus to read dig.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art, you should configure your job to use database purpose 'best', version v1_3. For more details see the description of the conditions database.

Note that datasets can require specific versions of our codes to process, as documented in the following table. Use of an inconsistent code version may result in job failure (exception) or incorrect results.

Database version of dataset Offline tag for processing dig (digis) TrkAna tag for processing mcs (reco)
v1_3.art >= v10_29_00 or HEAD >= v05_02_00 or HEAD
v1_1.art <= v10_28_00 * <= v05_01_00 
* Note that v1_1 and older digi datasets may still be processed by modern versions of Offline using additional fcl overrides described here. mcs files produced this way can be used with any version of TrkAna.

Reprocessed digitization and reconstruction datasets [2024]

In May 2024 several samples were remade from the dts->digi and digi-->reco stages to incorporate updates in digitization algorithms, triggering, trigger streams, reconstruction, and db changes.

The digitization stream is divided into 'Triggered', ie events which passed at least one reco-object based trigger selections, and 'Triggerable', ie events which pass a MC-truth based filter similar to the trigger selection. Note that these sets are not miscible (cannot be read in the same job) and the events selected do not have any pre-determined relation, ie one is not a subset of the other.

Mixed:

Digi Reco NTuple Comments
dig.mu2e.CeEndpointMix1BBTriggered.MDC2020ae_best_v1_3.art None
dig.mu2e.CeEndpointMix1BBTriggered.MDC2020ae_perfect_v1_3.art None
dig.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_best_v1_3.art
dig.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.CeEndpointMix2BBTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.CePlusEndpointMix1BBTriggered.MDC2020ae_best_v1_3.art None
dig.mu2e.CePlusEndpointMix1BBTriggered.MDC2020ae_perfect_v1_3.art None
dig.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_best_v1_3.art
dig.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.NoPrimaryMix1BBTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_best_v1_3.art
dig.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.NoPrimaryMix2BBTriggered.MDC2020ae_perfect_v1_3.art


Primaries:

Digi Reco NTuple Comments
dig.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art
dig.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.CeEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_best_v1_3.art
dig.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.CePlusEndpointOnSpillTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_best_v1_3.art
dig.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.CosmicCORSIKACalibAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_best_v1_3.art
dig.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.CosmicCORSIKACalibAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.CosmicCORSIKASignalAllOffSpillTriggered.MDC2020ae_best_v1_3.art None
dig.mu2e.CosmicCORSIKASignalAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.CosmicCORSIKASignalAllOffSpillTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.CosmicCORSIKASignalAllOnSpillTriggered.MDC2020ae_best_v1_3.art None
dig.mu2e.CosmicCORSIKASignalAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art mcs.mu2e.CosmicCORSIKASignalAllOnSpillTriggered.MDC2020ae_perfect_v1_3.art
dig.mu2e.CosmicCRYExtractedCatTriggered.MDC2020ae_best_v1_3.art mcs.mu2e.CosmicCRYExtractedCatTriggered.MDC2020ae_best_v1_3.art

Reprocessed reconstruction datasets [2023]

In Sept 2023 several samples were remade from the digi-->reco stage to incorporate updates in reconstruction and db changes.

Digi Reco NTuple Comments
dig.mu2e.CeEndpointMix1BBSignal.MDC2020r_best_v1_0.art mcs.mu2e.CeEndpointMix1BBSignal.MDC2020z_best_v1_1.art nts.mu2e.CeEndpointMix1BBSignalMix1BB.MDC2020z1_best_v1_1_std_v04_01_00.tka
dig.mu2e.FlateminusMix1BBSignal.MDC2020r_best_v1_0.art mcs.mu2e.FlateminusMix1BBSignal.MDC2020z_best_v1_1.art
dig.mu2e.CosmicCRYExtractedCatDigiTrk.MDC2020r.art mcs.mu2e.CosmicCRYExtractedCatDigiTrk.MDC2020z.art nts.mu2e.CosmicCRYExtractedTrk.MDC2020z1_best_v1_1_std_v04_01_00.tka naming issue: best, v1_1

Original datasets; most of these have been supersceded. You must use an appropriate tag of Mu2e code to process these datasets, see the table above

The digitization stream is divided into five parts: Signal, Diag, Trk, Calo, Untriggered, which are described in DocDB 41757. To obtain details (number of events, number of files, GB, etc.) about a dataset you can use the datasetSummary.sh script, available in the Production repository.

In the following summary, [stream] can be Untriggered, Calo, Signal, Diag, Trk and [purpose] can be perfect, best, startup. The digitization [digi] can be Mix[intensity] for mixed samples, OnSpill for unmixed samples. An [intensity] of 1BB corresponds to 1 booster proton batch, 2BB means 2 booster proton batches. MDC2020 also supports 'Low' intensity, but no production samples of that have been produced yet. 'Sequential' mixing is a special case where a fixed pattern of individual proton bunch intensities from a detailed beam slow extraction simulation is used instead of the lognormal intensity generator. Reconstructed (mcs) datasets are currently only available for Signal the stream.

NB: due to a configuration bug the CosmicLivetime data product was dropped from the dig and mcs datasets for MDC2020v production and earlier.

Digi Reco
dig.mu2e.CeEndpoint[digi][stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.CeEndpoint[digi]Signal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.CePlusEndpoint[digi][stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.CePlusEndpoint[digi]Signal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.FlateMinus[digi][stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.FlateMinus[digi]Signal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.FlatePlus[digi][stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.FlatePlus[digi]Signal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.NoPrimary[digi][stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.NoPrimary[digi]Signal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.PBINormal_33344MixSeq[stream].MDC2020r_[purpose]_v1_0.art
 mcs.mu2e.PBINormal_33344MixSeqSignal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.PBIPathological_33344MixSeq[stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.PBIPathological_33344MixSeqSignal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.IPAMuminusMichel[digi][stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.IPAMuminusMichel[digi]Signal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.IPAFlateMinus[digi][stream].MDC2020r_[purpose]_v1_0.art mcs.mu2e.IPAFlateMinus[digi]Signal.MDC2020r_[purpose]_v1_0.art
dig.mu2e.NoPrimaryMix2BB[digi][stream].MDC2020v.art ...
dig.mu2e.CosmicCORSIKAExtractedNoFieldTrk[stream].MDC2020r_[purpose]_v1_0.art (~1 hour of cosmic livetime)
dig.mu2e.CosmicCRYExtractedCatDigi*.MDC2020y_[stream]_v1_1.art (~10 hour of cosmic livetime)

Special datasets

In order to assess the impact of a degraded field from coil 11 in the DS a special CeEndpoint campaign was run. In total 100K CeEndpoints were ran with the updated field map which was passed to the Mu2e/Offline code via the Production scripts. This is currently tagged as MDC2020v. Mixed and OnSpill samples were produced assuming 1BB mode of operation. The datasets with degraded DS field are:

Digi Reco
dig.mu2e.CeEndpoint[digi][stream].MDC2020v_[purpose]_v1_0.art mcs.mu2e.CeEndpoint[digi]Signal.MDC2020v_[purpose]_v1_0.art

Argonne CRY datasets

These are CRY datasets produced by Yuri Oksuzian on the Argonne supercomputer

location records files MB events dataset 

  T     2237     2237       559            0   dig.mu2e.CosmicCRYhiOnSpillCalo.MDC2020r_perfect_v1_0.art
  T     2237     2237       559            0   dig.mu2e.CosmicCRYhiOnSpillDiag.MDC2020r_perfect_v1_0.art
  T     2237     2237     10494       137638   dig.mu2e.CosmicCRYhiOnSpillSignal.MDC2020r_perfect_v1_0.art
  T     2237     2237      2275        19387   dig.mu2e.CosmicCRYhiOnSpillTrk.MDC2020r_perfect_v1_0.art
  T     2237     2237     14472       891925   dig.mu2e.CosmicCRYhiOnSpillUntriggered.MDC2020r_perfect_v1_0.art
  T      200      200      1099          169   dig.mu2e.CosmicCRYhiSigFiltMix2BBCalo.MDC2020s_perfect_v1_0.art
  T      200      200       145            0   dig.mu2e.CosmicCRYhiSigFiltMix2BBDiag.MDC2020s_perfect_v1_0.art
  T      200      200    370173        87358   dig.mu2e.CosmicCRYhiSigFiltMix2BBSignal.MDC2020s_perfect_v1_0.art
  T      200      200     39523         9099   dig.mu2e.CosmicCRYhiSigFiltMix2BBTrk.MDC2020s_perfect_v1_0.art
  T      200      200    137872        30371   dig.mu2e.CosmicCRYhiSigFiltMix2BBUntriggered.MDC2020s_perfect_v1_0.art
  T     7897     7896      1964            0   dig.mu2e.CosmicCRYloOnSpillCalo.MDC2020r_perfect_v1_0.art
  T     7897     7897      1964            0   dig.mu2e.CosmicCRYloOnSpillDiag.MDC2020r_perfect_v1_0.art
  T     7897     7897     25841       392295   dig.mu2e.CosmicCRYloOnSpillSignal.MDC2020r_perfect_v1_0.art
  T     7897     7896      5609        45496   dig.mu2e.CosmicCRYloOnSpillTrk.MDC2020r_perfect_v1_0.art
  T     7897     7897     51348      4324567   dig.mu2e.CosmicCRYloOnSpillUntriggered.MDC2020r_perfect_v1_0.art
  T      213      213     14993       126613   mcs.mu2e.CosmicCRYhiOnSpillSignal.MDC2020r_perfect_v1_0.art
  T      196      196     29577        82601   mcs.mu2e.CosmicCRYhiSigFiltMix2BBSignal.MDC2020s_perfect_v1_0.art
  T      781      781     43287       379186   mcs.mu2e.CosmicCRYloOnSpillSignal.MDC2020r_perfect_v1_0.art

Flat Gamma Samples

The following samples were made with these changes to the ``PrimaryFilter":

  • MinimumPartMom : 20.0 # MeV/c (nominal = 50)
  • MinimumTrkSteps : 2 # primary must produce at least this many TrkSteps (nominal = 12)
  • MinimumSumCaloStepE : 5.0 # or at least this much calo energy (nominal = 5)

A Flat photon 70-102 MeV/c spectrum was generated from initial stopped muons, detector steps and digi files are available:

  • dts.mu2e.FlatGamma.MDC2020z_sm3.art
  • dig.mu2e.FlatGammaOnSpillConv.MDC2020z_sm3_perfect_v1_0.art

DIOtail

Two DIOtail test samples are available at dts stage. These use a binned spectrum based on Czarnecki et al.


momentum cut release filename files events
p > 95 MeV/c MDC2020ad dts.mu2e.DIOtail.MDC2020ad.art 99 1534077
p > 75 MeV/c MDC2020ad_sm0 dts.mu2e.DIOtail.MDC2020ad_sm0.art 83 30357435

Beam Pileup datasets

The final production beam pileup (detector signals from beam particles) datasets for normal mixing are listed below. Note that normal workflows do not require you to ever directly access these: mixing jobs to use these should be configured using the Production/Scripts/gen_Mix.sh script. 

files     MB      events     dataset

 9598 2948814  874688822   dts.mu2e.NeutralsFlashCat.MDC2020p.art
 9700  211960  248809400   dts.mu2e.EleBeamFlashCat.MDC2020p.art
   50   47481   43638457   dts.mu2e.MuStopPileupCat.MDC2020p.art
   20   15659   22262973   dts.mu2e.MuBeamFlashCat.MDC2020p.art

The NeutralsFlashCat and EleBeamFlash datasets are quite large and require a lot of staging time and space

In addition, there are production background datasets for early digitization mixing listed below. Note there are no 'Early' MuStopPileup, as the standard dataset version of those works fine for early (>200ns) digitization mixing. 

files     MB      events     dataset

  179    2279     521442   dts.mu2e.EarlyNeutralsFlashCat.MDC2020p.art
   92     425     113819   dts.mu2e.EarlyEleBeamFlashCat.MDC2020p.art
   19     859    1151125   dts.mu2e.EarlyMuBeamFlashCat.MDC2020p.art

Sim Datasets

Datasets from early stages of production are available for testing, including:

Beam

TODO

Stops

Dataset Description
sim.mu2e.MuminusStopsCat.MDC2020p.art Negative muon stops in the stopping target, used in muon daughter primary and pileup production campaigns
sim.mu2e.IPAMuminusStopsCat.MDC2020r.art Negative muon stops in the IPA, used to produce calibration samples of Michel electrons
sim.mu2e.MuplusStopsCat.MDC2020t.art Positive muon stops in the stopping target. There are only a few thousand of these and they are highly asymmetric

Pions

The pion beam campaign is a separate one from the main muon campaign. The naming convention for the various stages follows that of the muon beam campaign. Two pion beam campaigns were carried out: MDC2020r and MDC2020t

Dataset Description
sim.mu2e.PiminusStopsCat.MDC2020t.art Negative pion stops in the stopping target, pions have an infinite lifetime
sim.mu2e.PiplusStopsCat.MDC2020t.art positive pion stops in the stopping target, pions have an infinite lifetime

Older Datasets

1% and 10% test datasets were produced when testing MDC2020, these still show up in samweb listings but have been superseded and should not be used anymore. This includes datasets with the following descriptions: MDC2020k MDC2020km MDC2020n_10h MDC2020n_10pc

Retrieved from "http://mu2ewiki.fnal.gov/w/index.php?title=MDC2020&oldid=26358"