Datasets: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
 
(250 intermediate revisions by 4 users not shown)
Line 1: Line 1:
==Introduction==
This page is an attempt to record the datasets created and uploaded by "production".  These are semi-permanent datasets that were created for the collaboration as a whole.  It is nearly impossible to maintain dataset information perfectly when any datasets can become invalidated in various ways, or completely obsolete, at any time, for many reasons.  Please do not use any datasets without consulting experts in these datasets - that's still the best way to be sure you are using the right dataset.
To print lists of datasets that are known to SAM - all or optionally with restrictions (see -h).
setup mu2efiletools
mu2eDatasetList
To see the files in a dataset with full file paths:
mu2eDatasetFileList dataset_name_here >& fcllist.txt
See also [[Workflows]], [[FileTools]] and [[SAM]].
=== Dataset clean-up ===
In 10/2020, as part of migration from T10Kc to LTO8 tape formats, Rob deleted about 700TB of datasets, including most of the largest from CD3.
[https://docs.google.com/spreadsheets/d/1oih26rLtdJUBVhiBPWEUjpymrriXzbH0bgpfNCLlu6k/edit?ts=5f82a612#gid=1393936171 google spreadsheet list]
==Beam==
==Beam==
===TDR===
See [[TDRDatasets]]
===cd3===
See [http://mu2e.fnal.gov/atwork/workgroups/BackgroundWG/cd3-samples/ background group].
===051017===
This sample of stage 1 beam simulation was generated in May 2017 to answer questions about CRV shielding. Default geometry. This sample is standard enough that it could be of use to other groups.  Goals of this effort:
* Rates and dead-time with improved precision
* Sources of coincidences from neutrons and gammas
* Improved shielding and CRV geometry to mitigate rates and to increase CRV coverage (geometry changed in later stages)
The standard cd3 beam stage 1 fcl was modified to only write out the dsregion and mubeam datasets. Run in v6_2_1. See [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=8627 8627] and [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=7040 7040]. Expert: Yuri Oksuzian.
* 500K jobs of 10K POT, total 5e9 POT
* cnf.mu2e.cd3-beam-g4s1.051017.fcl
* sim.mu2e.cd3-beam-g4s1cat-mubeam.051017.art (concatenated 20-to-1, uploaded)
* sim.mu2e.cd3-beam-g4s1cat-dsregion.051017.art (concatenated 20-to-1, uploaded)
===geant4 v10 test samples===
Run 11/2016 to 2/2017 to test geant4 v10.  See  [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=9336 doc-9336]
[https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=9624 doc-9624]
[https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=9402 doc-9402]
[https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=9139 doc-9139]
[https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=8357 doc-8357]. 
For dataset details, see [[GeantV10Test]]. Expert: Ray Culbertson and Yuri Oksuzian.
===MDC2018===
A dataset to replace cd3 background frames and signal samples, largely driven by changes in tracker and target geometry.
[[MDC2018| Details]]
===geant4-10-04-patch-02===
The samples were produced on Bebop using 750k CPU hours
* sim.mu2e.beam-g4s1-dsregion.0619.art
* sim.mu2e.beam-g4s1-mubeam.0619.art
* sim.mu2e.beam-g4s1-truncated.0619.art
* bck.mu2e.beams1phase1.0619.tbz
Each file corresponds to 1E5 POT, and the total samples POT is equal to 3.298E8.
The stopping planes were arranged in the configuration described in docdb-26541.
This version of geant4 includes a bug in Kaon cross-sections.
* G4 version: v4_10_4_p02a
* CLHEP version: v2_3_4_6
* ART version: v2_12_01
* Offline version: v7_4_1
Expert: Yuri Oksuzian.
===geant4-10-05-patch-01a===
The samples were produced on Bebop using ~250k CPU hours
* cnf.mu2e.beams1-g4-10-5.0919.fcl
* sim.mu2e.beam-g4s1-dsregion.g4-10-5.art
**File count:    2160
**Total size:    114,348,861,373
**Event count:    55,462,720
**Trigger rate:  64%
* sim.mu2e.beam-g4s1-mubeam.g4-10-5.art
**File count:    2160
**Total size:    56,514,622,485
**Event count:    18,340,970
**Trigger rate:  21.2%
* bck.mu2e.beams1-g4-10-5.g4-10-5.tbz
Each file corresponds to 4E4 POT, and the total samples POT is equal to 0.864E8.
The stopping planes were arranged in the configuration described in docdb-26541.
Truncated files are empty and can recovered from the archive.
* G4 version: v4_10_5_p01a
* CLHEP version: v2_4_1_2
* ART version: v3_03_01
* Offline version: v7_5_4
Expert: Yuri Oksuzian.
===geant4-10-04-patch-03b===
The samples were produced on Bebop using ~250k CPU hours
* cnf.mu2e.beams1phase1.v0619.fcl
* sim.mu2e.beam-g4s1-dsregion.g4-10-4.art
**File count:    960
**Total size:    124,602,399,046
**Event count:    61701227
**Trigger rate: 64.3%
* sim.mu2e.beam-g4s1-mubeam.g4-10-4.art
**File count:    960
**Total size:    56,681,687,449
**Event count:    19030020
**Trigger rate: 19.8%
* bck.mu2e.beams1phase1.g4-10-4.tbz
* sim.mu2e.beam-g4s1-truncated.g4-10-4-cat.art
Each file corresponds to 1E5 POT, and the total samples POT is equal to 0.96E8.
The stopping planes were arranged in the configuration described in docdb-26541.
* G4 version: v4_10_4_p03b
* CLHEP version: v2_4_1_2
* ART version: v3_03_01
* Offline version: v7_5_4
===beams1-g4-10-5-alcc===
The samples were produced on Bebop and Theta using LCRC,ALCC resources
* cnf.mu2e.beams1-g4-10-5.0919.fcl
* sim.mu2e.beam-g4s1-dsregion.beams1-g4-10-5-alcc.art
**File count:    14466
**Total size:    758,659,292,452
**Event count:    371,088,115
**Trigger rate:  64.1%
* sim.mu2e.beam-g4s1-mubeam.beams1-g4-10-5-alcc.art
**File count:    14466
**Total size:    300,280,017,684
**Event count:    102,389,354
**Trigger rate:  17.7%
* bck.mu2e.beams1-g4-10-5.g4-10-5.tbz
Each file corresponds to 4E4 POT, and the total samples POT is equal to 5.8E8.
The stopping planes were arranged in the configuration described in docdb-26541.
Truncated files are empty and can be recovered from the archive.
* G4 version: v4_10_5_p01a
* CLHEP version: v2_4_1_2
* ART version: v3_03_01
* Offline version: alcc2019_v757
Expert: Yuri Oksuzian.
===MDC2020Dev===
[[MDC2020Dev]] a development sample is available to test certain updates, and as input to nightly reco validation.
=== MDC2020 ===
MDC2020, run in mid-2021, is a update of MC procedures, and a focus on calibration and early data samples.  [[MDC2020 | MDC2020 dataset page]]
== other projects==
=== SU2020 : Datasets for '2020 sensitivity updates===
[[Datasets-SU2020 | SU2020 dataset page]]
=== PBAR2M : Datasets for in-situ estimates of the antiproton background===
[[Datasets-PBAR2M | PBAR2M dataset page]]
=== Tracker VST Datasets ===
[[https://mu2einternalwiki.fnal.gov/wiki/TrackerVST  | Tracker VST dataset page]]
==Cosmics==
==Cosmics==
===Calibration Cosmic Test Sample===
* 2022-11-28 P.M. : calibration datasets below are obsolete, see [[MDC2020#Current_Datasets]] for the description of  current ones 
Calibration cosmics are events taken with a simulated trigger intended to collect all cosmics that hit a detector, for use in calibration studies.  The digis for trk and cal are written out, as well as the StepPointMC's for CRV (the CRV product is being updated, so we did not write here).  The code used was built locally and not tagged, thought it was eventually committed.  v6_5_2 should read it OK.  Expert: Ray Culbertson
3/2018, three samples were generated, 1M events generated for each then some filtering.
* '''ext''' - detector extracted to +14m in z
** Bfield is on but the default maps do not reach that far, so Bfield appears off
** trigger on trk OR cal
** Dataset: sim.mu2e.cosmic_calib_ext.180302.art
** geometry: Mu2eG4/geom/geom_common_garage.txt (mods to Mu2eG4/geom/geom_common_current.txt)
** Total cosmic rate = 1989.85 Hz for 1M events = 502s livetime
* '''ins''' - detect in normal inserted position
** Bfield on
** trigger on trk OR cal
** Dataset: sim.mu2e.cosmic_calib_ins.180302.art
** geometry: Mu2eG4/geom/geom_common.txt (->Mu2eG4/geom/geom_common_cd3_s4p2.txt)
** Total cosmic rate = 1989.85 Hz for 1M events = 502s livetime
* '''crv''' - detect in normal inserted position
** Bfield on
** trigger on CRV hits
** Dataset: sim.mu2e.cosmic_calib_crv.180302.art
** geometry: Mu2eG4/geom/geom_common.txt (->Mu2eG4/geom/geom_common_cd3_s4p2.txt)
** Total cosmic rate = 23010.7 Hz for 1M events = 43s livetime
===target6/7 Study===
===target6/7 Study===
Generated to study how cosmics enter the gap between the CRV top and sides, to help determine the CRV final design. Daya Bay generator. Summary talk [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=11147 11147].  Expert: Ralf Ehrlich.
Generated to study how cosmics enter the gap between the CRV top and sides, to help determine the CRV final design. Daya Bay generator. Summary talk [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=11147 11147].  Expert: Ralf Ehrlich.
* target6 - left top gap
* target6 - left (+x) top gap
* target7 - right top gap
* target7 - right (-x) top gap
Stages: same as cd3 processing.
Stages: same as cd3 processing.


6/2017
6/2017 [[FullListTarget67|full listing]]


===target5 Study===
===target5 Study===
Line 13: Line 198:
Generated to study cosmic rays that enter the TS hole and produce tracks, and how they can be degraded with new shielding blocks. This follows up on this category of events discovered in CD3 target1. Daya Bay generator.  Talk summary [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=8322 8322]. Expert: Ray Culbertson.
Generated to study cosmic rays that enter the TS hole and produce tracks, and how they can be degraded with new shielding blocks. This follows up on this category of events discovered in CD3 target1. Daya Bay generator.  Talk summary [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=8322 8322]. Expert: Ray Culbertson.


The talk shows the various shielding configurations. Stages:
The talk shows the various shielding configurations and concludes new shielding would help. Stages:
* s1 - v579, generate on a plane that is the TS opening, sim to a surface between TS3 and TS5
* s1 - v579, generate on a plane that is the TS opening, sim to a surface between TS3 and TS5
* s2 - various branches off of v579, complete sim, reco, require a track 50-200 MeV.
* s2 - various branches off of v579, complete sim, reco, require a track 50-200 MeV.
The job were run around 11/2016.


{|style="width: 85%"
{|style="width: 80%"
|-
|-
|style="width:10%"|'''date'''
|style="width:30%"|'''git tag'''
|style="width:25%"|'''tag'''
|style="width:70%"|'''dataset name'''
|style="width:65%"|'''name'''
|-
|-
| 11/2016  || v5-7_9 || sim.mu2e.cd3-cosmic-g4s1-target5.0901a.art
| v5-7_9 || sim.mu2e.cd3-cosmic-g4s1-target5.0901a.art  
|-
|-
| 11/2016  || v5-7_9-cosmic-target5-v2 || sim.mu2e.cd3-cosmic-g4s2-target5.1026a_geom1.art
| v5-7_9-cosmic-target5-v2 || sim.mu2e.cd3-cosmic-g4s2-target5.1026a_geom1.art  
|-
|-
| 11/2016  || v5-7_9-cosmic-target5-v3 || sim.mu2e.cd3-cosmic-g4s2-target5.1104a_geom2.art
| v5-7_9-cosmic-target5-v3 || sim.mu2e.cd3-cosmic-g4s2-target5.1104a_geom2.art  
|-
|-
| 11/2016  || v5-7_9-cosmic-target5-v4 ||  sim.mu2e.cd3-cosmic-g4s2-target5.1206a_geom3.art
| v5-7_9-cosmic-target5-v4 ||  sim.mu2e.cd3-cosmic-g4s2-target5.1206a_geom3.art  
|-
|-
| 11/2016  || v5-7_9-cosmic-target5-v5 ||  sim.mu2e.cd3-cosmic-g4s2-target5.1216a_geom4.art
| v5-7_9-cosmic-target5-v5 ||  sim.mu2e.cd3-cosmic-g4s2-target5.1216a_geom4.art  
|-
|-
| 11/2016  || v5-7_9-cosmic-target5-v6 ||  sim.mu2e.cd3-cosmic-g4s2-target5.1208a_geom5.art
| v5-7_9-cosmic-target5-v6 ||  sim.mu2e.cd3-cosmic-g4s2-target5.1208a_geom5.art  
|}
|}


===cd3===
Stage1 fcl and archive:
bck.mu2e.cd3-cosmic-g4s1-target5.0901a.tbz
cnf.mu2e.cd3-cosmic-g4s1-target5.0901a.fcl
Stage 2 fcl and archive.  The geometry was changed by running the same fcl but a different release, defined by the tag and loaded on cvmfs in OfflineSpecial
cnf.mu2e.cd3-cosmic-g4s2-target5.0901a_geom1.fcl
bck.mu2e.cd3-cosmic-g4s2-target5.1026a_geom1.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1104a_geom2.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1206a_geom3.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1216a_geom4.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1208a_geom5.tbz
 
===cd3 background===


Produced to determine the cosmic background for CD3 review.  Daya Bay generator.  Talk summary [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=7131 7131], memo [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=3059 3059]. Expert: Ralf Ehrlich.
Produced to determine the cosmic background for CD3 review.  Daya Bay generator.  Talk summary [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=7131 7131], memo [https://mu2e-docdb.fnal.gov:440/cgi-bin/ShowDocument?docid=3059 3059]. Expert: Ralf Ehrlich.
Line 52: Line 248:
* s5 - v576, reconstruct CRV and make analysis ntuples (not uploaded)
* s5 - v576, reconstruct CRV and make analysis ntuples (not uploaded)


At s1-s4, there is also a truncated data stream, which is events that overflow the SimParticle list.
For s1 and s2, there is also a truncated data stream, which is events that overflow the SimParticle list.


{|style="width: 85%"
{|style="width: 85%"
Line 70: Line 266:
| 5/2016  || v576|| sim.mu2e.cd3-cosmic-g4s4-target4.v542_v566_v574_v576.art
| 5/2016  || v576|| sim.mu2e.cd3-cosmic-g4s4-target4.v542_v566_v574_v576.art
|}
|}
There is another page with a [[FullListCD3Cosmics|full list]] of these datasets.
===CRY 1===
A sample of 4.9% of a mu2e live-time with CRY cosmic generator produced around Dec 20, 2018. We assume 1.06E7 sec of Mu2e live-time (needs to be updated). This was produced at the Argonne [[HPC]] center, "Bebop" farm.  The computing year deadline was approaching so some shortcuts had to be made, and the procedure was not fully in the production scripting. branch =v7_2_0_CRYMT based of Offline tag=v7_2_0 fcl =JobConfig/cosmic/cosmic_defs_s1s2.fclinc. The generator time was set to 0, so the time of the hits needs to be offset to get into the reco window, see GenerateCosmicTimes_module.cc 
Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran
The following configuration (EventGenerator/defaultConfigs/othersCRYconfig.txt) was used:
CRY::CRYSetup: Setting returnMuons to 1
CRY::CRYSetup: Setting returnNeutrons to 1
CRY::CRYSetup: Setting returnProtons to 1
CRY::CRYSetup: Setting returnGammas to 1
CRY::CRYSetup: Setting returnElectrons to 1
CRY::CRYSetup: Setting returnPions to 1
CRY::CRYSetup: Setting returnKaons to 1
CRY::CRYSetup: Setting date to 6-21-2021 (month-day-year)
CRY::CRYSetup: Setting latitude to 41.8
CRY::CRYSetup: Setting altitude to 0
CRY::CRYSetup: Setting subboxLength to 30
The production plane of 30x30 meters was centered at the tracker. Generated primaries were projected back to the world volume. The simulation then was initiated from the world volume.
The sample was produced using 0.75M (divided by 0.58) CPU hours on Bebop, processing on 32 cores with 8 threads.
The total number of files: 6545*10
There are 2E6 events per file.
The total number of events: 6545*10*2E6=1.309E+11
The rate in the generation plane, including non-muons: 281.6 Hz/m2 x 900 m2 = 253440 Hz
The total simulated live-time: 1.309E+11/253440 = 516493 sec.
Output datasets:
* sim.mu2e.cosmic-g4s1s2-crygeneral-cat.181220.art (6545 files, 141,614,791 events, 1.9TB)
* sim.mu2e.cosmic-g4s1s2-truncated-crygeneral-cat.181220.art (1309 files, 61042 events)
With log file tarballs:
* bck.mu2e.cosmic-g4s1s2-crygeneral-cat.181220.tbz
* bck.mu2e.cosmic-g4s1s2-truncated-crygeneral-cat.181220.tbz
Adding digis with mixing:
* cnf.mu2e.CRY-cosmic-general-mix.MDC2018g.fcl
* dig.mu2e.CRY-cosmic-general-mix.MDC2018g.art
* bck.mu2e.CRY-cosmic-general-mix.MDC2018g.tbz
===CRY 2===
In March 2019, the sample was generated using 1.5M CPU hours on Theta and 1.0M (divided by 0.58) hours on Bebop.
Each file from stage 1 output corresponds to 2.8 sec of live-time.
We've generated 468747 files with a total live-time of 1315310 sec.
As with CRY 1 sample, all particle species were simulated.
Configuration:
* cnf.mu2e.cry.v734.fcl
* CRY configuration: EventGenerator/defaultConfigs/defaultCRYconfig.txt
* Tag: v7_3_5
* fcl: Offline/JobConfig/cosmic/cosmic_s1_general_cryMT_G4internalFilters.fcl
The concatenated datasets:
*sim.mu2e.cosmic-g4s1s2-truncated-cry2general-cat.190320.art sample was concatenated with a factor 1,000
*sim.mu2e.cosmic-g4s1s2-cry2general-cat.190320.art sample was concatenated with a factor 5
The production plane of 300x300 meters was centered at the tracker and positioned at top of the dirt volume. Generated primaries were projected from the dirt toward the CRV box. Tracks that intersect CRV box were simulated.
The sample description and preliminary analysis are documented in docdb-26890.
Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran
===CRY3: stage 1===
The datasets:
* Parent: cnf.mu2e.cry_rs1.100619.fcl, based of cosmic_s1_dsstops.fcl
* sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019.art
* sim.mu2e.cosmic-g4s1-cryresample-truncated.g4-10-5-cat.art
* bck.mu2e.cry_rs1.cry-rs1-1019-g4-10-4.tbz
Each file corresponds to 3E6 simulated events and the live-time of 16.84 sec. The stopping planes were arranged in the configuration described in docdb-29112.
* Offline version: v7_5_4
* G4 version: v4_10_5_p01a
* ART version: v3_03_01
* Number of files: 20034
* Number of simulated cosmics: 6.01E+10
* Events triggered: 1067201262
* Simulated live-time: 3.37E+05 sec
* CPU hours: 3.28E+05
Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran
===CRY3: stage 2===
Created from dataset sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019.art by resampling procedure docdb-29112.
* Offline version: v7_5_7
* G4 version: v4_10_4_p03b
* 500,000 resampled events per output file
* lo sample: events with <14 MeV deposition in CRV
** 1 resampled event corresponds to 0.01920 sec
* hi sample: events with >14 MeV deposition in CRV
** 1 resampled event corresponds to 0.00032 sec
{|style="width: 90%;text-align:right;"
|-
!style="width:10%"|'''Location'''
!style="width:10%;text-align:right;"|'''SAM files'''
!style="width:10%;text-align:right;"|'''Files'''
!style="width:10%;text-align:right;"|'''MB'''
!style="width:10%;text-align:right;"|'''Events'''
!style="width:10%;text-align:right;"|'''Live-time'''
!style="width:10%;text-align:right;"|'''CPU Mhours'''
!style="width:25%;text-align:right;"|'''Dataset'''
|-
|    T  ||    371 ||    371 ||  34,495 ||  17,569,828 || 3.37E+05 sec || negligible || sim.mu2e.cosmic-g4s1-cryfilter-lo.191125.art (Do not use. First stage only: no hits in the tracker or calo)
|-
|    T  ||  39,930 ||  39,930 || 2,226,092 ||  205,387,262 || 3.83E+08 sec || 0.3 || sim.mu2e.cosmic-g4s1-cryresample-lo.191125.art
|-
|    T  ||  79,623 ||  79,623 || 7,223,949 ||  390,213,276 || 1.28E+07 sec || 0.6 || sim.mu2e.cosmic-g4s1-cryresample-hi.191125.art
|-
|}
Log datasets:
* bck.mu2e.cosmic-g4s1-cryfilter-lo.191125.tbz
* bck.mu2e.cosmic-g4s1-cryresample-lo.191125.tbz
* bck.mu2e.cosmic-g4s1-cryresample-hi.191125.tbz
===CRY: digis===
Digitized samples for the year 2025 and 2030.
Note: It seems that proton time maps are applied to cosmics products.
The effect has no impact on cosmics background estimation.
However, we need to understand the reason why time offsets were applied. 
The following light yield value was used:
* physics.producers.CrvPhotons.scintillationYield                : 11588 //20 PE - beam on light yield in 2025
* physics.producers.CrvPhotons.scintillationYield                : 7532  //13 PE - beam on light yield in 2030
Each section takes about an hour on FermiGrid
* Offline version: v09_04_00
{|style="width: 90%;text-align:right;"
|-
!style="width:10%"|'''Location'''
!style="width:10%;text-align:right;"|'''Sample'''
!style="width:10%;text-align:right;"|'''Files'''
!style="width:10%;text-align:right;"|'''MB'''
!style="width:10%;text-align:right;"|'''Events'''
!style="width:10%;text-align:right;"|'''Live-time'''
!style="width:10%;text-align:right;"|'''Merging factor'''
!style="width:10%;text-align:right;"|'''Light Yield'''
!style="width:25%;text-align:right;"|'''Dataset'''
|-
|    T  ||  CRY3 ||  3,993 || 649,460 ||  45,300,046 || 3.83E+08 sec || 10 || 11588 || dig.mu2e.CRY-cosmic-general.2025lo.art
|-
|    T  ||  CRY3 ||  7,963 || 1,908,672 || 88,664,595 || 1.28E+07 sec || 10 || 11588 ||  dig.mu2e.CRY-cosmic-general.2025hi.art
|-
|    T  ||  CRY3 ||  3,993 || 626,886 ||  45,301,971 || 3.83E+08 sec || 10 || 7532 ||  dig.mu2e.CRY-cosmic-general.2030lo.art
|-
|    T  ||  CRY3 ||  7,963 || 1,844,576 || 88,669,970 || 1.28E+07 sec || 10 || 7532  || dig.mu2e.CRY-cosmic-general.2030hi.art
|-
|    T  ||  CRY3 ||  3,993 || ?? || ?? || 3.83E+08 sec || 10 || 16545 ||  dig.oksuzian.CRY-cosmic-general.cry3-digi-lo.art
|-
|    T  ||  CRY3 ||  7,963 || ?? || ?? || 1.28E+07 sec || 10 || 16545 ||  dig.oksuzian.CRY-cosmic-general.cry3-digi-hi.art
|-
|    T  ||  CRY4 ||  x || x ||  x || 5.09E+07 sec || 10 || 11588 ||  dig.mu2e.CRY-cosmic-general.0920-2025lo.art
|-
|    T  ||  CRY4 ||  x || x || x || 4.55E+06 sec || 10 || 11588 ||  dig.mu2e.CRY-cosmic-general.0920-2025hi.art
|-
|}
Log datasets:
* bck.mu2e.sim.2025hi.tbz
* bck.mu2e.sim.2025lo.tbz
Experts: Yuri Oksuzian
===CRY4: stage 1===
The datasets:
* Parent: cnf.mu2e.cry_s1_resample.020620.fcl, based of cosmic_s1_dsstops.fcl
* Geometry: Mu2eG4/geom/geom_CRY_2019_PhaseI.txt
* sim.mu2e.cosmic-g4s1-dsstops.cry-rs1-0220-g4-10-5.art
* Log files with truncated stream: bck.mu2e.cry_s1_resample.cry-rs1-0220-g4-10-5.tbz
Each file corresponds to 1E6 simulated events and the live-time of 11.835 sec. The stopping planes were arranged in the configuration described in docdb-29112.
* Offline git branch: alcc2019 based of v7_5_7
* G4 version: v4_10_5_p01
* ART version: v3_03_01
* Number of files: 58125
* Size: 11,310,236,341,478
* Number of events: 2,495,733,817
* Cosmic rate at DS 3627.5 [Hz]
* Simulated live-time: 6.88E5 sec
* CPU hours: 2.85E+06
* triggering rate: 4.3%
===CRY4: stage 2===
Created from dataset sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019.art by resampling procedure docdb-29112.
* Parent fcl: cnf.mu2e.sim.crys2lo-1220.fcl
* Offline version: v09_12_00
* G4 version: geant4-10-06-patch-02
* 500,000 resampled events per output file
* lo sample: events with <16 MeV deposition in CRV
** 1 resampled event corresponds to ??? sec
* hi sample: events with >16 MeV deposition in CRV
** 1 resampled event corresponds to ??? sec
*samweb list-definitions --user=mu2epro | grep 123020
** mu2eDatasetFileList bck.mu2e.sim.123020.tbz
{|style="width: 90%;text-align:right;"
|-
!style="width:10%"|'''Location'''
!style="width:10%;text-align:right;"|'''SAM files'''
!style="width:10%;text-align:right;"|'''MB'''
!style="width:10%;text-align:right;"|'''Events'''
!style="width:10%;text-align:right;"|'''Live-time [sec]'''
!style="width:10%;text-align:right;"|'''CPU Mhours'''
!style="width:10%;text-align:right;"|'''Offline ver'''
!style="width:25%;text-align:right;"|'''Dataset'''
|-
|    T  ||  5813 ||  682,408 ||  337,849,938 || 687,909 || negligible || x || sim.mu2e.filtered-s1.200605.art (Stage1 only)
|-
|    T  || ??? || ??? ||  ??? || ??? sec || ??? || x || sim.mu2e.s2-dsstops-resampler.091120.art (lo)
|-
|    T  ||  49955 || 4,128,996 ||  297,651,147 || 5.09E7 || 0.25M || x || sim.mu2e.s2-dsstops-resampler.092020.art (lo)
|-
|    T  ||  133557|| 11,259,578 ||  780,914,911 || 1.36E8 || 1.5M(Bebop) || x || sim.mu2e.s2-dsstops-resampler.123020.art (lo)
|-
|    T  ||  39827 || 4,610,492 ||  167,363,296 || 5.49E6 sec || x || x || sim.mu2e.s2-dsstops-resampler.092020-hi.art (hi)
|-
|}
Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran
===CRY5: stage 1===
The datasets:
* Parent: cnf.mu2e.cry5s1.110221.fcl, based of S1DSStopsCRY.fcl
* Geometry: Mu2eG4/geom/geom_CRY_2019_PhaseI.txt
* sim.mu2e.CosmicDSStopsCRY.110321.art (0.001 mm minRangeCut - do not use)
* sim.mu2e.CosmicDSStopsCRY.010622.art (1.0 mm minRangeCut)
* Log files with truncated stream: bck.mu2e.cry5s1.010622.tbz
Each file corresponds to 300,000 simulated events and the live-time of 11.84 sec. The stopping planes were arranged in the configuration described in docdb-29112.
* Muse: MDC2020n
* G4 version: ???
* ART version: ???
* Number of files: 46,981
* Size: 135,94,595,234,991
* Number of events: 1,986,182,321
* Simulated live-time: 556,255 sec
* Cosmic rate at DS: 3570 Hz
* CPU hours: 3.4E6 KNL hours on Bebop
* triggering rate: ???%
===CRY5: stage 2 (Low)===
We first create the filtered dataset that contains events with > 16 MeV deposition in the CRV
The dataset sim.mu2e.CosmicDSStopsLowCRY.010622.art is filtered from S1
* Filter efficiency: 0.1023
Then we resample sim.mu2e.CosmicDSStopsLowCRY.010622.art by the procedure described in docdb-29112.
* Parent fcl: cnf.mu2e.sim.cry5s2lo.fcl
* SimJob version: MDC2020o
* Offline version: v10_09_00
* G4 version: geant4-10-07-patch-02
* 500,000 resampled events per output file
* lo sample: events with <16 MeV deposition in CRV
** 1 resampled file corresponds to 1272.46 sec
** mu2eDatasetFileList bck.?.?.?.tbz
*Note: Only low sample has a requirement 500 MeV particle in the tracker.
{|style="width: 90%;text-align:right;"
|-
!style="width:10%"|'''Location'''
!style="width:10%;text-align:right;"|'''SAM files'''
!style="width:10%;text-align:right;"|'''MB'''
!style="width:10%;text-align:right;"|'''Events'''
!style="width:10%;text-align:right;"|'''Live-time [sec]'''
!style="width:10%;text-align:right;"|'''CPU Mhours'''
!style="width:10%;text-align:right;"|'''SimJob'''
!style="width:25%;text-align:right;"|'''Dataset'''
|-
|    T  ||  46,981 ||  715,507 ||  244,512,440 || 556,255 || negligible || x || sim.mu2e.CosmicDSStopsLowCRY.010622.art (Stage1 only)
|-
|    T  ||  90,685 || 3,722,128 ||  692,979,476 || 1.15E8 || 3.0 (KNL) || MDC2020o || dts.mu2e.CosmicCRYlo.MDC2020o.art (lo)
|-
|    T  ||  19,993 || 7,693,097 ||  976,228,026 || 2.37E6 || 6 h/job || MDC2020p || dts.mu2e.CosmicCRYhi.MDC2020p.art (hi)
|-
|}
===CRY5: stage 2 (High)===
* hi sample: events with >16 MeV deposition in CRV
Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran
===CRY stage 1: 10.4-1019===
The datasets:
* Parent: cnf.mu2e.cry_rs1.100619.fcl, based of cosmic_s1_dsstops.fcl
* sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019-g4-10-4.art
* sim.mu2e.cosmic-g4s1s2-cryresample-truncated.g4-10-4-cat.art
* bck.mu2e.cry_rs1.cry-rs1-1019-g4-10-4.tbz
Each file corresponds to 3E6 simulated events and the live-time of 16.84 sec. The stopping planes were arranged in the configuration described in docdb-29112.
* Offline version: v7_5_4
* G4 version: v4_10_4_p03b
* ART version: v3_03_01
* Number of files: 18519
* Number of simulated cosmics: 5.56E+10
* Simulated live-time: 3.12E+05 sec
* CPU hours: 2.78E+05
* triggering rate: 1.78%
===DYB 1: stage 1===
The datasets:
* Parent: cnf.mu2e.dyb_dsstops.0519.fcl, based of cosmic_s1_dsstops_DYB.fcl
* sim.mu2e.cosmic-g4s1-dsstops.dyb0520.art
* sim.mu2e.cosmic-g4s1-truncated-dsstops.dyb0520.art
* bck.mu2e.???.tbz
Each file corresponds to 1E6 simulated events and the live-time of 20.35 sec. The stopping planes were arranged in the configuration described in docdb-29112.
* Offline version: v09_05_00
* G4 version: geant4-10-05-patch-01
* ART version: v3_05_01
* Number of files: 49905
* Dataset size [MB]: 25,230,489
* Number of simulated events: 49,905E6
* Number of triggered events: 3,886,243,195
* Simulated live-time: 1015559.5 sec
* CPU hours: 800/0.58E3 Bebop hours
* triggering rate: 7.76%
Experts: Yuri Oksuzian, Lisa Goodenough
===Wideband MC===
Described in doc-49689
Inner gap size: 0 mm
Outer gap size: 0.1 mm
Cross talk: 4%
Relative PE yield: 1.01
PE spread: 2%
{| class="wikitable"
! Configuration name !! Live-time [hours] !! Geometry file !! Notes
|-
| nts.mu2e.CRV_wideband_cosmics-mc.config_0012_v1.root || 409 ||  || Turned off special (aging, Mu2e-II) counters
|-
| nts.mu2e.CRV_wideband_cosmics-mc.config_0012_v2.root || 409 ||  || Modules moved closer to wall, light yield changed to channel-by-channel variation
|-
| nts.mu2e.CRV_wideband_cosmics-mc.config_0012_v4.root ||  ||  || Same as 0012_v2, but the target plane size is increased from 1m2 to 10m2
|-
| nts.mu2e.WidebandCRV_v2.MDC2020ag.root ||  || geom_Wideband4modules_v3.txt || Same as 0012_v2, but all concrete in the geometry was changed to air
|-
| nts.mu2e.WidebandCRV_v4.MDC2020ag.root ||  || geom_Wideband4modules_v4.txt ||
|-
| nts.mu2e.WidebandCRV_v5.MDC2020ag.root ||  || geom_Wideband4modules_v5.txt ||
|-
| nts.mu2e.WidebandCRV_v5a.MDC2020ag.root ||  || geom_Wideband4modules_v5a.txt || Same as v5, but channel-by-channel variation of the light yield is turned off
|-
| nts.mu2e.WidebandCRV_v6.MDC2020ag.root ||  || geom_Wideband4modules_v6.txt ||
|}
=== MDC2020 ===
MDC2020, run in mid-2021, is a update of MC procedures, and a focus on calibration and early data samples.  [[MDC2020 | MDC2020 dataset page]]


==Pions==
==Pions==
Line 78: Line 660:
head of branch pbarAnalysis, from head after v6_2_3, on Aug 25 15:22, hash 2ce1246d3d7833bcdd8fcf38bcea3ab6f3255755.   
head of branch pbarAnalysis, from head after v6_2_3, on Aug 25 15:22, hash 2ce1246d3d7833bcdd8fcf38bcea3ab6f3255755.   
100K jobs x 500K pbars, first NERSC production - docker image mu2e/prd:pbar-00.  generate and sim to the upstream side of TS1 pbar window.  
100K jobs x 500K pbars, first NERSC production - docker image mu2e/prd:pbar-00.  generate and sim to the upstream side of TS1 pbar window.  
fcl dataset: cnf.rhbob.NERSCprod1.pbarAnalysis_0_1.fcl  Concatenated dataset sim.mu2e.antiprotons_cs1VD91.170829.art
Production: Ray Culbertson, Physics: Bob Bernstein.
Expert: Bob Bernstein
 
* fcl dataset: cnf.rhbob.NERSCprod1.pbarAnalysis_0_1.fcl   
* Concatenated dataset (485 files, 177637185 events): sim.mu2e.antiprotons_cs1VD91.170829.art
* logs and TFileService: bck.mu2e.NERSCprod1.170829.tbz
 
===2019 Bernstein Study===
 
Code has been rewritten to streamline the procedure, and the sample is regenerated.
 
Stage 0 generates protons on target, traces them through all target interactions, then stops the simulation, saving only particles that could have produces a pbar when interacting.
sim.mu2e.masterPbarVertices.v0.000.art
 
The first interaction in the target is selected as a pbar production point and a pbar is generated random in direction angle, and with momentum flat from X to Y.  The pbar is not propagated.  The output is a file with the vertices and pbars now produces an art file which contains pbars in the production target.
 
==Spill Structure==
 
I have prepared 2 files with the full statistics of the simulated spills found in Mu2e-doc-33344.  The files are
 
  /pnfs/mu2e/persistent/users/kutschke/PBI-Final/dig.kutschke.NoPrimary-pbiseq-mix-det-cat.v09_09_00.001000_00000000.art
  /pnfs/mu2e/persistent/users/kutschke/PBI-Final/dig.kutschke.NoPrimary-pbiseq-mix-det-cat.v09_09_00.001001_00000000.art
 
The first is the normal spill and the second is the pathlogical spill.  Both files still use the old model of the CRV shielding.  There are 25438 eventrs in each file,  Experts: Rob Kutschke and Steve Werkema.
 
 
[[Category:Computing]]
[[Category:Workflows]]
[[Category:Datasets]]

Latest revision as of 23:01, 19 July 2024

Introduction

This page is an attempt to record the datasets created and uploaded by "production". These are semi-permanent datasets that were created for the collaboration as a whole. It is nearly impossible to maintain dataset information perfectly when any datasets can become invalidated in various ways, or completely obsolete, at any time, for many reasons. Please do not use any datasets without consulting experts in these datasets - that's still the best way to be sure you are using the right dataset.

To print lists of datasets that are known to SAM - all or optionally with restrictions (see -h). 

setup mu2efiletools
mu2eDatasetList

To see the files in a dataset with full file paths: 

mu2eDatasetFileList dataset_name_here >& fcllist.txt

See also Workflows, FileTools and SAM.

Dataset clean-up

In 10/2020, as part of migration from T10Kc to LTO8 tape formats, Rob deleted about 700TB of datasets, including most of the largest from CD3. google spreadsheet list

Beam

TDR

See TDRDatasets

cd3

See background group.

051017

This sample of stage 1 beam simulation was generated in May 2017 to answer questions about CRV shielding. Default geometry. This sample is standard enough that it could be of use to other groups. Goals of this effort:

  • Rates and dead-time with improved precision
  • Sources of coincidences from neutrons and gammas
  • Improved shielding and CRV geometry to mitigate rates and to increase CRV coverage (geometry changed in later stages)

The standard cd3 beam stage 1 fcl was modified to only write out the dsregion and mubeam datasets. Run in v6_2_1. See 8627 and 7040. Expert: Yuri Oksuzian.

  • 500K jobs of 10K POT, total 5e9 POT
  • cnf.mu2e.cd3-beam-g4s1.051017.fcl
  • sim.mu2e.cd3-beam-g4s1cat-mubeam.051017.art (concatenated 20-to-1, uploaded)
  • sim.mu2e.cd3-beam-g4s1cat-dsregion.051017.art (concatenated 20-to-1, uploaded)

geant4 v10 test samples

Run 11/2016 to 2/2017 to test geant4 v10. See doc-9336 doc-9624 doc-9402 doc-9139 doc-8357. For dataset details, see GeantV10Test. Expert: Ray Culbertson and Yuri Oksuzian.

MDC2018

A dataset to replace cd3 background frames and signal samples, largely driven by changes in tracker and target geometry.

Details

geant4-10-04-patch-02

The samples were produced on Bebop using 750k CPU hours

  • sim.mu2e.beam-g4s1-dsregion.0619.art
  • sim.mu2e.beam-g4s1-mubeam.0619.art
  • sim.mu2e.beam-g4s1-truncated.0619.art
  • bck.mu2e.beams1phase1.0619.tbz

Each file corresponds to 1E5 POT, and the total samples POT is equal to 3.298E8. The stopping planes were arranged in the configuration described in docdb-26541. This version of geant4 includes a bug in Kaon cross-sections.

  • G4 version: v4_10_4_p02a
  • CLHEP version: v2_3_4_6
  • ART version: v2_12_01
  • Offline version: v7_4_1

Expert: Yuri Oksuzian.

geant4-10-05-patch-01a

The samples were produced on Bebop using ~250k CPU hours

  • cnf.mu2e.beams1-g4-10-5.0919.fcl
  • sim.mu2e.beam-g4s1-dsregion.g4-10-5.art
    • File count: 2160
    • Total size: 114,348,861,373
    • Event count: 55,462,720
    • Trigger rate: 64%
  • sim.mu2e.beam-g4s1-mubeam.g4-10-5.art
    • File count: 2160
    • Total size: 56,514,622,485
    • Event count: 18,340,970
    • Trigger rate: 21.2%
  • bck.mu2e.beams1-g4-10-5.g4-10-5.tbz

Each file corresponds to 4E4 POT, and the total samples POT is equal to 0.864E8. The stopping planes were arranged in the configuration described in docdb-26541.

Truncated files are empty and can recovered from the archive.

  • G4 version: v4_10_5_p01a
  • CLHEP version: v2_4_1_2
  • ART version: v3_03_01
  • Offline version: v7_5_4

Expert: Yuri Oksuzian.

geant4-10-04-patch-03b

The samples were produced on Bebop using ~250k CPU hours

  • cnf.mu2e.beams1phase1.v0619.fcl
  • sim.mu2e.beam-g4s1-dsregion.g4-10-4.art
    • File count: 960
    • Total size: 124,602,399,046
    • Event count: 61701227
    • Trigger rate: 64.3%
  • sim.mu2e.beam-g4s1-mubeam.g4-10-4.art
    • File count: 960
    • Total size: 56,681,687,449
    • Event count: 19030020
    • Trigger rate: 19.8%
  • bck.mu2e.beams1phase1.g4-10-4.tbz
  • sim.mu2e.beam-g4s1-truncated.g4-10-4-cat.art

Each file corresponds to 1E5 POT, and the total samples POT is equal to 0.96E8. The stopping planes were arranged in the configuration described in docdb-26541.

  • G4 version: v4_10_4_p03b
  • CLHEP version: v2_4_1_2
  • ART version: v3_03_01
  • Offline version: v7_5_4


beams1-g4-10-5-alcc

The samples were produced on Bebop and Theta using LCRC,ALCC resources

  • cnf.mu2e.beams1-g4-10-5.0919.fcl
  • sim.mu2e.beam-g4s1-dsregion.beams1-g4-10-5-alcc.art
    • File count: 14466
    • Total size: 758,659,292,452
    • Event count: 371,088,115
    • Trigger rate: 64.1%
  • sim.mu2e.beam-g4s1-mubeam.beams1-g4-10-5-alcc.art
    • File count: 14466
    • Total size: 300,280,017,684
    • Event count: 102,389,354
    • Trigger rate: 17.7%
  • bck.mu2e.beams1-g4-10-5.g4-10-5.tbz

Each file corresponds to 4E4 POT, and the total samples POT is equal to 5.8E8. The stopping planes were arranged in the configuration described in docdb-26541.

Truncated files are empty and can be recovered from the archive.

  • G4 version: v4_10_5_p01a
  • CLHEP version: v2_4_1_2
  • ART version: v3_03_01
  • Offline version: alcc2019_v757

Expert: Yuri Oksuzian.

MDC2020Dev

MDC2020Dev a development sample is available to test certain updates, and as input to nightly reco validation.

MDC2020

MDC2020, run in mid-2021, is a update of MC procedures, and a focus on calibration and early data samples. MDC2020 dataset page

other projects

SU2020 : Datasets for '2020 sensitivity updates

SU2020 dataset page

PBAR2M : Datasets for in-situ estimates of the antiproton background

PBAR2M dataset page

Tracker VST Datasets

[| Tracker VST dataset page]

Cosmics

Calibration Cosmic Test Sample

  • 2022-11-28 P.M. : calibration datasets below are obsolete, see MDC2020#Current_Datasets for the description of current ones

Calibration cosmics are events taken with a simulated trigger intended to collect all cosmics that hit a detector, for use in calibration studies. The digis for trk and cal are written out, as well as the StepPointMC's for CRV (the CRV product is being updated, so we did not write here). The code used was built locally and not tagged, thought it was eventually committed. v6_5_2 should read it OK. Expert: Ray Culbertson

3/2018, three samples were generated, 1M events generated for each then some filtering.

  • ext - detector extracted to +14m in z
    • Bfield is on but the default maps do not reach that far, so Bfield appears off
    • trigger on trk OR cal
    • Dataset: sim.mu2e.cosmic_calib_ext.180302.art
    • geometry: Mu2eG4/geom/geom_common_garage.txt (mods to Mu2eG4/geom/geom_common_current.txt)
    • Total cosmic rate = 1989.85 Hz for 1M events = 502s livetime
  • ins - detect in normal inserted position
    • Bfield on
    • trigger on trk OR cal
    • Dataset: sim.mu2e.cosmic_calib_ins.180302.art
    • geometry: Mu2eG4/geom/geom_common.txt (->Mu2eG4/geom/geom_common_cd3_s4p2.txt)
    • Total cosmic rate = 1989.85 Hz for 1M events = 502s livetime
  • crv - detect in normal inserted position
    • Bfield on
    • trigger on CRV hits
    • Dataset: sim.mu2e.cosmic_calib_crv.180302.art
    • geometry: Mu2eG4/geom/geom_common.txt (->Mu2eG4/geom/geom_common_cd3_s4p2.txt)
    • Total cosmic rate = 23010.7 Hz for 1M events = 43s livetime

target6/7 Study

Generated to study how cosmics enter the gap between the CRV top and sides, to help determine the CRV final design. Daya Bay generator. Summary talk 11147. Expert: Ralf Ehrlich.

  • target6 - left (+x) top gap
  • target7 - right (-x) top gap

Stages: same as cd3 processing.

6/2017 full listing

target5 Study

Generated to study cosmic rays that enter the TS hole and produce tracks, and how they can be degraded with new shielding blocks. This follows up on this category of events discovered in CD3 target1. Daya Bay generator. Talk summary 8322. Expert: Ray Culbertson.

The talk shows the various shielding configurations and concludes new shielding would help. Stages:

  • s1 - v579, generate on a plane that is the TS opening, sim to a surface between TS3 and TS5
  • s2 - various branches off of v579, complete sim, reco, require a track 50-200 MeV.

The job were run around 11/2016.

git tag dataset name
v5-7_9 sim.mu2e.cd3-cosmic-g4s1-target5.0901a.art
v5-7_9-cosmic-target5-v2 sim.mu2e.cd3-cosmic-g4s2-target5.1026a_geom1.art
v5-7_9-cosmic-target5-v3 sim.mu2e.cd3-cosmic-g4s2-target5.1104a_geom2.art
v5-7_9-cosmic-target5-v4 sim.mu2e.cd3-cosmic-g4s2-target5.1206a_geom3.art
v5-7_9-cosmic-target5-v5 sim.mu2e.cd3-cosmic-g4s2-target5.1216a_geom4.art
v5-7_9-cosmic-target5-v6 sim.mu2e.cd3-cosmic-g4s2-target5.1208a_geom5.art

Stage1 fcl and archive: 

bck.mu2e.cd3-cosmic-g4s1-target5.0901a.tbz
cnf.mu2e.cd3-cosmic-g4s1-target5.0901a.fcl

Stage 2 fcl and archive. The geometry was changed by running the same fcl but a different release, defined by the tag and loaded on cvmfs in OfflineSpecial 

cnf.mu2e.cd3-cosmic-g4s2-target5.0901a_geom1.fcl
bck.mu2e.cd3-cosmic-g4s2-target5.1026a_geom1.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1104a_geom2.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1206a_geom3.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1216a_geom4.tbz
bck.mu2e.cd3-cosmic-g4s2-target5.1208a_geom5.tbz

cd3 background

Produced to determine the cosmic background for CD3 review. Daya Bay generator. Talk summary 7131, memo 3059. Expert: Ralf Ehrlich.

  • general - all cosmics passing through a horizontal surface through detector.
  • target1 - left side, around TS entrance
  • target2 - upstream face
  • target3 - downstream face
  • target4 - cryo hole

Stages (s1-s4 uploaded)

  • s1 - v542, simulate CRV, require 45 MeV of energy on detector volume surface, stop
  • s2 - v566, simulate detectors, require 15 straw hits
  • s3 - v574, reco, require a track 50-200 MeV
  • s4 - v576, require tracks, 100-110 MeV, passing all cuts, PID, no upstream track
  • s5 - v576, reconstruct CRV and make analysis ntuples (not uploaded)

For s1 and s2, there is also a truncated data stream, which is events that overflow the SimParticle list.

date Offline name
5/2016 v576 sim.mu2e.cd3-cosmic-g4s4-general.v542_v566_v574_v576.art
5/2016 v576 sim.mu2e.cd3-cosmic-g4s4-target1.v542_v566_v574_v576.art
5/2016 v576 sim.mu2e.cd3-cosmic-g4s4-target2.v542_v566_v574_v576.art
5/2016 v576 sim.mu2e.cd3-cosmic-g4s4-target3.v542_v566_v574_v576.art
5/2016 v576 sim.mu2e.cd3-cosmic-g4s4-target4.v542_v566_v574_v576.art

There is another page with a full list of these datasets.


CRY 1

A sample of 4.9% of a mu2e live-time with CRY cosmic generator produced around Dec 20, 2018. We assume 1.06E7 sec of Mu2e live-time (needs to be updated). This was produced at the Argonne HPC center, "Bebop" farm. The computing year deadline was approaching so some shortcuts had to be made, and the procedure was not fully in the production scripting. branch =v7_2_0_CRYMT based of Offline tag=v7_2_0 fcl =JobConfig/cosmic/cosmic_defs_s1s2.fclinc. The generator time was set to 0, so the time of the hits needs to be offset to get into the reco window, see GenerateCosmicTimes_module.cc

Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran

The following configuration (EventGenerator/defaultConfigs/othersCRYconfig.txt) was used: 

CRY::CRYSetup: Setting returnMuons to 1
CRY::CRYSetup: Setting returnNeutrons to 1 
CRY::CRYSetup: Setting returnProtons to 1 
CRY::CRYSetup: Setting returnGammas to 1 
CRY::CRYSetup: Setting returnElectrons to 1
CRY::CRYSetup: Setting returnPions to 1
CRY::CRYSetup: Setting returnKaons to 1
CRY::CRYSetup: Setting date to 6-21-2021 (month-day-year)
CRY::CRYSetup: Setting latitude to 41.8
CRY::CRYSetup: Setting altitude to 0
CRY::CRYSetup: Setting subboxLength to 30

The production plane of 30x30 meters was centered at the tracker. Generated primaries were projected back to the world volume. The simulation then was initiated from the world volume. The sample was produced using 0.75M (divided by 0.58) CPU hours on Bebop, processing on 32 cores with 8 threads.

The total number of files: 6545*10 There are 2E6 events per file. The total number of events: 6545*10*2E6=1.309E+11 The rate in the generation plane, including non-muons: 281.6 Hz/m2 x 900 m2 = 253440 Hz The total simulated live-time: 1.309E+11/253440 = 516493 sec.

Output datasets:

  • sim.mu2e.cosmic-g4s1s2-crygeneral-cat.181220.art (6545 files, 141,614,791 events, 1.9TB)
  • sim.mu2e.cosmic-g4s1s2-truncated-crygeneral-cat.181220.art (1309 files, 61042 events)

With log file tarballs:

  • bck.mu2e.cosmic-g4s1s2-crygeneral-cat.181220.tbz
  • bck.mu2e.cosmic-g4s1s2-truncated-crygeneral-cat.181220.tbz

Adding digis with mixing:

  • cnf.mu2e.CRY-cosmic-general-mix.MDC2018g.fcl
  • dig.mu2e.CRY-cosmic-general-mix.MDC2018g.art
  • bck.mu2e.CRY-cosmic-general-mix.MDC2018g.tbz

CRY 2

In March 2019, the sample was generated using 1.5M CPU hours on Theta and 1.0M (divided by 0.58) hours on Bebop.

Each file from stage 1 output corresponds to 2.8 sec of live-time. We've generated 468747 files with a total live-time of 1315310 sec. As with CRY 1 sample, all particle species were simulated.

Configuration:

  • cnf.mu2e.cry.v734.fcl
  • CRY configuration: EventGenerator/defaultConfigs/defaultCRYconfig.txt
  • Tag: v7_3_5
  • fcl: Offline/JobConfig/cosmic/cosmic_s1_general_cryMT_G4internalFilters.fcl

The concatenated datasets:

  • sim.mu2e.cosmic-g4s1s2-truncated-cry2general-cat.190320.art sample was concatenated with a factor 1,000
  • sim.mu2e.cosmic-g4s1s2-cry2general-cat.190320.art sample was concatenated with a factor 5

The production plane of 300x300 meters was centered at the tracker and positioned at top of the dirt volume. Generated primaries were projected from the dirt toward the CRV box. Tracks that intersect CRV box were simulated.

The sample description and preliminary analysis are documented in docdb-26890.

Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran

CRY3: stage 1

The datasets:

  • Parent: cnf.mu2e.cry_rs1.100619.fcl, based of cosmic_s1_dsstops.fcl
  • sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019.art
  • sim.mu2e.cosmic-g4s1-cryresample-truncated.g4-10-5-cat.art
  • bck.mu2e.cry_rs1.cry-rs1-1019-g4-10-4.tbz

Each file corresponds to 3E6 simulated events and the live-time of 16.84 sec. The stopping planes were arranged in the configuration described in docdb-29112.

  • Offline version: v7_5_4
  • G4 version: v4_10_5_p01a
  • ART version: v3_03_01
  • Number of files: 20034
  • Number of simulated cosmics: 6.01E+10
  • Events triggered: 1067201262
  • Simulated live-time: 3.37E+05 sec
  • CPU hours: 3.28E+05

Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran

CRY3: stage 2

Created from dataset sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019.art by resampling procedure docdb-29112.

  • Offline version: v7_5_7
  • G4 version: v4_10_4_p03b
  • 500,000 resampled events per output file
  • lo sample: events with <14 MeV deposition in CRV
    • 1 resampled event corresponds to 0.01920 sec
  • hi sample: events with >14 MeV deposition in CRV
    • 1 resampled event corresponds to 0.00032 sec
Location SAM files Files MB Events Live-time CPU Mhours Dataset
T 371 371 34,495 17,569,828 3.37E+05 sec negligible sim.mu2e.cosmic-g4s1-cryfilter-lo.191125.art (Do not use. First stage only: no hits in the tracker or calo)
T 39,930 39,930 2,226,092 205,387,262 3.83E+08 sec 0.3 sim.mu2e.cosmic-g4s1-cryresample-lo.191125.art
T 79,623 79,623 7,223,949 390,213,276 1.28E+07 sec 0.6 sim.mu2e.cosmic-g4s1-cryresample-hi.191125.art

Log datasets:

  • bck.mu2e.cosmic-g4s1-cryfilter-lo.191125.tbz
  • bck.mu2e.cosmic-g4s1-cryresample-lo.191125.tbz
  • bck.mu2e.cosmic-g4s1-cryresample-hi.191125.tbz

CRY: digis

Digitized samples for the year 2025 and 2030.

Note: It seems that proton time maps are applied to cosmics products. The effect has no impact on cosmics background estimation. However, we need to understand the reason why time offsets were applied. The following light yield value was used:

  • physics.producers.CrvPhotons.scintillationYield  : 11588 //20 PE - beam on light yield in 2025
  • physics.producers.CrvPhotons.scintillationYield  : 7532 //13 PE - beam on light yield in 2030

Each section takes about an hour on FermiGrid

  • Offline version: v09_04_00
Location Sample Files MB Events Live-time Merging factor Light Yield Dataset
T CRY3 3,993 649,460 45,300,046 3.83E+08 sec 10 11588 dig.mu2e.CRY-cosmic-general.2025lo.art
T CRY3 7,963 1,908,672 88,664,595 1.28E+07 sec 10 11588 dig.mu2e.CRY-cosmic-general.2025hi.art
T CRY3 3,993 626,886 45,301,971 3.83E+08 sec 10 7532 dig.mu2e.CRY-cosmic-general.2030lo.art
T CRY3 7,963 1,844,576 88,669,970 1.28E+07 sec 10 7532 dig.mu2e.CRY-cosmic-general.2030hi.art
T CRY3 3,993 ?? ?? 3.83E+08 sec 10 16545 dig.oksuzian.CRY-cosmic-general.cry3-digi-lo.art
T CRY3 7,963 ?? ?? 1.28E+07 sec 10 16545 dig.oksuzian.CRY-cosmic-general.cry3-digi-hi.art
T CRY4 x x x 5.09E+07 sec 10 11588 dig.mu2e.CRY-cosmic-general.0920-2025lo.art
T CRY4 x x x 4.55E+06 sec 10 11588 dig.mu2e.CRY-cosmic-general.0920-2025hi.art

Log datasets:

  • bck.mu2e.sim.2025hi.tbz
  • bck.mu2e.sim.2025lo.tbz

Experts: Yuri Oksuzian

CRY4: stage 1

The datasets:

  • Parent: cnf.mu2e.cry_s1_resample.020620.fcl, based of cosmic_s1_dsstops.fcl
  • Geometry: Mu2eG4/geom/geom_CRY_2019_PhaseI.txt
  • sim.mu2e.cosmic-g4s1-dsstops.cry-rs1-0220-g4-10-5.art
  • Log files with truncated stream: bck.mu2e.cry_s1_resample.cry-rs1-0220-g4-10-5.tbz

Each file corresponds to 1E6 simulated events and the live-time of 11.835 sec. The stopping planes were arranged in the configuration described in docdb-29112.

  • Offline git branch: alcc2019 based of v7_5_7
  • G4 version: v4_10_5_p01
  • ART version: v3_03_01
  • Number of files: 58125
  • Size: 11,310,236,341,478
  • Number of events: 2,495,733,817
  • Cosmic rate at DS 3627.5 [Hz]
  • Simulated live-time: 6.88E5 sec
  • CPU hours: 2.85E+06
  • triggering rate: 4.3%

CRY4: stage 2

Created from dataset sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019.art by resampling procedure docdb-29112.

  • Parent fcl: cnf.mu2e.sim.crys2lo-1220.fcl
  • Offline version: v09_12_00
  • G4 version: geant4-10-06-patch-02
  • 500,000 resampled events per output file
  • lo sample: events with <16 MeV deposition in CRV
    • 1 resampled event corresponds to ??? sec
  • hi sample: events with >16 MeV deposition in CRV
    • 1 resampled event corresponds to ??? sec
  • samweb list-definitions --user=mu2epro | grep 123020
    • mu2eDatasetFileList bck.mu2e.sim.123020.tbz


Location SAM files MB Events Live-time [sec] CPU Mhours Offline ver Dataset
T 5813 682,408 337,849,938 687,909 negligible x sim.mu2e.filtered-s1.200605.art (Stage1 only)
T ??? ??? ??? ??? sec ??? x sim.mu2e.s2-dsstops-resampler.091120.art (lo)
T 49955 4,128,996 297,651,147 5.09E7 0.25M x sim.mu2e.s2-dsstops-resampler.092020.art (lo)
T 133557 11,259,578 780,914,911 1.36E8 1.5M(Bebop) x sim.mu2e.s2-dsstops-resampler.123020.art (lo)
T 39827 4,610,492 167,363,296 5.49E6 sec x x sim.mu2e.s2-dsstops-resampler.092020-hi.art (hi)

Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran


CRY5: stage 1

The datasets:

  • Parent: cnf.mu2e.cry5s1.110221.fcl, based of S1DSStopsCRY.fcl
  • Geometry: Mu2eG4/geom/geom_CRY_2019_PhaseI.txt
  • sim.mu2e.CosmicDSStopsCRY.110321.art (0.001 mm minRangeCut - do not use)
  • sim.mu2e.CosmicDSStopsCRY.010622.art (1.0 mm minRangeCut)
  • Log files with truncated stream: bck.mu2e.cry5s1.010622.tbz

Each file corresponds to 300,000 simulated events and the live-time of 11.84 sec. The stopping planes were arranged in the configuration described in docdb-29112.

  • Muse: MDC2020n
  • G4 version: ???
  • ART version: ???
  • Number of files: 46,981
  • Size: 135,94,595,234,991
  • Number of events: 1,986,182,321
  • Simulated live-time: 556,255 sec
  • Cosmic rate at DS: 3570 Hz
  • CPU hours: 3.4E6 KNL hours on Bebop
  • triggering rate: ???%

CRY5: stage 2 (Low)

We first create the filtered dataset that contains events with > 16 MeV deposition in the CRV The dataset sim.mu2e.CosmicDSStopsLowCRY.010622.art is filtered from S1

  • Filter efficiency: 0.1023

Then we resample sim.mu2e.CosmicDSStopsLowCRY.010622.art by the procedure described in docdb-29112.

  • Parent fcl: cnf.mu2e.sim.cry5s2lo.fcl
  • SimJob version: MDC2020o
  • Offline version: v10_09_00
  • G4 version: geant4-10-07-patch-02
  • 500,000 resampled events per output file
  • lo sample: events with <16 MeV deposition in CRV
    • 1 resampled file corresponds to 1272.46 sec
    • mu2eDatasetFileList bck.?.?.?.tbz
  • Note: Only low sample has a requirement 500 MeV particle in the tracker.


Location SAM files MB Events Live-time [sec] CPU Mhours SimJob Dataset
T 46,981 715,507 244,512,440 556,255 negligible x sim.mu2e.CosmicDSStopsLowCRY.010622.art (Stage1 only)
T 90,685 3,722,128 692,979,476 1.15E8 3.0 (KNL) MDC2020o dts.mu2e.CosmicCRYlo.MDC2020o.art (lo)
T 19,993 7,693,097 976,228,026 2.37E6 6 h/job MDC2020p dts.mu2e.CosmicCRYhi.MDC2020p.art (hi)

CRY5: stage 2 (High)

  • hi sample: events with >16 MeV deposition in CRV

Experts: Yuri Oksuzian, Lisa Goodenough, Nam Tran

CRY stage 1: 10.4-1019

The datasets:

  • Parent: cnf.mu2e.cry_rs1.100619.fcl, based of cosmic_s1_dsstops.fcl
  • sim.mu2e.cosmic-g4s1s2-cryresample.cry-rs1-1019-g4-10-4.art
  • sim.mu2e.cosmic-g4s1s2-cryresample-truncated.g4-10-4-cat.art
  • bck.mu2e.cry_rs1.cry-rs1-1019-g4-10-4.tbz

Each file corresponds to 3E6 simulated events and the live-time of 16.84 sec. The stopping planes were arranged in the configuration described in docdb-29112.

  • Offline version: v7_5_4
  • G4 version: v4_10_4_p03b
  • ART version: v3_03_01
  • Number of files: 18519
  • Number of simulated cosmics: 5.56E+10
  • Simulated live-time: 3.12E+05 sec
  • CPU hours: 2.78E+05
  • triggering rate: 1.78%


DYB 1: stage 1

The datasets:

  • Parent: cnf.mu2e.dyb_dsstops.0519.fcl, based of cosmic_s1_dsstops_DYB.fcl
  • sim.mu2e.cosmic-g4s1-dsstops.dyb0520.art
  • sim.mu2e.cosmic-g4s1-truncated-dsstops.dyb0520.art
  • bck.mu2e.???.tbz

Each file corresponds to 1E6 simulated events and the live-time of 20.35 sec. The stopping planes were arranged in the configuration described in docdb-29112.

  • Offline version: v09_05_00
  • G4 version: geant4-10-05-patch-01
  • ART version: v3_05_01
  • Number of files: 49905
  • Dataset size [MB]: 25,230,489
  • Number of simulated events: 49,905E6
  • Number of triggered events: 3,886,243,195
  • Simulated live-time: 1015559.5 sec
  • CPU hours: 800/0.58E3 Bebop hours
  • triggering rate: 7.76%

Experts: Yuri Oksuzian, Lisa Goodenough


Wideband MC

Described in doc-49689

Inner gap size: 0 mm

Outer gap size: 0.1 mm

Cross talk: 4%

Relative PE yield: 1.01

PE spread: 2%

Configuration name Live-time [hours] Geometry file Notes
nts.mu2e.CRV_wideband_cosmics-mc.config_0012_v1.root 409 Turned off special (aging, Mu2e-II) counters
nts.mu2e.CRV_wideband_cosmics-mc.config_0012_v2.root 409 Modules moved closer to wall, light yield changed to channel-by-channel variation
nts.mu2e.CRV_wideband_cosmics-mc.config_0012_v4.root Same as 0012_v2, but the target plane size is increased from 1m2 to 10m2
nts.mu2e.WidebandCRV_v2.MDC2020ag.root geom_Wideband4modules_v3.txt Same as 0012_v2, but all concrete in the geometry was changed to air
nts.mu2e.WidebandCRV_v4.MDC2020ag.root geom_Wideband4modules_v4.txt
nts.mu2e.WidebandCRV_v5.MDC2020ag.root geom_Wideband4modules_v5.txt
nts.mu2e.WidebandCRV_v5a.MDC2020ag.root geom_Wideband4modules_v5a.txt Same as v5, but channel-by-channel variation of the light yield is turned off
nts.mu2e.WidebandCRV_v6.MDC2020ag.root geom_Wideband4modules_v6.txt

MDC2020

MDC2020, run in mid-2021, is a update of MC procedures, and a focus on calibration and early data samples. MDC2020 dataset page

Pions

Antiprotons

Bernstein Study

9/2017 generating antiprotons in the primary target, flat in energy and phase space. head of branch pbarAnalysis, from head after v6_2_3, on Aug 25 15:22, hash 2ce1246d3d7833bcdd8fcf38bcea3ab6f3255755. 100K jobs x 500K pbars, first NERSC production - docker image mu2e/prd:pbar-00. generate and sim to the upstream side of TS1 pbar window. Production: Ray Culbertson, Physics: Bob Bernstein.

  • fcl dataset: cnf.rhbob.NERSCprod1.pbarAnalysis_0_1.fcl
  • Concatenated dataset (485 files, 177637185 events): sim.mu2e.antiprotons_cs1VD91.170829.art
  • logs and TFileService: bck.mu2e.NERSCprod1.170829.tbz

2019 Bernstein Study

Code has been rewritten to streamline the procedure, and the sample is regenerated.

Stage 0 generates protons on target, traces them through all target interactions, then stops the simulation, saving only particles that could have produces a pbar when interacting. sim.mu2e.masterPbarVertices.v0.000.art

The first interaction in the target is selected as a pbar production point and a pbar is generated random in direction angle, and with momentum flat from X to Y. The pbar is not propagated. The output is a file with the vertices and pbars now produces an art file which contains pbars in the production target.

Spill Structure

I have prepared 2 files with the full statistics of the simulated spills found in Mu2e-doc-33344. The files are 

  /pnfs/mu2e/persistent/users/kutschke/PBI-Final/dig.kutschke.NoPrimary-pbiseq-mix-det-cat.v09_09_00.001000_00000000.art
  /pnfs/mu2e/persistent/users/kutschke/PBI-Final/dig.kutschke.NoPrimary-pbiseq-mix-det-cat.v09_09_00.001001_00000000.art

The first is the normal spill and the second is the pathlogical spill. Both files still use the old model of the CRV shielding. There are 25438 eventrs in each file, Experts: Rob Kutschke and Steve Werkema.

Retrieved from "http://mu2ewiki.fnal.gov/w/index.php?title=Datasets&oldid=25591"