Code: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
 
(135 intermediate revisions by 7 users not shown)
Line 1: Line 1:
[http://mu2e.fnal.gov/atwork/computing/temp/v6_0_2.shtml example page for git documentation]
== Building code ==
== Building code ==


* Basic recipe for creating a satellite release
* [[End of Life for Scientific Linux 7]] Instructions needed for June 2024 only.
<pre>
* [[UPS to Spack Transition]] ongoing from spring 2024
source /cvmfs/fermilab.opensciencegrid.org/products/common/etc/setups
* [[CodeEnvironment]] how to setup the linux environment
setup mu2e
* [[GitIntro]] code management preliminaries for newcomers
/cvmfs/mu2e.opensciencegrid.org/Offline/v6_0_0/SLF6/prof/Offline/bin/createSatelliteRelease
* [[OfflineStatus]] which branch or tag of Mu2e Offline you should start from
cd Offline
* [[GitHubWorkflow]] - code repository checkout and commit procedures
source setup.sh
* [[IncludeFiles]] - where to find include files
[add content]
* [[Muse]] - Mu2e code setup and build scripts
scons -j 4
* [[scons]] - internal commercial build tool, called by Muse
</pre>
* [[Building Offline with cmake]] - DAQ is building Offline using a different commercial tool.
* [[CodeDebugging|Debugging]] code debugging tools and tips
* [https://www.github.com/Mu2e Mu2e github organization]
* [[UPS|UPS]] - using the Fermilab UPS product setup
* [[Redmine]] - a few pieces of code are still in the redmine git repository
* [[CVS]] - a few pieces of code are still in the CVS repository


* Basic recipe for setup, checkout and build
== Configuring executables ==
<pre>
*  [[FclIntro|fcl]] - intro to fcl art job control language
source /cvmfs/fermilab.opensciencegrid.org/products/common/etc/setups
** [[FclPaths|paths]] - which modules and what order
setup mu2e
** [[FclIOModules|I/O modules]]
git clone http://cdcvs.fnal.gov/projects/mu2eofflinesoftwaremu2eoffline/Offline.git
** [[MessageLogger|Message logger]]
- or -
* [[SearchPaths|Search paths]] - how data, fcl, and other control files are found
git clone ssh://p-mu2eofflinesoftwaremu2eoffline@cdcvs.fnal.gov/cvs/projects/mu2eofflinesoftwaremu2eoffline/Offline.git
* [[SimpleConfig|SimpleConfig]] - another way to input parameters to an executable
cd Offline
* [[Simulation|Simulation]] - an overview
git checkout -b work
** [[SimulationFCL]] - fcl procedures for MDC2020 and later
source setup.sh
** [[Generators]] - generating the first particle
scons -j 4
*** [[CORSIKA]] cosmic ray simulation
</pre>
** [[Staging|Staging]] - how and why of running the simulation in stages
* [[Git|git]] code repository management
** [[TimeSim|Time simulation]] - adding lifetimes
* [[scons]] code building tool
** [[BunchIntensity|Bunch intensity]] - simulating bunch-to-bunch variations
* [[SatelliteRelease|Satellite Releases]] for building only the part of the code base you need
** [[Mixing|Mixing]] - mixing background and signal simulation
** [[RunNumbers]] - how run numbers ranges are used
* Other applications
** [[EventDisplays]]
** [[Ntuples]] - data access at the interactive level
** [[MachineLearning|Machine learning]] - neural networks


== Modules, Products, and Services ==
== Modules, Products, and Services ==
* Modules
* Modules
** [[Modules|Modules]]
** [[Modules|Modules]]
** [[FclIOModules|I/O modules]]
** [[FilterModules|Filter Modules]]
** [[FilterModules|Filter Modules]]
* Products
* Products
Line 41: Line 48:
** [[MakeProducts|Making data products]]
** [[MakeProducts|Making data products]]
** [[Handles]]
** [[Handles]]
** [[PhysicalVolumeInfoCollection]] (needs update)
** [[PhysicalVolumeInfoCollection]]
** [[Provenance]] (needs update)
** [[Provenance]]
** [[CetMapVector|cet::map_vector]]
** [[CetMapVector|cet::map_vector]]
* [http://mu2e.fnal.gov/atwork/computing_atwork/geometry/Geometry.shtml Mu2e Geometry: The Big Picture] (convert to wiki)
** [[SchemaEvolution| Schema Evolution]]
** Notes on the geometry files
* [[Geometry|Geometry]]
** [http://mu2e-docdb.fnal.gov/cgi-bin/ShowDocument?docid=1120 Units and Coordinate Systems]
* [[Alignment]]
* Random numbers:  
* Random numbers:  
** [[RandomNumbersBasic|Basic Instructions]]
** [[RandomNumbersBasic|Basic Instructions]]
Line 51: Line 60:
* [[MagneticFieldMaps|Magnetic Field Maps]]  
* [[MagneticFieldMaps|Magnetic Field Maps]]  
* [[ConditionsData|Conditions Data]]
* [[ConditionsData|Conditions Data]]
** [https://mu2einternalwiki.fnal.gov/wiki/CalibrationSets CalibrationSets]
* [[Services|Services]]
* [[Services|Services]]
** [[ArtServices|Framework services]]
** [[ArtServices|Framework services]]
* [[SimpleConfig|SimpleConfig]]
* [[Exceptions|Exceptions]]
* [[Exceptions|Exceptions]]
 
* [[MessageLogger|Message logger]]
== Configuring executables ==
* [[PyWrap]] - wrap compiled c++ code so it can be used in python
* fcl
* [https://cdcvs.fnal.gov/redmine/projects/art/wiki/ArtExitCodes art error codes]
** [[FclIntro|Introduction]]
* [[Elastic Analysis Facility (EAF)|Elastic Analysis Facility (EAF)]]
** [[FclPaths|paths]]
** [[FclIOModules|I/O modules]]
** [[MessageLogger|Message logger]]
* [[SearchPaths|Search paths]]
* [[SimpleConfig|SimpleConfig]]


== Code Management ==
== Code Management ==


* [[Git|mu2e git]]
* [[Spack]] - setup and build tool to replace UPS and MRB
* Jenkins - a central build platform
* [[SpackMaintenance]] - expert procedures and debugging
** [[Jenkins|Jenkins overview]]
* [[Legacy_Access_to_SL7]]
** [http://mu2e.fnal.gov/atwork/computing/ops/nightlyBuild/nightly.shtml  Jenkins Nightly build results]
* [[MuseMaintenance]] - Muse procedures for experts
* [[Cvmfs]]
* [[ReleaseList]]
* [[Git|git]] - overview and pointers to detailed and mu2e-specific instructions
* [[Validation]] - automatic and occasional procedures for validation
* [[GeantChecklist]] - validation of new geant versions
* [[Jenkins]] - a central build platform
* [[Cvmfs|CVMFS]] - a virtual disk mount containing our code
* [[Docker]] a portable software container to hold and run our environment and software
* [[CodeDistribution|Download]] - pull a local copy to remote institutions or laptops
* [[CodeDistribution|Download]] - pull a local copy to remote institutions or laptops
* [[BTrk]] - the KalMan fitter code is in this non-standard product
* [[Scisoft|scisoft]] - server for product manifests
* [[BTrk]] - (deprecated) the Kalman fitter code is in this non-standard product
* [[KinKal]] - a repo and UPS product containing the core track Kalman fit code
* [[CVS]]
* [[CodeDepencyGraph]] - how to make the code dependency graph
* [[DAQ]] [https://cdcvs.fnal.gov/redmine/projects/mu2edaq/wiki DAQ redmine]
* [[RootBuild|building root]]
* [https://cdcvs.fnal.gov/redmine/projects/artutilscripts/repository/revisions/master/raw/tools/checkPrerequisites checkPrerequisites tool] - check linux has rpms needed by art
* [[SconsUPS]] - how to build a new version of scons, packaged for UPS
* [[Pyana]] - setting up python analysis packages
* [[Github_CI_Maintenance|Github CI Maintenance]] - information about the CI repo, used by Jenkins for build tests


== Standards and Practices ==
== Standards and Practices ==
*  [[Editors|Editors]], policy of not using tab characters.
* [[CodingStandards]] - an overview of code issues
* [[CodeTools]] - code formatting and checking tools
* [[MagicNumbers|Magic numbers]] - where to get value of pi, etc.
*  [[Editors|Editors]] - tips on editors and policy of not using tab characters.
* [[CodeDebugging|Debugging]]
* [[GeantTips]]
* [https://en.wikipedia.org/wiki/ISO_8601 ISO 8601 time format]
* CMS code references:
* CMS code references:
** [https://twiki.cern.ch/twiki/bin/view/CMSPublic/WebHome Home]  
** [https://twiki.cern.ch/twiki/bin/view/CMSPublic/WebHome Home]  
** [https://twiki.cern.ch/twiki/bin/view/CMSPublic/WorkBook Offline WorkBook]  
** [https://twiki.cern.ch/twiki/bin/view/CMSPublic/WorkBook Offline WorkBook]  
** [https://twiki.cern.ch/twiki/bin/view/CMSPublic/SWGuide SW Guide]  
** [https://twiki.cern.ch/twiki/bin/view/CMSPublic/SWGuide SW Guide]  
* [[Units|Units]] and Coordinate Systems
* FAQs
** [[CppFAQ|c++]]
** [[LinuxFAQ|linux]]
** [[RootFAQ|root]]
** [http://thbecker.net/articles/rvalue_references/section_01.html move semantics and r-value references]


== External Packages ==
== External Packages ==
* UPS/UPD as used by Mu2e  
* [[UPS| UPS]] [https://cdcvs.fnal.gov/redmine/projects/ups/wiki/ReferenceManual/ manual] [https://cdcvs.fnal.gov/redmine/projects/ups/wiki/Getting_Started_Using_UPS getting started]
* Setting up ROOT by itself
* Mu2e [https://github.com/Mu2e github] [https://cdcvs.fnal.gov/redmine/projects/mu2eofflinesoftwaremu2eoffline/repository redmine] [http://cdcvs.fnal.gov/lxr lab LXR] [http://cdcvs.fnal.gov/lxr/mu2eofflinesoftware/index.html Mu2e LXR] [https://lxr.sourceforge.io/en/index.php LXR project]
* Mu2e code    
* [https://web.fnal.gov/project/ArtDoc/Pages/home.aspx art]  [https://web.fnal.gov/project/ArtDoc/SitePages/documentation.aspx doc] [https://github.com/art-framework-suite github] [https://cdcvs.fnal.gov/redmine/projects/art redmine] [https://cdcvs.fnal.gov/redmine/projects/art/repository/revisions/master/show/art browser] [https://listserv.fnal.gov/scripts/wa.exe?A0=ART-USERS art-users] [https://cdcvs.fnal.gov/redmine/projects/cet-is-public/wiki/AboutQualifiers product flags] [https://cdcvs.fnal.gov/redmine/projects/art/wiki/ArtExitCodes error codes]
* art    
* [https://gcc.gnu.org/projects/cxx-status.html gcc features development] [https://gcc.gnu.org/onlinedocs/libstdc++/manual/status.html#manual.intro.status.iso gcc library dependence]
* CMS Framework    
* [https://indico.fnal.gov/category/1191/ recent art stakeholders meetings]; [https://cdcvs.fnal.gov/redmine/projects/art/wiki/Stakeholder_meeting_presentations older art stakeholders meetings]
* Root (v5.28)
* [https://cdcvs.fnal.gov/redmine/projects/artdaq/wiki artdaq wiki]
*  Geant4 DOxygen(v9.4.p01)
* [http://rpubs.com/paterno/303233 Paterno memory profiling instructions]
* Geant4 LXR
* [http://valgrind.org valgrind]]
* CLHEP(v.2.2.0.4)
* [https://cdcvs.fnal.gov/redmine/projects/art/wiki/Getting_started_with_MAP_and_DDT MAP and DDT debuggers]
* HepPDT
* [https://twiki.cern.ch/twiki/bin/view/CMSPublic/SWGuide CMS Framework] [http://cmslxr.fnal.gov/lxr/ LXR]
* fhicl-cpp
* [https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/SetupCMSbotScriptsYourOrg CMS github PR] [https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/Maintaining_CMSbot_scripts_and_Jenkins_jobs more info]
* cetlib
* [https://root.cern.ch/root/ root] [https://root.cern.ch/guides/reference-guide docs]
* Message Facility
* [http://geant4.web.cern.ch/geant4/ geant] [https://web.fnal.gov/project/Geant4/SitePages/Home.aspx at Fermilab]  [http://www-geant4.kek.jp/Reference/9.4.p01/Geant4 DOxygen(v9.4.p01)] [http://www-geant4.kek.jp/LXR/ LXR]
* cpp0x
* [[Geant4Examples]] How to run the standard Geant4 examples on the Mu2e interactive machines.
* BTrk
* [http://public.muonsinc.com/Projects/G4beamline.aspx G4Beamline]  [http://mu2e-docdb.fnal.gov/cgi-bin/ShowDocument?docid=1490 Mu2e manual]
* LXR browsers for many Fermilab projects
* [http://proj-clhep.web.cern.ch/proj-clhep/ CLHEP] [http://proj-clhep.web.cern.ch/proj-clhep/doc/CLHEP_2_2_0_4/html/ CLHEP(v.2.2.0.4)]
* The art redmine wiki,  art-users archive
* [http://lcgapp.cern.ch/project/simu/HepPDT/ HepPDT]
* Other external software used by Mu2e with links to documentation.
* [https://cdcvs.fnal.gov/redmine/projects/fhicl/wiki fhicl] [https://cdcvs.fnal.gov/redmine/projects/fhicl-cpp/repository  fhicl-cpp]
 
* [https://cdcvs.fnal.gov/redmine/projects/cetlib cetlib] [https://cdcvs.fnal.gov/redmine/projects/cetlib/repository  browser] [https://fnalssi.github.io/cetmodules/ cetmodules]
* [https://cdcvs.fnal.gov/redmine/projects/messagefacility Message Facility] [https://cdcvs.fnal.gov/redmine/projects/messagefacility/repository browser]
* [https://cdcvs.fnal.gov/redmine/projects/cpp0x cpp0x] [https://cdcvs.fnal.gov/redmine/projects/cpp0x/repository browser]
* [http://www.boost.org/ boost]  [http://www.boost.org/doc/libs/1_47_0 browser]
* [[BTrk]] [https://github.com/KFTrack/BTrk browser]
* [https://cdcvs.fnal.gov/lxr/ LXR browsers] for many Fermilab projects
* [[Scons|scons]]
* [http://mu2e.fnal.gov/atwork/computing_atwork/mu2emars.shtml MARS] (password protected)
[[Category:Computing]]
[[Category:Computing]]
[[Category:Computing/Code]]
[[Category:Code]]

Latest revision as of 16:15, 23 August 2024

Building code

Configuring executables

Modules, Products, and Services

Code Management

Standards and Practices

External Packages

Retrieved from "http://mu2ewiki.fnal.gov/w/index.php?title=Code&oldid=25921"