MuseMaintenance: Difference between revisions

From Mu2eWiki
Jump to navigation Jump to search
No edit summary
Line 49: Line 49:
* if needed, repoint the "Production/current" link to this new tag
* if needed, repoint the "Production/current" link to this new tag
* cd ~ and publish the transaction
* cd ~ and publish the transaction
==Publishing ProdJob==
ProdJob is a published Muse build area that contains both Offline and Production.  It can serve as the basis for submitting production jobs.  Currently, the plan is to publish Offline and Production as separate Musings, then make a ProdJob linking to these two.  We expect that Production will be updated more frequently than Offline, and ProdJob allows for this case efficiently.
In a scratch area, assuming an Offline tag ''otag'', a Production tag ''ptag'' and a targeted ProdJob tag ''tag'',
setup mu2e
setup muse
muse link Offline ''otag''
muse link Production ''ptag''
muse setup
muse build
muse tarball -r Prodjob/''tag''
And, as described in previous sections, also setup, build, and tar a "debug" version in a second process. Upload the resulting tarballs to cvmfs Musings area.





Revision as of 21:27, 17 June 2021

Publishing Offline tags

When Offline is tagged, it needs to be build and published on cvmfs in Muse format. A jenkins build project is used to build prof and debug in parallel. If the build fails, the project will return an error. The output is tarballs that can then be installed on cvmfs.

  • go to jenkins mu2e-offline-build-muse project. (Requires an account and a cert in the browser.)
  • select "Build with Parameters", enter the tag string, and hit "Build". takes about 45 min.
  • When done, select "BUILDTYPE=prof"
  • if anything went wrong, select "last build" and look at the console output and the log file
  • under artifacts, right click on the tarball and "copy link address"
  • log onto the cvmfs machine, and start a transaction
  • cd to /cvmfs/mu2e.opensciencegrid.org/Musings/, wget the tarball, extract it (bzipped, use "-j")
  • remove tarball
  • repeat for the debug tarball
  • if needed, repoint the "Offline/current" link to this new tag
  • cd ~ and publish the transaction
  • once cvmfs is updated, test with
muse setup tag

The script that this project runs is in the codetools repo,

codetools/bin/jenkinsMuseBuild.sh

When the jenkins project is run, it checks out the head of codetools to find the script.

Publishing Production tags

Production contains most of the top-level fcl to use Offline, so is often updated and published at the same time as Offline. To "build" and publish a tag of Production with tag name tag, in a scratch area.

setup mu2e
setup muse
git clone https://github.com/Mu2e/Production
git -C Production checkout -b temp tag
muse setup
muse build
muse tarball -r Production/tag

You will get an output tarball. In a second window, in the same directory

setup mu2e
setup muse
muse setup -q debug
muse build
muse tarball -r Production/tag

You will get another tarball. Even though Production doesn't produce anything in the build area, it is necessary create the build directories so the setup command doesn't give warnings about "Production wasn't built with this setup". Muse doesn't have a concept of a repo that build with no output, yet.

Then on the cvmfs installation machine

  • log onto the cvmfs machine, and start a transaction
  • cd to /cvmfs/mu2e.opensciencegrid.org/Musings/, wget the tarball, extract it (bzipped, use "-j")
  • remove tarball
  • repeat for the debug tarball
  • if needed, repoint the "Production/current" link to this new tag
  • cd ~ and publish the transaction


Publishing ProdJob

ProdJob is a published Muse build area that contains both Offline and Production. It can serve as the basis for submitting production jobs. Currently, the plan is to publish Offline and Production as separate Musings, then make a ProdJob linking to these two. We expect that Production will be updated more frequently than Offline, and ProdJob allows for this case efficiently.

In a scratch area, assuming an Offline tag otag, a Production tag ptag and a targeted ProdJob tag tag,

setup mu2e
setup muse
muse link Offline otag
muse link Production ptag
muse setup
muse build
muse tarball -r Prodjob/tag

And, as described in previous sections, also setup, build, and tar a "debug" version in a second process. Upload the resulting tarballs to cvmfs Musings area.