cms-sw / cms-docker Goto Github PK
View Code? Open in Web Editor NEWDocker files for various cms services and tasks
Docker files for various cms services and tasks
type el9, aarch64-43aad39a0e,x86_64-f0ed0821da
Once this issue is closed, I will start the build of the new image.
Please let me know if I should post this issue somewhere else.
For an upcoming open data release, I'm trying to install CMSSW_4_2_8_lowpupatch1 into an SLC5 container, but the bootstrap script (or actually cmspkg.py
with cmspkg_tag = "V00-00-37"
) fails. Any idea how to solve it? I don't know why the package size returns an invalid literal (see below).
export SCRAM_ARCH=slc5_amd64_gcc434
sh /opt/cms/bootstrap.sh setup -r cms -architecture ${SCRAM_ARCH} -server cmsrep.cern.ch
slc5_amd64
Output:
Downloading driver file slc5_amd64_gcc434...Done driver slc5_amd64_gcc434.
Downloading driver file slc5_amd64_common ...Downloading driver file common_amd64_common ...Downloading bootstrap core packages...
Reading Package Lists...
Get:1 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+gcc+4.3.4-cms-1-1.slc5_amd64_gcc434.rpm
Get:2 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+expat+2.0.0-cms2-1-1.slc5_amd64_gcc434.rpm
Get:3 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+zlib+1.2.3-cms-1-1.slc5_amd64_gcc434.rpm
Get:4 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+beecrypt+4.1.2-cms2-1-1.slc5_amd64_gcc434.rpm
Get:5 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+bz2lib+1.0.5-cms-1-1.slc5_amd64_gcc434.rpm
Get:6 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+db4+4.4.20-cms-1-1.slc5_amd64_gcc434.rpm
Get:7 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+elfutils+0.131-cms-1-1.slc5_amd64_gcc434.rpm
Get:8 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+neon+0.26.3-cms2-1-1.slc5_amd64_gcc434.rpm
Get:9 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+openssl+0.9.8e-cms4-1-1.slc5_amd64_gcc434.rpm
Get:10 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+libxml2+2.6.23-cms2-1-1.slc5_amd64_gcc434.rpm
Get:11 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+rpm+4.4.2.2-cms3-1-1.slc5_amd64_gcc434.rpm
Get:12 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 external+apt+0.5.15lorg3.2-cms3-1-1.slc5_amd64_gcc434.rpm
Done.
Unpacking core packages...593260 blocks
593260 blocks
4691 blocks
4691 blocks
360 blocks
360 blocks
1318 blocks
1318 blocks
Can't open /opt/cms/bootstraptmp/BOOTSTRAP/inst/slc5_amd64_gcc434/external/beecrypt/4.1.2-cms2/lib/libbeecrypt.la: No such file or directory.
2340 blocks
2340 blocks
44015 blocks
44015 blocks
5887 blocks
5887 blocks
2848 blocks
2848 blocks
46793 blocks
46793 blocks
35411 blocks
35411 blocks
21602 blocks
21602 blocks
49589 blocks
49589 blocks
Done.
Harvesting system for locally available software...Done.
Initializing local rpm database.../opt/cms/slc5_amd64_gcc434/tmp/system-import /opt/cms
/opt/cms
Done.
Installing packages in the local rpm database...Can't open /opt/cms/slc5_amd64_gcc434/external/beecrypt/4.1.2-cms2/lib/libbeecrypt.la: No such file or directory.
Done
cmspkg setup done.
Installing default packages.Reading Package Lists...
Get:1 http://cmsrep.cern.ch cmssw/cms/slc5_amd64_gcc434 cms+cms-common+1.0-1-1107.slc5_amd64_gcc434.rpm
Building Dependency Tree...
The following NEW packages will be installed:
cms+cms-common+1.0
0 upgraded, 1 newly installed, 0 removed and 0 not upgraded.
Traceback (most recent call last):
File "/opt/cms/share/cms/cmspkg/V00-00-37/cmspkg.py", line 1207, in ?
process(args, opts, cache_dir)
File "/opt/cms/share/cms/cmspkg/V00-00-37/cmspkg.py", line 1088, in process
repo.install(pkg, reinstall=opts.reinstall, force=opts.force)
File "/opt/cms/share/cms/cmspkg/V00-00-37/cmspkg.py", line 675, in install
size_compress, size_uncompress = self.package_size (pk[1])
File "/opt/cms/share/cms/cmspkg/V00-00-37/cmspkg.py", line 514, in package_size
return st.st_size, int(out)
ValueError: invalid literal for int():
There was a problem while installing the default packages
Done
Bootstrap environment to be found in:
### /opt/cms/slc5_amd64_gcc434/external/apt/0.5.15lorg3.2-cms3/etc/profile.d/init.sh
/opt/cms/bootstrap.sh: line 1835: cd: /opt/cms/bootstraptmp/BOOTSTRAP: No such file or directory
Image rebuild will be triggered once this issue is closed
type cs9, aarch64-f1ec72adbf,x86_64-9b1213e777
Once this issue is closed, I will start the build of the new image.
Image rebuild will be triggered once this issue is closed
type cs9, aarch64-d59cf70abc,x86_64-711657d29f
Once this issue is closed, I will start the build of the new image.
type cs9, aarch64-19faf384b0,x86_64-0e3dd04224
Once this issue is closed, I will start the build of the new image.
type el9,
type cs9, aarch64-e80b3a39b0,x86_64-4311292258
Once this issue is closed, I will start the build of the new image.
type cs9, aarch64-fe8ea60112,x86_64-312a494238
Once this issue is closed, I will start the build of the new image.
type alma8, aarch64-57c0134253,ppc64le-6a15583daa,x86_64-931364daab
Once this issue is closed, I will start the build of the new image.
type cs9, aarch64-aadd3ac87e,x86_64-988f98c017
Once this issue is closed, I will start the build of the new image.
type cs9, aarch64-45335d0e0a,x86_64-5bfc78f1f7
Once this issue is closed, I will start the build of the new image.
Once this issue is closed, I will start the build of the new image.
[current] 4.0.21-23.el8 --> [new] 4.0.21-23.el8.alma.1
Docker hub has changed the "Free Team" for organizations. Now they only allow 1 team of max 3 members. Currently we have 3 teams with more than 3 members each (specially dmwm
team has 12 members). For now dockerhub has not asked us to cleanup these team but I guess in future they might. Currently we can not add any more teams or members to any of our teams ( we already have 16 seats fill out of 3).
For cms images we are using cmsblddoc
, I would suggest that for dmwm
you can also start using dmwmbot
instead of individual accounts.
FYI @muhammadimranfarooqi @yuyiguo @ericvaandering @bbockelm @vkuznet @fabioespinosa @ddaina @Panos512 @goughes @amaltaro @todorivanov
type cs9, aarch64-9d43dcc58c,x86_64-f31935f5a6
Once this issue is closed, I will start the build of the new image.
type el8,aarch64-ccfb38b47c,ppc64le-7f45ae1478,x86_64-da502e3b8e
Once this issue is closed, I will start the build of the new image.
type cs9,aarch64-a2bc7a24d5,x86_64-b4e0f7a7b4
Once this issue is closed, I will start the build of the new image.
type el9,aarch64-264e8aadc9,x86_64-2b5b7a9bff
I checked on one of the slc-install images and this reduces the intermediate image by about 130 MB by not storing the downloaded RPM files in some image
type cs9, aarch64-d12735c2c1,x86_64-d696794169
Once this issue is closed, I will start the build of the new image.
type cs9, aarch64-dbbf494708,x86_64-4986ad2634
Once this issue is closed, I will start the build of the new image.
type alma8,aarch64-ccfb38b47c,ppc64le-7f45ae1478,x86_64-da502e3b8e
Once this issue is closed, I will start the build of the new image.
type cs9, aarch64-06b3ad7a9b,x86_64-882e6b1a7e
Once this issue is closed, I will start the build of the new image.
There is boot2docker for Mac and Windows.
Unfortunately I was not successful with the recipe from here because of a 503
from cmsdocker.cern.ch
.
type cs9, aarch64-7850f8c088,x86_64-f65acc4484
Once this issue is closed, I will start the build of the new image.
@aandvalenzuela , one next update of el8/el9 containers please add tmux
too. It is a small package [a] so should not increase the container size too much.
[a]
Installing:
tmux x86_64 2.7-3.el8 baseos 315 k
Installing dependencies:
libevent x86_64 2.1.8-5.el8 baseos 253 k
[current] 4.0.21-23.el8 --> [new] 4.0.21-23.el8.alma.1
type el9, aarch64-0537e1aba3,x86_64-47385e9134
Once this issue is closed, I will start the build of the new image.
type rocky8,aarch64-be879ad24f,x86_64-69cecc7163
Once this issue is closed, I will start the build of the new image.
type cs9, aarch64-4b5025eef9,x86_64-0e06102782
Once this issue is closed, I will start the build of the new image.
Image rebuild will be triggered once this issue is closed
type cs9, aarch64-1964d9dc04,x86_64-0e4c909afa
Once this issue is closed, I will start the build of the new image.
Image rebuild will be triggered once this issue is closed
There are outdated apptainer versions in several current CMS containers:
These need to be updated to 1.2.5-1, which includes the resolution to apptainer/apptainer#1779.
(I'm not sure what action needs to be taken for this update - maybe just triggering a new build of the containers? The apptainer version doesn't seem to be pinned anywhere in this repository, as far as I can tell.)
type cs9, aarch64-4d5f94b8c3,x86_64-699e995cc8
Once this issue is closed, I will start the build of the new image.
The README links to https://github.com/cms-sw/cms-docker/blob/master/jenkins, which no longer exists in the repo. It also refers to *EXECUTE_BUILD.sh
files, but there are very few of these in the repo. These parts should be removed or updated for the latest practices.
[current] 1.8.0-1.el8 --> [new] 1.8.1-1.el8
@aandvalenzuela , can you please update el8/el9 containers (latest) to have squid
package installed.
FYI @fwyzard
type el8, aarch64-57c0134253,ppc64le-6a15583daa,x86_64-931364daab
Once this issue is closed, I will start the build of the new image.
type cs9,aarch64-28b614bd0b,x86_64-42984441e3
Once this issue is closed, I will start the build of the new image.
type ubi8, aarch64-f1370ea020,ppc64le-abc584e8d4,x86_64-4a6dbfbb84
Once this issue is closed, I will start the build of the new image.
When I run these commands:
cmssw-el8
source /cvmfs/cms.cern.ch/cmsset_default.sh
cmsenv
I get the following warning:
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "en_US.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
This does not happen in e.g. the cc7 image, so something is probably missing from the el8 image.
type el8,aarch64-ccfb38b47c,ppc64le-7f45ae1478,x86_64-da502e3b8e
type cs9, aarch64-75b0306feb,x86_64-5005be3da5
Once this issue is closed, I will start the build of the new image.
Docker does not free up space from deleted files. The ~5GB of rpms downloaded for a release are still counted in the image space usage even after removal. I was able to create a much smaller image this way:
docker run -it -v /tmp:/build ...
Setup as usual in /opt/cms
mv /opt/cms/slc7_amd64_gcc700/var/cmspkg /build
ln -s /opt/cms/slc7_amd64_gcc700/var /build/cmspkg
Run cmspkg install as usual.
After install
rm /opt/cms/slc7_amd64_gcc700/var/cmspkg
cp -rpv /build/cmspkg /opt/cms/slc7_amd64_gcc700/var
Image rebuild will be triggered once this issue is closed
type cs9, aarch64-e0be580eaa,x86_64-bd8a322cad
Once this issue is closed, I will start the build of the new image.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.