Comments (6)
@davidlange6 @slava77 I was hoping either of you might be able to provide meaningful comments on the numbers provided about processing requirements.
from resource-modeling.
It's a question to Tom (I think he entered the numbers based on my inputs).
@tommasoboccali
from resource-modeling.
from resource-modeling.
ok, now I see it - btw interesting, can we discuss at some point what is this python ;)
We used these numbers from
- RECO only: ttbar reco from Slava. Assuming (which we believe is ~ true) his machine has 10 HS06 per core, we ended up in 20 sec per ev + some 10% (going to 25 sec/ev = 250 HS06s/ev)
- DR: the D part (which gives a +10 sec) can even be too low ... I think I saw a table by Slava at some point
AH, ok: here https://indico.cern.ch/event/624140/contributions/2533493/attachments/1438070/2212438/reco_2017_OnC_040317.pdf
it says D is 16, so more than 10.
The numbers in the presentation (page 10), would give on
- reco (which hs to include miniaod time) = 18.5 sec (I think for real reco the +10% missing is about alca but not sure i remember)
- D+R = 34.5 sec
so in this last release (4 months after the estimates which entered the doc), reco is probably a bit too high, DR seems ~ ok
tom
from resource-modeling.
Hey, it's becoming a party around here! What is this python? I keep telling people it's an expression of my midlife crisis (but I'm kidding).
So the bit of code (currently in cpu.py, but we'll get it into a JSON file I'm sure) that currently is
data_reco_time_lhc = 250 #this is per HS
mc_gensim_time_lhc = 500 #this is per HS
mc_digi_time_lhc = 100 #this is per HS
should really be more like
data_reco_time_lhc = 185 #this is per HS
mc_gensim_time_lhc = 500 #this is per HS
mc_digi_time_lhc = 160 #this is per HS
My main concern is that I have got the current reconstruction and the HL-LHC expectations in the same units...there is that factor of 10 for Slava's computer that I keep worrying that I'm not counting or double counting or whatever.
from resource-modeling.
from resource-modeling.
Related Issues (15)
- Move parameters into JSON HOT 3
- Add GEN-SIM to disk model HOT 1
- Add RAW to disk/tape model
- Update disk.py and JSON to allow for data tier sizes to change as a function of year
- Change model during shutdown to not get rid of data from last shutdown year
- Add MC production during shutdown to the model HOT 1
- Add re-reco passes to storage model
- Add ops space.
- Add a USER tier at 50% of the microAOD tier
- Pretty model output HOT 2
- Make configure accept a list of configuration files
- Missing items in CPU model
- Clean up code after DOE submission
- Better histogramming tools HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from resource-modeling.