Comments (1)
I'm not sure where the modified elog_submit.sh
script is, but when you submit does the job still run? Did it not occur until you made the script modification? I read this like an informative alert rather than a fatal error: something in your code uses NumExpr
(matrix calculations I imagine) which seems to enforce limits on thread usage based on environment variables, rather than solely on the number of available cores.
Practically this may mean you want to specify the environment variable as you change the number of requested cores so you can take advantage of the parallelism. You could try specifying the environment directly in the Python code (somewhere at the beginning, before the relevant functions/methods are called), to see if you can change the number of threads and the message disappears:
import os
os.environ["NUMEXPR_MAX_THREADS"] = 9# some number more than 8
You can put it in the shell script as well:
export NUMEXPR_MAX_THREADS=9 # for pipca
Please let me know if I'm missing something. If you can point to the specific code you've run it may be easier to figure out.
from btx.
Related Issues (20)
- Script to generate a default yaml HOT 4
- Simple interface for the config to generate small data files
- Job summary tasks
- `run_analysis` fails if mask is not provided
- Airflow integration on s3df HOT 1
- `TypeError` when an event does not have an ebeamPhotonEnergy value HOT 1
- rename `timetool_diagnostics`
- enhance and test `ih5` everywhere
- Fix airflow for psffb after confirmation of succesful s3df integration
- `retrieve_pixel_index_map` not working for pnCCD detector HOT 1
- Change logging level as a command line argument
- `indexer` reporting does not run when called with `mpirun` HOT 6
- Notes for running CrystFEL's `detector-shift`
- interactive visualization of masks in jupyter
- make `index` handle the case where no reflections were indexed. HOT 1
- ENH: add `ResoNet` task HOT 2
- ENH: add shot-per-shot total intensity option to `run_analysis` task HOT 1
- Analysis of PyFAI geometry optimization HOT 5
- ENH: create hdf5 files with total number of photons, event times, and fiducials
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from btx.