krlmlr / ulimit Goto Github PK
View Code? Open in Web Editor NEWLimit memory usage of R processes on POSIX systems | Obsolete, use this instead:
Home Page: https://github.com/jeroen/unix
ulimit's Issues
Provide Windows support
Expose other APIs
Request: Provide interface to query ulimit values
We're currently forking a system call to check what a specific ulimit is. This causes memory allocation issues since fork() makes a copy of the R memory.
If this package had a query interface to do this call we could avoid the fork.
More details: Mouse-Imaging-Centre/RMINC#257
Warn if limits could not be set
Provide support for parsing human-readable values
Return number of bytes with class "memory", print and format by S3 dispatch with the help of gdata::humanReadable. What to use for parsing?
don't limit GPU?
Hello,
When I run ulimit and tensorflow at the same time, then tensorflow is unable to allocate the RAM on the GPU. I get an error like this:
sess <- tf$Session()
2018-04-20 11:07:39.267514: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 11.11G (11924878080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-04-20 11:07:39.267547: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 10.00G (10732390400 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-04-20 11:07:39.267557: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 9.00G (9659151360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-04-20 11:07:39.267566: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 8.10G (8693235712 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-04-20 11:07:39.267574: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 7.29G (7823911936 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-04-20 11:07:39.267589: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 6.56G (7041520640 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-04-20 11:07:39.267598: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 5.90G (6337368576 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
I have 32gb RAM and that's what ulimit is to. The GPU has 12gb RAM.
Is there a way to use make this package restrict just the main CPU RAM, not the GPU?
Thank you.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.