Comments (5)
How much memory do you have available? The only time we've seen no printed exception error is when docker decides to end the process due to lack of memory.
from too-many-cells.
How much memory do you have available? The only time we've seen no printed exception error is when docker decides to end the process due to lack of memory.
I give it 14GB mem yet still failed.
The entire mem I hava is 16GB and I am using latest macos with docker-desktop.
Though I have to admit that the data was provided as a single .csv file and the quality was not that good, should I try to use cellranger-like data (3 files in a dir I mean. This can compress the data size)?
And I run into almost the same problem when I use vitual machine(ubuntu 18.04 server) instead of docker. I SUCCESSFULLY use too-many-cells to analizy part of my data (3 clusters picked). But when I use the entire data, it still said "unable to commit 10737418240". So I guess maybe we can't avoid the mem problem even in an actual machine rather than docker or vms.
from too-many-cells.
The matrix implementation is memory hungry, so if you find that it ends after using all of the available memory, then that is the reason for the crash. If you are on a 16GB machine then I would use feature selection / filter out unneeded cells beforehand.
from too-many-cells.
The matrix implementation is memory hungry, so if you find that it ends after using all of the available memory, then that is the reason for the crash. If you are on a 16GB machine then I would use feature selection / filter out unneeded cells beforehand.
Yeah, I guess so. Maybe I should do some test to decide how many cells I should leave.
However, thanks again for this tool and your patience, I used it and indeeed got some nice results, guess the tool will become more attractive if we can get a optimized version later.
:)
from too-many-cells.
You can also use dimensionality reduction to limit the size of the matrix.
from too-many-cells.
Related Issues (20)
- parse error (not enough input) HOT 3
- Error in installing with docker HOT 2
- kent-394 not supported HOT 9
- Running a million cells failed in the docker HOT 2
- Purity section in too-many-cells HOT 4
- error, called at src/Data/Sparse/SpMatrix.hs:793:22 in sparse-linear-algebra-0.3.2-LJ5QWDyWqk8g1L9MLmVBX:Data.Sparse.SpMatrix HOT 5
- comparative analysis of clustering performance HOT 2
- comparative analysis of clustering performance #37 HOT 3
- can't install the included projects HOT 13
- Error when installing with nix on CentOS 7 HOT 4
- Strange warnings occurred during the procedure HOT 3
- A problem for batch effect removed data HOT 11
- fail when downloading ucsc browser HOT 2
- The pipeline crashed with error message HOT 3
- Index out of bounds for TooManyPeaks HOT 7
- Prune parameters setting question HOT 1
- Question: Does well separated color in the dendrogram mean that the items are distinct? HOT 1
- Seurat SCtransform HOT 1
- Installation fails with nix-env ('__noChroot' set, but that's not allowed when 'sandbox' is 'true') HOT 7
- How to modify the colors of the PieChart HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from too-many-cells.