Comments (8)
I thought it might be related to #35 too - just sent you the error log by email.
from q2-assembly.
QUAST is downloading some reference data in the background (which I realised only recently) so we need to make it possible to just provide those as input to the action itself (I haven't checked in detail whether that's possible or not but I certainly hope it is).
It is possible - we can provide those in fasta format.
from q2-assembly.
I know that this is redundant to what I posted on the forum, but responding for reference's sake. I can confirm that the alignment files are being stored in the tmp directory, and can confirm that that directory did run out of space on our cluster after ~500GB had been written to it.
from q2-assembly.
Hey @gregcaporaso, I suspect this is related to #35 - QUAST is downloading some reference data in the background (which I realised only recently) so we need to make it possible to just provide those as input to the action itself (I haven't checked in detail whether that's possible or not but I certainly hope it is). Please do send the log file over, if you have it - I can have a look just to confirm whether it's this problem or something else entirely. Thanks!
from q2-assembly.
Any updates? We ran into the same error today when using a tiny (4 sample) dataset.
from q2-assembly.
It doesn't look like the space issue is due to downloaded references, but rather inefficiency in storing alignment files. See this and this.
from q2-assembly.
Do you know whether you're running out space wherever the tmp
directory is located or somewhere else? I think these are two separate issues: those alignment files should be stored in tmp (as far as I can tell) so if you're good on space there, the issue is somewhere else...
from q2-assembly.
I have not seen this happen with any of our runs so I'm going to close it for now (since we don't really have any way to address it on our end anyway)
from q2-assembly.
Related Issues (20)
- BUG: `index-contigs` fails if any input files are empty HOT 4
- Cannot download some files from the `evaluate-contigs` qzv
- update help text for `assemble-spades --p-meta` HOT 3
- BUG: `assembly assemble-spades` auto-detection of phred-offset error
- BUG: index-contigs collects only .fa files
- BUG: action `generate-reads` is missing the `pysam` dependency HOT 3
- Update help text for `assemble-spades --p-threads --p-memory`
- BUG: Download buttons for the `assembly evaluate-contigs` visualization not producing PDFs, etc.. HOT 2
- BUG: `MultiMAGSequencesDirFmt` does not have a manifest in `index_mags`
- ENH: allow passing already aligned reads to `evaluate-quast`
- ENH: update `insilicoseq` to 1.6.0 HOT 2
- BUG: action `assemble-megahit` does not allow for `--p-num-cpu-threads > 1` HOT 3
- ENH: allow contig QC evaluation without drawing the Icarus plots
- BUG: download buttons in the QUAST viz are broken HOT 1
- ENH: evaluate-contigs action should output a results table to enable filtering of samples
- ENH: make contig IDs unique across all samples
- ENH: add action to rename contigs
- ENH: add an action to filter `SampleData[Contigs]` HOT 1
- ENH: filter contigs by length
- ENH: output fetched reference genomes from 'evaluate-quast'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from q2-assembly.