Comments (6)
Hey @wangshuangyi,
it seems that you first created the grenepipe
environment with conda, and are now installing mamba from within that environment? That indeed could be slow - it's faster to install mamba first, just as a normal step in conda withing any grenepipe, and then create the grenepipe
environment from there, as documented here. That should work faster.
As for naming the environments: That is not something that snakemake uses. If you create all the individual tool environments manually, snakemake won't know about it, and won't use them, so that would not help you. Instead, get mamba to work as documented, install and activate the grenepipe
environment from there, and let snakemake take care of the rest ;-)
Hope that helps, so long
Lucas
from grenepipe.
Thank you very much for your reply. I have solved the problem of mamba, but as shown below, this command is often interrupted due to my network environment, may I ask whether I can re-run this command after the interruption? Also, I notice that when I run snakemake --use-conda --conda-frontend mamba --cores 4 --directory example/, each yaml will generate a different file after completion under path/grenepipe-0.12.2/example/.snakemake/conda/. If I execute a different project, do I need to run $snakemake --use-conda --conda-frontend mamba --cores 4 --directory xxx/?
from grenepipe.
Hi @wangshuangyi,
Thank you very much for your reply. I have solved the problem of mamba,
Very good!
but as shown below, this command is often interrupted due to my network environment, may I ask whether I can re-run this command after the interruption?
That is a more general conda/mamba question. If any install step fails, you might need to delete the env first again before re-trying (conda env remove --name env_name
), but I'd talk with your network administrator to fix your network instead.
Also, I notice that when I run snakemake --use-conda --conda-frontend mamba --cores 4 --directory example/, each yaml will generate a different file after completion under path/grenepipe-0.12.2/example/.snakemake/conda/.
Yes, for some reason, snakemake always installs the environments locally in the directory where you run your analysis (the one specified via --directory
). This is of course time- and space-consuming and unnecessary, and so you can use this trick to instead re-use the environments once you have them installed.
If I execute a different project, do I need to run $snakemake --use-conda --conda-frontend mamba --cores 4 --directory xxx/?
I'd recommend to read the whole wiki. That might answer most of your questions. If not, let me know.
Cheers
Lucas
from grenepipe.
Dear @wangshuangyi,
any update on this, or can be close the issue?
Cheers
Lucas
from grenepipe.
Closing the issue now, but feel free to re-open if this is still and issue.
from grenepipe.
Related Issues (20)
- bwa-mem2 "{tmp}.0000.bam": File exists HOT 5
- threads for bwa-mem2 via slurm HOT 2
- Error running toy example HOT 6
- MissingRuleException HOT 13
- PID error HOT 9
- java.lang.OutOfMemoryError: Java heap space HOT 2
- GRENEPIPE v12.1 HOT 5
- Make "trimming-tool" optional HOT 4
- restrict-regions and short contigs HOT 2
- ModuleNotFoundError: No module named 'chardet' HOT 2
- Write full executed command for each step to log files for reproducibility HOT 3
- merging calls from multiple pipeline runs? HOT 2
- Feature Request: Download reference genome and known variation HOT 2
- config file HOT 5
- greenepipe run error HOT 5
- problem with dedup HOT 4
- a new type of error HOT 2
- a new type of error HOT 1
- another type of error HOT 11
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from grenepipe.