Git Product home page Git Product logo

Comments (6)

lczech avatar lczech commented on July 30, 2024

Hey @wangshuangyi,

it seems that you first created the grenepipe environment with conda, and are now installing mamba from within that environment? That indeed could be slow - it's faster to install mamba first, just as a normal step in conda withing any grenepipe, and then create the grenepipe environment from there, as documented here. That should work faster.

As for naming the environments: That is not something that snakemake uses. If you create all the individual tool environments manually, snakemake won't know about it, and won't use them, so that would not help you. Instead, get mamba to work as documented, install and activate the grenepipe environment from there, and let snakemake take care of the rest ;-)

Hope that helps, so long
Lucas

from grenepipe.

wangshuangyi avatar wangshuangyi commented on July 30, 2024

Thank you very much for your reply. I have solved the problem of mamba, but as shown below, this command is often interrupted due to my network environment, may I ask whether I can re-run this command after the interruption? Also, I notice that when I run snakemake --use-conda --conda-frontend mamba --cores 4 --directory example/, each yaml will generate a different file after completion under path/grenepipe-0.12.2/example/.snakemake/conda/. If I execute a different project, do I need to run $snakemake --use-conda --conda-frontend mamba --cores 4 --directory xxx/?

from grenepipe.

lczech avatar lczech commented on July 30, 2024

Hi @wangshuangyi,

Thank you very much for your reply. I have solved the problem of mamba,

Very good!

but as shown below, this command is often interrupted due to my network environment, may I ask whether I can re-run this command after the interruption?

That is a more general conda/mamba question. If any install step fails, you might need to delete the env first again before re-trying (conda env remove --name env_name), but I'd talk with your network administrator to fix your network instead.

Also, I notice that when I run snakemake --use-conda --conda-frontend mamba --cores 4 --directory example/, each yaml will generate a different file after completion under path/grenepipe-0.12.2/example/.snakemake/conda/.

Yes, for some reason, snakemake always installs the environments locally in the directory where you run your analysis (the one specified via --directory). This is of course time- and space-consuming and unnecessary, and so you can use this trick to instead re-use the environments once you have them installed.

If I execute a different project, do I need to run $snakemake --use-conda --conda-frontend mamba --cores 4 --directory xxx/?

Yes, see here and here.

I'd recommend to read the whole wiki. That might answer most of your questions. If not, let me know.

Cheers
Lucas

from grenepipe.

lczech avatar lczech commented on July 30, 2024

Dear @wangshuangyi,

any update on this, or can be close the issue?

Cheers
Lucas

from grenepipe.

lczech avatar lczech commented on July 30, 2024

Closing the issue now, but feel free to re-open if this is still and issue.

from grenepipe.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.