Git Product home page Git Product logo

Comments (7)

ewels avatar ewels commented on July 28, 2024 1

This sounds like the same "just rm -r ~/.aws" answer that we give on slack on a regular basis.

Are the CI tests configuring AWS access for anything else?

from modules.

jfy133 avatar jfy133 commented on July 28, 2024

Currently this is required for the module to test.

The actual error reported in that CI was:

    > ERROR ~ Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: XD54JYBDPDWDSX0E; S3 Extended Request ID: JmDS4i8VpQQTDw/5SrGhY7knZ3AJxsxKCfWID2bGjrMZrmvZn/3cZ/FjOIKuvwnBCJPOGxTfEao=; Proxy: null)

I'm wondering now if I copied the required taxdmp files to our bucket somewhere...

from modules.

jfy133 avatar jfy133 commented on July 28, 2024

Ok indeed I did:


   input[0] = [[], file("s3://ngi-igenomes/test-data/createtaxdb/taxonomy/megan-nucl-Feb2022.db.zip", checkIfExists: true)]

@nf-core/infrastructure can you think why reason why GHA can't access the igenomes bucket?

from modules.

bebosudo avatar bebosudo commented on July 28, 2024

That file seems to be openly available, both with aws cli

[alberto@fedora]$ podman run --rm -it docker.io/amazon/aws-cli s3 --no-sign-request cp s3://ngi-igenomes/test-data/createtaxdb/taxonomy/megan-nucl-Feb2022.db.zip /tmp

and as http https://ngi-igenomes.s3.amazonaws.com/test-data/createtaxdb/taxonomy/megan-nucl-Feb2022.db.zip

Note the --no-sign-request, otherwise you get a unable to locate credentials error, see this thread: aws/aws-cli#904

I don't know how you're retrieving that file though, if with something different than the aws cli, you may want to check the current role/user you're assuming, as that may have some restrictions that prevent it from reaching that bucket and object.

from modules.

jfy133 avatar jfy133 commented on July 28, 2024

Hrm, must be something nextflow side then...

from modules.

maxulysse avatar maxulysse commented on July 28, 2024

Not that I'm aware

from modules.

jfy133 avatar jfy133 commented on July 28, 2024

This sounds like the same "just rm -r ~/.aws" answer that we give on slack on a regular basis.

Are the CI tests configuring AWS access for anything else?

Ooff, ok. So we should add that as an upstream step of the actual test in the gha?

from modules.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.