Comments (7)
This sounds like the same "just rm -r ~/.aws
" answer that we give on slack on a regular basis.
Are the CI tests configuring AWS access for anything else?
from modules.
Currently this is required for the module to test.
The actual error reported in that CI was:
> ERROR ~ Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: XD54JYBDPDWDSX0E; S3 Extended Request ID: JmDS4i8VpQQTDw/5SrGhY7knZ3AJxsxKCfWID2bGjrMZrmvZn/3cZ/FjOIKuvwnBCJPOGxTfEao=; Proxy: null)
I'm wondering now if I copied the required taxdmp files to our bucket somewhere...
from modules.
Ok indeed I did:
input[0] = [[], file("s3://ngi-igenomes/test-data/createtaxdb/taxonomy/megan-nucl-Feb2022.db.zip", checkIfExists: true)]
@nf-core/infrastructure can you think why reason why GHA can't access the igenomes bucket?
from modules.
That file seems to be openly available, both with aws cli
[alberto@fedora]$ podman run --rm -it docker.io/amazon/aws-cli s3 --no-sign-request cp s3://ngi-igenomes/test-data/createtaxdb/taxonomy/megan-nucl-Feb2022.db.zip /tmp
and as http https://ngi-igenomes.s3.amazonaws.com/test-data/createtaxdb/taxonomy/megan-nucl-Feb2022.db.zip
Note the --no-sign-request
, otherwise you get a unable to locate credentials
error, see this thread: aws/aws-cli#904
I don't know how you're retrieving that file though, if with something different than the aws cli, you may want to check the current role/user you're assuming, as that may have some restrictions that prevent it from reaching that bucket and object.
from modules.
Hrm, must be something nextflow side then...
from modules.
Not that I'm aware
from modules.
This sounds like the same "just
rm -r ~/.aws
" answer that we give on slack on a regular basis.Are the CI tests configuring AWS access for anything else?
Ooff, ok. So we should add that as an upstream step of the actual test in the gha?
from modules.
Related Issues (20)
- Investigate issue extracting minigut_cf.tar.gz for centrifuge
- Investigate issue extracting data.tar.gz for rgi related modules HOT 1
- Investigate unknown issue for checkv/updatedatabase module
- new module: pypgx/createinputvcf
- new module: pypgx/preparedepthofcoverage
- new module: pypgx/computecontrolstatistics
- new module: pypgx/runngspipeline
- Remove tags.yml files if we are sure we no longer need them HOT 1
- new module: MSISENSORPRO/MSISENSORPRO_SOMATIC_TUMORONLY
- Investigate why `subworkflows/nf-core/fastq_align_hisat2` tests were not triggered
- snpeff security issue HOT 3
- [FEATURE] add stub and tests to lofreq/filter
- new module: SENTIEON/QUALCAL
- Standardized channel output for different files HOT 1
- new module: DIAMOND/CLUSTER
- new module: REPEATMASKER HOT 2
- new module: BRAKER3 HOT 1
- update module: FCS/FCSGX
- Minor bug: krakentools/combinekreports incorrect description
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from modules.