Git Product home page Git Product logo

Comments (12)

nellh avatar nellh commented on August 20, 2024

@chrisfilo I think this is fixed by the disk changes (maybe the move to Overlay2). Please reopen if you're still running into it.

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

I recently stumbled upon this again: https://openneuro.org/datasets/ds000110/versions/00001?app=FreeSurfer&version=26&job=79e6d717-ab91-4590-bb17-63f5d574d445

from openneuro.

nellh avatar nellh commented on August 20, 2024

Does this occur randomly? If you retry the job it sometimes succeeds?

Since the file is missing in the results and symlinks are dereferenced when it's copied out, I think it's actually missing when it reaches this part of the app.

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

I'm seeing more of such and other similar error in this job https://openneuro.org/datasets/ds001043/versions/00001?app=FreeSurfer&version=27&job=5a2aec58fce2fd0001047fc3

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

I'm getting similar looking error when running freesurfer as part of FMRIPREP:

Loading label /output/data/freesurfer/fsaverage5/label/rh.cortex.label
Standard error:
No such file or directory
mri_vol2surf: could not open label file /output/data/freesurfer/fsaverage5/label/rh.cortex.label
Invalid argument
mri_vol2surf: could not load label file /output/data/freesurfer/fsaverage5/label/rh.cortex.label
Invalid argument
Return code: 255

https://openneuro.org/datasets/ds001076/versions/00001?app=FMRIPREP&version=45&job=7090f9ff-30e9-41ed-968d-e540e5cd03f2 (Subject control07)

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

I rerun the previously failing job at https://openneuro.org/datasets/ds001043/versions/00001?app=FreeSurfer&version=27&job=5a2aec58fce2fd0001047fc3 and it hit the same snag.

This might be a good datasets to test potential solutions.

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

I tried with 30Gb instances and this is still failing (on ds001043): https://openneuro.org/datasets/ds001043/versions/00001?app=FreeSurfer&version=28&job=5a5f7a7324c4760001b50c89

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

I'm begging to think that this might have something to do with the fact that this error happens on datasets with more than one session. Investigating.

from openneuro.

chrisgorgo avatar chrisgorgo commented on August 20, 2024

It fails even if only one session is selected: https://openneuro.org/datasets/ds001043/versions/00001?app=FreeSurfer&version=30&job=5a600929bcef5e0001c394a1

from openneuro.

nellh avatar nellh commented on August 20, 2024

Noticed that production is still using an out of date host container and it looks like this is because the dockerhub build did not complete. This is fixed now.

I'm running some more tests to see if I can get this to fail outside of ECS as that will make it easier to pause a container and look at what might have failed.

from openneuro.

jbwexler avatar jbwexler commented on August 20, 2024

I'm experiencing this error when running freesurfer on ds000201: https://openneuro.org/datasets/ds000201/versions/00004

Are there any workarounds?

from openneuro.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.