Git Product home page Git Product logo

Comments (7)

xinqingbuhao avatar xinqingbuhao commented on August 12, 2024 1

i solved the issue. The reason is why data is not prepared when GPU need to compute. Now i put the data and label into files, GPU can get data immediately when the training stage.
Although your code decouples data processing and training networks. But it caused serial training instead of parallelism, and the main expenses were placed on the cpu. It is possible when the amount of data is small, but it is extremely inefficient when the data is slightly larger.

from edsr-tensorflow.

jmiller656 avatar jmiller656 commented on August 12, 2024

Not sure what this means, I haven't experienced this error. Could you give me some steps to reproduce the error?

from edsr-tensorflow.

xinqingbuhao avatar xinqingbuhao commented on August 12, 2024

image
i got the same issue plus resource-exhausted.

from edsr-tensorflow.

xinqingbuhao avatar xinqingbuhao commented on August 12, 2024

Not sure what this means, I haven't experienced this error. Could you give me some steps to reproduce the error?

11%|███▍ | 1058/10000 [9:15:04<77:40:33, 31.27s/it]

Is this state normal with GPU ? I think this speed is a bit slow and GPU-Util is zero with 10000 img of 100*100, batchsize=32 ,32layer Net. thx~~

from edsr-tensorflow.

jmiller656 avatar jmiller656 commented on August 12, 2024

Hey there, I believe you are right that the timing you show is quite slow. I think there may be a problem with your cuda setup, unrelated to the code here. This would probably cause zero GPU utilization. Nothing in this project directly edits what is being used in the gpu. That is done behind the scenes by tensorflow

from edsr-tensorflow.

xinqingbuhao avatar xinqingbuhao commented on August 12, 2024

Hey there, I believe you are right that the timing you show is quite slow. I think there may be a problem with your cuda setup, unrelated to the code here. This would probably cause zero GPU utilization. Nothing in this project directly edits what is being used in the gpu. That is done behind the scenes by tensorflow

thx~~little brother ,hahah, Could u tell me your tensorflow-version , CUDA and cudnn version? (i use python2.7 env)

from edsr-tensorflow.

jmiller656 avatar jmiller656 commented on August 12, 2024

I see, good catch. Do you have code for this? If so, please make a PR and I'll review it

from edsr-tensorflow.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.