Git Product home page Git Product logo

Comments (4)

jonasrauber avatar jonasrauber commented on May 31, 2024

Could you be a bit more specific what you mean?
Support in which way?
How would that make sense in combination with PyTorch, TensorFlow, JAX?

from eagerpy.

machineko avatar machineko commented on May 31, 2024

Using cuda_array_interface torch, cupy and jax are working with numba on cuda.jit nativly u just pass torch.cuda or jax.cuda tensor to them.

TF didn't have that but have https://www.tensorflow.org/api_docs/python/tf/experimental/dlpack/from_dlpack so u can add it pretty easy

from eagerpy.

jonasrauber avatar jonasrauber commented on May 31, 2024

Oh, now I understand what you mean. Yes, I am aware of dlpack and cuda_array_interface and they are both very interesting. Right now there is no need for them in EagerPy, because they are for exchanging tensors between different frameworks and EagerPy is rather about writing code that works with each framework (but that doesn't combine different frameworks).
If there is a good use case, it might be worth considering how we can add this explicitly. In a way it's already possible to use, because EagerPy tensors are really just wrapped tensors from the individual frameworks.

If your question is specifically about whether you can use EagerPy tensors with numba, then I guess the answer is the same: EagerPy tensors are really just wrapped tensors and you can at any time get the raw tensor and then its cuda_array_interface.

If you are asking for something else, please provide a specific example of code that you would want to be supported.

from eagerpy.

machineko avatar machineko commented on May 31, 2024

Dunno what OP wants from cuda.jit but its pretty neat function to have working python cuda code with gpu arrays, u can convert almost any function write to work on cpu to gpu without any overhead specialy good for some sort of search for big arrays (for example glowtts).
You don't need to add custom interface probably just add dlpack handler to tf tensor will be enough.

from eagerpy.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.