Git Product home page Git Product logo

Comments (3)

zhyang2226 avatar zhyang2226 commented on June 16, 2024 2

Actually, such timestep embedding method comes from Transformer (Attention is All You Need) and has been widely utilized in diffusion models and Transformer-like network structures. If the scaler timestep is used as input of the network, compared with other high-dimensional inputs, the final output will be difficult to heavily depend on it, which is not what we want. Therefore, encoding the scaler timestep to a vector that has a similar dimension as other inputs can solve this problem.

from fisor.

ZhaoRunyi avatar ZhaoRunyi commented on June 16, 2024 1

Thanks for your reply! I may check out later about the relation between fourier features and generalization, see if there are any literature furthur explain it. I would share my findings as soon as I finished the research.

Best regards!

from fisor.

Facebear-ljx avatar Facebear-ljx commented on June 16, 2024

Hi!
Thanks for your interests on our work. This is a good question and we did not investigate this in-depth. Actually, this is a common choice in many popular diffusion policies like IDQL, Decision Diffuser, et al and also many diffusion models for image generation. So, we directly followed this impementation.

From a quick search, I found the fourier feature can improve generalization ability for unseen times, and help the neural network to extract high-frequency features from the scalar time variable, and enjoys other good properties. We would also very happy to hear from your further findings on the advantages of fourier features.

from fisor.

Related Issues (2)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.