Git Product home page Git Product logo

khrylx / rfc Goto Github PK

View Code? Open in Web Editor NEW
151.0 9.0 14.0 44.52 MB

[NeurIPS 2020] Official PyTorch Implementation of "Residual Force Control for Agile Human Behavior Imitation and Extended Motion Synthesis". NeurIPS 2020.

Home Page: https://www.ye-yuan.com/rfc

License: Other

Python 100.00%
residual-force-control humanoid-control deepmimic reinforcement-learning imitation-learning character-animation motion-synthesis pytorch imitation neurips-2020

rfc's Introduction

Ye Yuan's GitHub stats

rfc's People

Contributors

khrylx avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

rfc's Issues

Question on motion prediction - H3.6M

Dear author,

Many thanks for sharing code of this very nice work!
I am insterested in the experiment II Extended Motion Synthesis on H3.6M dataset.
Will you release the code related to this experiment?
Btw, in the readme, the first RFC GIF result, the humanoid model changed direction in Yaw a lot. Is this due to the reward function, which does not foucs on global orientation (qr)?

Thank you again for this very nice work~

Issue of multiprocessing when training

Hi,
Thanks for sharing this excellent work.
I met some problems when runing the training code about multiprocessing. The training code "python motion_imitation/motion_im.py --cfg 0506 --num_threads <max_num_CPU_threads_you_have>" works well when I only use one cpu core. But it stuck when I set the num_threads over 1(such as 2,4,12), the problem seems to be happened in "agent.py": "pod, worker_memory, worker_logger = queue.get()" when the ppo algorithm starts sampling.
The multiprocessing process seems work okay in the first sampling iteration, but the queue start to be empty in the second iteration and then the whole training process stuck.
image
I'm not familiar with gym and multiprocessing, do you know how to fix it?

Best Regards.

imitate the various human 3D poses from a live video

Many thanks for sharing code of the very interesting work!
I want to know if your work can imitate the various human 3D poses from a live video. i.e., let the robot to learn the actions of people in the video

Do I have to train a new model for each motion clip?

Thanks for your code!

I'm not very familiar with the filed of motion imitation. I thought that once a model is trained, it could mimic all the motion clips. But from your code, it seems like that a new model has to be trained for each motion clip.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.