Git Product home page Git Product logo

chainerrl's Introduction

ChainerRL

Build Status Coverage Status Documentation Status PyPI

ChainerRL is a deep reinforcement learning library that implements various state-of-the-art deep reinforcement algorithms in Python using Chainer, a flexible deep learning framework.

Breakout Humanoid

Installation

ChainerRL is tested with Python 2.7+ and 3.5.1+. For other requirements, see requirements.txt.

ChainerRL can be installed via PyPI:

pip install chainerrl

It can also be installed from the source code:

python setup.py install

Refer to Installation for more information on installation.

Getting started

You can try ChainerRL Quickstart Guide first, or check the examples ready for Atari 2600 and Open AI Gym.

For more information, you can refer to ChainerRL's documentation.

Algorithms

Algorithm Discrete Action Continous Action Recurrent Model CPU Async Training
DQN (including DoubleDQN etc.) ✓ (NAF) x
Categorical DQN x x
DDPG x x
A3C
ACER
NSQ (N-step Q-learning) ✓ (NAF)
PCL (Path Consistency Learning)
PPO x x
TRPO x x

Following algorithms have been implemented in ChainerRL:

  • A3C (Asynchronous Advantage Actor-Critic)
  • ACER (Actor-Critic with Experience Replay)
  • Asynchronous N-step Q-learning
  • Categorical DQN
  • DQN (including Double DQN, Persistent Advantage Learning (PAL), Double PAL, Dynamic Policy Programming (DPP))
  • DDPG (Deep Deterministic Poilcy Gradients) (including SVG(0))
  • PGT (Policy Gradient Theorem)
  • PCL (Path Consistency Learning)
  • PPO (Proximal Policy Optimization)
  • TRPO (Trust Region Policy Optimization)

Q-function based algorithms such as DQN can utilize a Normalized Advantage Function (NAF) to tackle continuous-action problems as well as DQN-like discrete output networks.

Environments

Environments that support the subset of OpenAI Gym's interface (reset and step methods) can be used.

Contributing

Any kind of contribution to ChainerRL would be highly appreciated! If you are interested in contributing to ChainerRL, please read CONTRIBUTING.md.

License

MIT License.

chainerrl's People

Contributors

muupan avatar toslunar avatar kiyukuta avatar corochann avatar uidilr avatar seann999 avatar lyx-x avatar katrinleinweber avatar delta2323 avatar okuta avatar knorth55 avatar mitmul avatar iory avatar kuni-kuni avatar mr4msm avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.