This is a project for Deecamp 2019 which cooperated with APEX Lib of Shanghai Jiaotong University and Tianrang Intelligence Company

DQN

DDQN

DuelingDQN

RayDQN

PPO

DDPG

TD3

SAC

IMPALA

A3C

APPO

Ape-X

QMIX

VDN

Gamma-Reward

PressLight

This project is based on CityFlow which is a multi-agent reinforcement learning environment for large scale city traffic scenario, the algorithms are bases on Ray which is a fast and simple framework for building and running distributed applications.

This guide is based on Ubuntu 16.04.

CityFlow has little dependencies, so building from source is not scary.

1. Check that you have python 3.6 installed. Other version of python might work, however, we only tested on python with version >= 3.6.
2. Install cpp dependencies

apt update && apt-get install -y build-essential libboost-all-dev cmake

3. Clone CityFlow project from github.

git clone --recursive https://github.com/cityflow-project/CityFlow.git

Notice that CityFlow uses pybind11 to integrate C++ code with python, the repo has pybind11 as a submodule, please use --recursive to clone all codes.

4. Go to CityFlow project’s root directory and run

pip install .

5. Wait for installation to complete and CityFlow should be successfully installed.

import cityflow
eng = cityflow.Engine

pip install -i https://pypi.tuna.tsinghua.edu.cn/simple -U ray  # also recommended: ray[debug]

git clone https://github.com/openai/gym
cd gym
pip install -e .