Git Product home page Git Product logo

zongyan / rl_multi_agent_passage Goto Github PK

View Code? Open in Web Editor NEW

This project forked from proroklab/rl_multi_agent_passage

0.0 0.0 0.0 1.45 MB

Repository containing RL environment, model and trainer for GNN demo for ICRA 2022 paper "A Framework for Real-World Multi-Robot Systems\\Running Decentralized GNN-Based Policies"

License: GNU General Public License v3.0

Shell 0.42% Python 97.11% Dockerfile 2.47%

rl_multi_agent_passage's Introduction

Multi-Agent RL passage formation for ICRA 2022

Repository containing the code base for training the multi-agent coordination policy used in the paper "A Framework for Real-World Multi-Robot Systems Running Decentralized GNN-Based Policies".

Supplementary video material:

Video preview

Citation

If you use any part of this code in your research, please cite our paper:

@inproceedings{blumenkamp2022decentralizedgnn,
  title={A Framework for Real-World Multi-Robot Systems Running Decentralized GNN-Based Policies},
  author={Blumenkamp, Jan and Morad, Steven and Gielis, Jennifer and Li, Qingbiao and Prorok, Amanda},
  booktitle={IEEE International Conference on Robotics and Automation},
  year={2022},
  organization={IEEE}
}

Setup

Clone with git clone --recursive to include submodules. Run ./build.sh to set up a docker container for training. Training can be performed without docker by installing all requirements in the host system according to the Dockerfile.

Train

Start training by running

./run.sh python3 src/train.py

The training will stop automatically after 5000 training iterations.

Evaluate

Optionally, evaluate the policy performance by running

./run.sh python3 src/evaluate.py results/MultiPPO_simple_xxxx/checkpoint_yyyyyy

where the path to the model checkpoint has to be adapted accordingly.

Export model

For ROS2 inference (refer this ROS2 project)

./run.sh python3 src/export.py results/MultiPPO_simple_xxxx/checkpoint_yyyyyy

The exported torchscript model will be saved in the same checkpoint folder and can then manually be copied to the correct location in the ROS2 project.

rl_multi_agent_passage's People

Contributors

janblumenkamp avatar qingbiaoli avatar smorad avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.