Comments (3)
I do not believe that supporting easy interdependency with PettingZoo, one of the most well-supported libraries for MARL environments is "redundant". Requiring potential users to dabble in low-level environment manipulation to conform to a Gym specification and not having comprehensive documentation is problematic for wider adoption, in my view.
from epymarl.
AFAIK, cooperative MARL has the same interface as OpenAI's Gym (which is the bigger project here). You can easily define a tuple of observations (one tuple element for each agent), actions, etc - and a single reward (because it's cooperative). That's identical to Gym (which we currently support). I don't see the reason for supporting a redundant API like PZ's but we will be happy to merge a wrapper if someone wants to contribute it.
from epymarl.
Hi! Sorry for the late follow-up.
There have been several difficulties of an improved integration of PettingZoo due to backwards incompatible changes introduced in later gym
and more recently gymnasium
versions which PettingZoo relies and that were not compatible with EPyMARL and several of our environments that relies on the outdated gym==0.21
version.
That being said, I am very glad that we just published a big update to EPyMARL including lots of new features and a move to gymnasium
from gym
(as well as support for training in non-common-reward games, weights and biases logging, and more)! This required not just changes to EPyMARL but also all our environments (esp. RWARE, LBF, matrix games, SMAClite) to continue support of these envs with EPyMARL. As part of this move to gymnasium
, we could now easily integrate PettingZoo environments. I have tested it with MPE environments of PettingZoo as well as some simpler environments and it seems to work well. Note, that continuous control tasks will not be supported.
I will close this issue since PettingZoo integration now works, but please let us know if there are any outstanding issues!
from epymarl.
Related Issues (20)
- Exploding targets for A2C and task Tag when add_value_last_step: True HOT 1
- Are values from Tables 3-7 for task MPE Tag, algorithms MAA2C and MAA2C_NS swapped?
- SMAC environment problem HOT 9
- Does this library support continuous action spaces? HOT 4
- How to get the Episodic return graph HOT 8
- Question with the implentation of Modules w.r.t different Multi-agent algorithms
- MADDPG algorithm problem
- How could I render the lbf environment? HOT 1
- Unable to install requirements.txt HOT 5
- Hi, why NonSharedMAC only has one agent? thanks HOT 1
- Parameters of MAPPO in different scenarios
- Question about MAPPO centralized critic's target network HOT 1
- Recommended torch version? HOT 1
- Adding new environment to ePYMARL HOT 1
- Training code for pretrained adversarial policies
- SMACv2 and SMAC Lite HOT 1
- [BUG] Duplicate agent_grad_norm in maddpg_learner.py Needs Removal HOT 1
- Get stats not being used in parallel runner
- Errors in search.py HOT 1
- Problems with SMAC and SMACv2 HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from epymarl.