If life exists on Mars, shall we human cooperate or compete with it?
WIP. Not released yet.
If you have any question (propose an ISSUE if it's general problem) or want to contribute to this repository, feel free to contact me: zhding96@gmail.com
Large-scale competitive games are generally hard, I'm still struggling with developing this repo.
Some tutorials (./tutorials/) are provided for simple MARL concepts, including building an arbitrary matrix game, solving the Nash equilibrium with different algorithms for matrix games, building arbitrary Markov game, solving Markov games, etc.
For comprehensive usage instruction document, see here.
MARS is still under-development and not prepared to release yet. You may find it hard to clone b.c. the author is testing algorithms with some models hosted on Git.
Use Python 3.6
pip install -r requirements.txt
Basic RL Algorithms to do:
- DQN
- PPO
- Genetic Algorithm
- PMOE
- DDPG
- TD3
- SAC
MARL Algorithms to do:
- Self-Play
- Fictitious Self-Play
- Neural Fictitious Self-Play
- Policy Space Responce Oracle
- Joint Policy Space Responce Oracle
- MADDPG
- QMIX
- QTRAN
- MAPPO
Supported environments:
- Openai Gym
- PettingZoo
- LaserTag
- SlimeVolley
- SMAC
Two agents in SlimeVolley-v0 trained with self-play.
Two agents in Boxing-v1 PettingZoo trained with self-play.
Exploitability tests are also conducted.