Game-based AI Platforms

This page provides the links to the source code of the game-based platforms for AI research, corresponding research papers, and competitions collected in our survey paper ``Game-based Platforms for Artificial Intelligence Research''.

Please use this bibtex if you want to cite our work:

@article{hu2023game,
  title={Game-based Platforms for Artificial Intelligence Research},
  author={Hu, Chengpeng and Wang, Ziqi and Zhao, Yunlong and Du, Haocheng and Liu, Jialin},
  journal={under single-blind review},
  year={2023}
}

Playing Games by AI

Board Games

<Blood bowl> <Github Link> <Competition Link> by Justesen, Niels and Uth, Lasse Møller and Jakobsen, Christopher and Moore, Peter David and Togelius, Julian and Risi, Sebastian, 2019.
<ColorShapeLinks: A board game AI competition for educators and students> <Github Link> <Competition Link> by Nuno Fachada, 2021.
<Mjx: A framework for Mahjong AI research> <Github Link> by Koyamada, Sotetsu and Habara, Keigo and Goto, Nao and Okano, Shinri and Nishimori, Soichiro and Ishii, Shin, 2022.

Social Games

<It's Food Fight! Introducing the Chef's Hat Card Game for Affective-Aware HRI> <Github Link> <Competition Link> by Pablo Barros and Alessandra Sciutti and Anne C. Bloem and Inge M. Hootsmans and Lena M. Opheij and Romain H.A. Toebosch and Emilia Barakova, 2021.

Grid-based 2D Video Games

<Pommerman> <Github Link> <Competition Link> by Resnick, Cinjon and Eldridge, Wes and Ha, David and Britz, Denny and Foerster, Jakob and Togelius, Julian and Cho, Kyunghyun and Bruna, Joan, 2018.
<The first microRTS artificial intelligence competition> <Github Link> <Competition Link> by Santiago Ontañón., 2018.
<The NetHack Learning Environment> <Github Link> <Competition Link> by Küttler, Heinrich and Nardelli, Nantas and Miller, Alexander H. and Raileanu, Roberta and Selvatici, Marco and Grefenstette, Edward and Rocktäschel, Tim, 2020.
<Tribes: A New Turn-Based Strategy Game for AI> <Github Link> by Diego Perez Liebana, Yu-Jhen Hsu, Stavros Emmanouilidis, Bobby Khaleque, Raluca Gaina, 2020.
<Neural MMO: A Massively Multiagent Game Environment for Training and Evaluating Intelligent Agents> <Github Link> <Competition Link> by Joseph Suarez, Yilun Du, Clare Zhu, Igor Mordatch, and Phillip Isol, 2021.
<Snakes AI Competition 2020 and 2021 Report> <Github Link> <Competition Link> by Joseph Alexander Brown, Luiz Jonata Pires de Araujo, and Alexandr Grichshenko, 2021.

Pixel-based 2D Video Games

<The Mario AI Benchmark and Competitions> <Github Link> <Competition Link> by Sergey Karakovskiy and Julian Togelius, 2012.
<Geometry Friends Game AI competition> <Github Link> <Competition Link> by Prada, Rui and Lopes, Phil and Catarino, João and Quitério, Joao and Melo, Francisco S. , 2015.
<Game AI Research with Fast Planet Wars Variants> <Github Link> Lucas, S.M., 2018.
<Angry Bird AI Competition> by Renz Jochen, Zhang Peng, (Gary) Ge XiaoYu, Nikonova Ekaterina, Gamage Chathura, Xue Cheng, and Pinto Vimukthin , 2012.
<Fighting game artificial intelligence competition platform> <Github Link> <Competition Link> by Lu, Feiyu and Yamamoto, Kaito and Nomura, Luis H and Mizuno, Syunsuke and Lee, YoungMin and Thawonmas, Ruck , 2013.

3D Video Games

<ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning> <Competition Link> by Marek Wydmuch and Micha{\l} Kempka and Wojciech Ja'skowski , 2019.
<MineRL Diamond challenge> <Github Link> <Competition Link> by William H. Guss and Houghton, Brandon and Topin, Nicholay and Wang, Phillip and Codel, Cayden and Veloso, Manuela and Salakhutdinov, Ruslan , 2019.

Commercial Games

<Monte Carlo Tree Search Experiments in Hearthstone> <Github Link> by Santos, Andr{'e} and Santos, Pedro A and Melo, Francisco S , 2017.
<Starcraft II: A new challenge for reinforcement learning> <Github Link> <Competition Link> by Vinyals, Oriol and Ewalds, Timo and Bartunov, Sergey and Georgiev, Petko and Vezhnevets, Alexander Sasha and Yeo, Michelle and Makhzani, Alireza and K{"u}ttler, Heinrich and Agapiou, John and Schrittwieser, Julian and others , 2017.
<Dota 2 with large scale deep reinforcement learning> <Github Link> <Competition Link> by Berner, Christopher and Brockman, Greg and Chan and others , 2019.
<Overcooked! On the utility of learning about humans for human-ai coordination> <Github Link> by Carroll, Micah and Shah, Rohin and Ho, Mark K. and Griffiths, Thomas L. and Seshia, Sanjit A. and Abbeel, Pieter and Dragan, Anca , 2019.
<Honor of Kings Arena: an Environment for Generalization in Competitive Reinforcement Learning> <Github Link>by Wei, Hua and Chen, Jingxiao and Ji, Xiyang and Qin, Hongyang and Deng, Minwen and Li, Siqin and Wang, Liang and Zhang, Weinan and Yu, Yong and Liu, Lin and Huang, Lanxiao and Ye, Deheng and Fu, Qiang and Yang, Wei , 2022.

Other Games

<AI wolf contest—development of game AI using collective intelligence> <Github Link> <Competition Link> by Toriumi, Fujio and Osawa, Hirotaka and Inaba, Michimasa and Katagami, Daisuke and Shinoda, Kosuke and Matsubara, Hitoshi, 2016.
<Using Fractal Neural Networks to Play SimCity 1 and Conway’s Game of Life at Variable Scales> <Github Link> by Earle, S., 2020.

Platforms with Multiple Games

<General game playing: Overview of the AAAI competition> <Github Link> <Competition Link> by Genesereth, M., Love, N. and Pell, B., 2005.
<Botzone> <Github Link> <Competition Link> by Zhou, Haoyu and Zhou, Yushan and Zhang, Haifeng and Huang, Houjun and Li, Wenxin, 2017.
<OpenSpiel: A Framework for Reinforcement Learning in Games> <Github Link> by Marc Lanctot, etc, 2020.
<Ludii as a competition platform> <Github Link> <Competition Link> by Stephenson, M., Piette, E., Soemers, D.J. and Browne, C., 2019.
<TAG: Tabletop Games Framework> <Github Link> by Raluca D. Gaina and Martin Balla and Alexander Dockhorn and Raul Montoliu and Diego Perez-Liebana, 2020.
<OpenAI Gym> <Github Link> by Greg Brockman, Vicki Cheung,450Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zarem , 2016.
<Pettingzoo: Gym for multi-agent reinforcement learning> <Github Link> by Terry, J. K and Black, Benjamin and Grammel, Nathaniel and Jayakumar, Mario and Hari, Ananth and Sulivan, Ryan and Santos, Luis and Perez, Rodrigo and Horsch, Caroline and Dieffendahl, Clemens and Williams, Niall L and Lokesh, Yashas and Sullivan, Ryan and Ravi, Praveen, 2020.
<Minimalistic Gridworld Environment for Gymnasium> by Chevalier-Boisvert, Maxime and Bahdanau, Dzmitry and Lahlou, Salem and Willems, Lucas and Saharia, Chitwan and Nguyen, Thien Huu and Bengio, Yoshua, 2018.
<General Video Game AI> <Github Link> <Competition Link> by iego Perez-Liebana, Jialin Liu, Ahmed Khalifa, Raluca D Gaina, Julian Togelius, and Simon M Luca, 2019.
<STRATEGA: A General Strategy Games Framework> <Github Link> by Dockhorn, A., Grueso, J.H., Jeurissen, D. and Liebana, D.P., 2020.
<Griddly: A platform for AI research in games> <Github Link> by Christopher Bamfor, 2021.
<Melting Pot> <Github Link> by Joel Z. Leibo .etc , 2021.
<Playing SNES in the Retro Learning Environment> <Github Link> <Competition Link> by Nadav Bhonker, Shai Rozenberg and Itay Hubara , 2016.
<Leveraging Procedural Generation to Benchmark Reinforcement Learning> <Github Link> <Competition Link> by Cobbe, Karl and Hesse, Christopher and Hilton, Jacob and Schulman, John, 2019.
<AI Olympics Competition> <Competition Link> by Zhang Haifeng and Yahui C , 2022.
<DeepMind Lab> <Github Link> by Charles Beattie, Joel Z Leibo, Denis Teplyashin, Tom Ward, Marcus Wainwright, Heinrich Küttler, Andrew Lefrancq, Simon Green, Víctor Valdés, Amir Sadik, et al. , 2016.
<EMERGENT TOOL USE FROM MULTI-AGENT AUTOCURRICULA> <Github Link> by Baker, Bowen and Kanitscheider, Ingmar and Markov, Todor and Wu, Yi and Powell, Glenn and McGrew, Bob and Mordatch, Igor , 219.
<MiniWorld: Minimalistic 3D Environment for RL & Robotics Research> by Chevalier-Boisvert, Maxime, 2018.

Game for Design

Design Games by AI

2D Map/Level

<The Mario AI Benchmark and Competitions> <Github Link> <Competition Link> by Sergey Karakovskiy and Julian Togelius, 2012.
<Procedural zelda: A pcg environment for player experience research> <Github Link> by Heijne, Norbert and Bakkes, Sander , 2017.
<Talakat: Bullet hell generation through constrained map-elites> <Github Link> by Khalifa, Ahmed and Lee, Scott and Nealen, Andy and Togelius, Julian , 2018.
<AIBIRDS> <Github Link> by Renz, Jochen and Ge, XiaoYu and Stephenson, Matthew and Zhang, Peng , 2019.
<Friend, collaborator, student, manager: How design of an AI-driven game level editor affects creators> <Github Link> Guzdial, Matthew and Liao, Nicholas and Chen, Jonathan and Chen, Shao-Yu and Shah, Shukan and Shah, Vishwa and Reno, Joshua and Smith, Gillian and Riedl, Mark O , 2019.
<PCGRL Learning> <Github Link> by Khalifa, Ahmed and Bontrager, Philip and Earle, Sam and Togelius, Julian , 2020.
<Keiki: Towards Realistic Danmaku Generation via Sequential GANs> <Github Link> by Wang, Ziqi and Liu, Jialin and Yannakakis, Georgios N , 2021.

3D Map/Level

<The AI settlement generation challenge in minecraft> <Github Link> <Competition Link> by Salge, Christoph and Green, Michael Cerny and Canaan, Rodrigo and Skwarski, Filip and Fritsch, Rafael and Brightmoore, Adrian and Ye, Shaofang and Cao, Changxing and Togelius, Julian , 2020.
<Say “Sul Sul!” to SimSim, A Sims-Inspired Platform for Sandbox Game AI> <Github Link> by Charity, Megan and Rajesh, Dipika and Ombok, Rachel and Soros, Lisa B , 2020.

Narrative

<Bringing stories alive: Generating interactive fiction worlds> <Github Link> by Ammanabrolu, Prithviraj and Cheung, Wesley and Tu, Dan and Broniec, William and Riedl, Mark , 2020.

Rhythm Chart

<StepMania> <Github Link>
<OSU!> <Github Link>

Card

<Monte carlo tree search experiments in hearthstone> <Github Link> by Santos, Andre and Santos, Pedro A and Melo, Francisco S , 2017.

Other Design

<Evolving personas for player decision modeling> <Github Link> by Holmgard, Christoffer and Liapis, Antonios and Togelius, Julian and Yannakakis, Georgios N , 2014.
<VGLC : The Video Game Level Corpus> <Github Link> by Adam James Summerville, Sam Snodgrass, Michael Mateas, Santiago Ontañón, 2016.
<Baba is Y’all: Collaborative Mixed-Initiative Level Design> <Web page> by Charity, Megan and Khalifa, Ahmed and Togelius, Julian , 2020.
<Lode Encoder: AI-constrained co-creativity> <Web page> by Bhaumik, Debosmita and Khalifa, Ahmed and Togelius, Julian , 2021.

HcPlu/GameAI-Platforms