Illuminating Game Space Using MAP-Elites for Assisting Video Game Design
The CaveSwing implementation is taken from this repository
A more detailed setup tutorial can be found in this link.
Installation
Python dependencies (It is recommended to create a virtual environment for the project):
- thrift
- numpy
- matplotlib
- tqdm
You can install the dependencies by running pip install -r requirements.txt
optionally: Jupiter notebook, but the interactive visualisation does not work in the notebook.
Java
- version 8+ (with language level 8)
- additional libraries are in the lib subfolder (gson and thrift are required to run the example)
Running Map-elites
The main files for tuning the parameters in CaveSwing can be found in the src/hyperopt package. It contains both python and Java code.
To run the project the follow these steps:
- 1, run main in
TuneMapElites.java
, which starts up the server. - 2, run
mapElite.py
with python
You can modify, which behaviour descriptors you want to use.
It is also possible to add new descriptors, which has to be done on the Java side in the TuneMapElites.java
, where the descriptors are added to the Results
object.
Initialize MAP-elites
Define the threshold for the bins, which should be the minimum and maximum values of the expected behaviour characterization values.
mapElite.behaviour_tresholds = [
("height", (mapElite.get_threshold(min=0, max=200, bins=50))),
("averageSpeed", (mapElite.get_threshold(min=5., max=312., bins=50)))]
Connect to the Java client (should run TuneMapElites.java
first) and run the numIters
of iterations with G random initial solutions. After running G random parameters the remaining iterations mutates the found parameters to find new ones.
client = mapElite.connectToServer()
elites = mapElite.runSimulation(numIters, randomSolutions, client)
Visualize the found solutions as a heatmap.
mapElite.makeHeatMap(elites)
After running for 2000 iterations, we should get a heatmap similar to this. For running longer more bins should be filled up by the algorithms.
Modifying Behavioral Characterization
Got to TuneMapElites.java
and you can define new ways to collect data in the PlayGame function, you just have to make sure to add it a new name and put it into the Results map.
Existing Behavioural Characterizations are:
height
; average height the agent takes during evaluationaverageSpeed
; average speed to complete the levelticks
; average number of ticks the agent takes to finish the levelropeActions
; average number of rope actions used during evaluationanchorNormalized
; calculated as:ropeActions / numAnchors / nTicks
and averaged over N evaluations.
Then to use the new Behavioural Characterization on the python side, you just have to use the new name in MAP-elites initialization.
mapElite.behaviour_tresholds = [
("<bc1>", (mapElite.get_threshold(min1, max1, bins1))),
("<bc2>", (mapElite.get_threshold(min2, max2, bins2)))]
where and are the names of the behavioral characterizations and min
, max
are the ranges for the values it might take (or the area we are interested in) and bins
define the number of grids used within these ranges.
Please cite this paper if you use this in your work:
@article{balla2021illuminating,
title={Illuminating Game Space Using MAP-Elites for Assisting Video Game Design},
author={Balla, Martin and Barahona-R{\i}os, Adri{\'a}n and Katona, Adam and P{\'e}rez, Nuria Pena and Spick, Ryan},
year={2021},
booktitle={11th AISB Symposium on AI & Games}
}