This assignment demonstrates the differences between using "direct value estimation" and "function approximation" given a policy estimated for the world.

Requirements:

+ pip install graphics
+ pip install numpy

How To Run

+ python main.py
+ Follow instructions.