Udacity Machine Learning Engineer Nanodegree Capstone Project

Requirements:

  1. python 3.5+
  2. openAi.gym (pip install gym)

Running the agents

use python <agent_name>.py to execute the agent. The list of various agents is given in the project structure\code of this Read_Me.

project Structure

Code

Cartpole

  1. Random_exploration : random_guessing.py : shows results if the env is enxplored randomly without any learning agent. (code\cartpole\random_guessing.py)
  2. Q_learning: Q_learning_agent.py : Creates apolicy iteration Q_learning model and genrates the respective Q_table while learning and produces the reeepctive results.(code\cartpole\Q_learning_agent.py)
  3. Deep_Q_learning : DQN_model_1.py : Creates a Deep_Q_learning agent and trains it to play the game. (code\cartpole\DQN_model_1.py)

Mountain_Car

  1. Random_exploration : random_guessing.py : shows results if the env is enxplored randomly without any learning agent.(code\Mountain_car\random_guessing.py)
  2. Q_learning: Q_learning_agent.py : Creates apolicy iteration Q_learning model and genrates the respective Q_table while learning and produces the reeepctive results.(code\Mountain_car\Q_learning_agent.py)
  3. Deep_Q_learning : DQN_model_1.py : Creates a Deep_Q_learning agent and trains it to play the game.(code\Mountain_car\DQN_model_2.py)

Report

  1. Proposal : Docs/proposal.pdf
  2. Report : Docs/Report.html

Simulation Results :

Cartpole :

  1. Jupyter Notebook : Docs/Cartpole Results/Cartpole_result_plots.ipynb
  2. HTML : Docs/Cartpole_result_plots.html

Mountain Car :

  1. Jupyter Notebook : Docs/Mountain Car Results/Mountain_car_result_plots.ipynb
  2. HTML : Docs/Mountain_car_result_plots.html