A coding project relating to search algorithms, including DFS, BFS, ID, GBFS, A*, Weighted A*, HC, EHC, etc.
A coding project (PDDL language) in terms of data modelling.
A coding project about MDP and reinforcement learning, namely, value iteration(synchronous, asynchronous, and prioritized sweeping), Q-learning(learn from a table, and approximation), problem analysis.