Code for implementing discrete probalbistic world models for applications within Reinforcement learning.