Sparse MDPs in Spark Policy Evaluation and Iteration implementation in Spark for MDPs with sparse transition matrices.