BestMSM is a Python package for building master equation / Markov state models. You can read the documentation here.
This code has been written by David De Sancho.
git clone http://github.com/daviddesancho/bestmsm destination/bestmsm
cd destination/bestmsm
python setup.py install --user