Markov chain python. Only requires matplotlib and numpy to work.