Click Markov_chain.pdf link to view the file.