Diffusions, Markov Processes and Martingales, vol 1 and 2, Rogers, Williams

MARKOV CHAINS by DAVID FREEDMAN

An Introduction to Markov Processes by Daniel W. Stroock (Paperback, 2016)

Markov Processes - Volume II / E. B. Dynkin

Hahn, B: Essential MATLAB for Engineers and Scientists by Daniel T. Valentine

Data Analysis with Excel?: An Introduction for Physical Scientists, Kirkup, Les,

Markov Processes An Introduction for Physical Scientists Gillespie Hardback

Markov Processes - Volume I / E. B. Dynkin