Diffusions, Markov Processes, & Martingales by DAVID WILLIAMS

Seymour - Trust-Based Interactive Partially Observable Markov Decision - X555z

Elements of the Theory of Markov Processes and Their Applications (Dover...

Elements of the Theory of Markov Processes & Their Applications, A Bharucha-Reid

Theory Of Markov Processes By E. B. Dynkin (1961, Hardcover)

MARKOV PROCESSES-I & II by E.B. DYNKIN

Markov Processes : An Introduction for Physical Scientists by DanielT. Gillespie

Partially Observed Markov Decision Processes by Vikram Krishnamurthy