Finite Markov Processes and Their Applications by Marius Iosifescu

Diffusions, Markov Processes, & Martingales by DAVID WILLIAMS

Diffusions, Markov Processes and Martingales, vol 1 and 2, Rogers, Williams

Markov Processes - Volume II / E. B. Dynkin

Diffusions, Markov Processes and Martingales: Volumes 1 & 2 (Rogers & Williams)

Markov Chains and Decision Processes for Engineers and Managers - Like New

Counterexamples In Markov Decision Processes: 6... - Piunovskiy, Alexey B

Markov Processes - Volume I / E. B. Dynkin