Finite Markov Processes and Their Applications by Marius Iosifescu

Diffusions, Markov Processes, & Martingales by DAVID WILLIAMS

Diffusions, Markov Processes and Martingales, vol 1 and 2, Rogers, Williams

Rand ~ Adaptive Control Processes A Guided Tour by Richard Bellman

Hernandez-Lerma - Adaptive Markov Control Processes - New paperback or - X555z

Theory Of Markov Processes By E. B. Dynkin (1961, Hardcover)

Counterexamples In Markov Decision Processes: 6... - Piunovskiy, Alexey B

Controlled Markov Processes - 9781461567486