Hernandez-Lerma - Further Topics on Discrete-Time Markov Control Proce - X555z

Diffusions, Markov Processes and Martingales, vol 1 and 2, Rogers, Williams

Finite Markov Processes and Their Applications by Marius Iosifescu

Markov Decision Processes: Discrete Stochastic Dynamic Programming by

Diffusions, Markov Processes and Martingales (Volume 1 Foundations)

Further Topics on Discrete-Time Markov Control Processes by Hernandez-Lerma: New

Markov Processes - Volume II / E. B. Dynkin

Discrete-Time Markov Control Processes - 9781461268840