Hernandez-Lerma - Discrete-Time Markov Control Processes Basic Optim - X555z

Finite Markov Processes and Their Applications by Marius Iosifescu

Diffusions, Markov Processes and Martingales: Volumes 1 & 2 (Rogers & Williams)

Hernandez-Lerma - Further Topics on Discrete-Time Markov Control Proce - X555z

Discrete-time Markov control processes basic optimality criteria Onésimo Hernánd

MARKOV CHAINS by DAVID FREEDMAN

Hernandez-Lerma - Adaptive Markov Control Processes - New hardback or - X555z

An Introduction to Markov Processes by Daniel W. Stroock (Paperback, 2016)