Further Topics on Discrete-Time Markov Control Processes Hardcove

Finite Markov Processes and Their Applications by Marius Iosifescu

Diffusions, Markov Processes and Martingales: Volumes 1 & 2 (Rogers & Williams)

Discrete-Time Markov Control Processes: Basic Optimality Criteria by Onesimo Her

Further Topics on Discrete-Time Markov Control Processes by Onesimo Hernandez-Le

Further Topics on Discrete-Time Markov Control Processes by Hernandez-Lerma: New

Further Topics on Discrete-Time Markov Control Processes - 9781461268185

MARKOV CHAINS by DAVID FREEDMAN