Discrete-Time Markov Control Processes: Basic Optimality Criteria by Onesimo Her

Discrete-Time Markov Control Processes: Basic Optimality Criteria: New

Finite Markov Processes and Their Applications by Marius Iosifescu

Discrete-Time Markov Control Processes: Basic Optimality Criteria (Stochastic Mo

Markov Chains and Decision Processes for Engineers and Managers - Like New

Diffusions, Markov Processes and Martingales: Volumes 1 & 2 (Rogers & Williams)

Further Topics on Discrete-Time Markov Control Processes by Onesimo Hernandez-Le

MARKOV CHAINS by DAVID FREEDMAN