Finite Markov Processes and Their Applications by Marius Iosifescu

Diffusions, Markov Processes and Martingales: Volumes 1 & 2 (Rogers & Williams)

Further Topics on Discrete-Time Markov Control Processes by Onesimo Hernandez-Le

Discrete-Time Markov Control Processes: Basic Optimality Criteria: New

Discrete-Time Markov Control Processes: Basic Optimality Criteria by Jean B. Las

MARKOV CHAINS by DAVID FREEDMAN

Discrete-Time Markov Control Processes: Basic Optimality Criteria (Stochastic Mo

Discrete-Time Markov Control Processes - 9781461268840