Discrete-Time Markov Control Processes: Basic Optimality Criteria by Onesimo Her

Discrete-Time Markov Control Processes: Basic Optimality Criteria: New

Diffusions, Markov Processes and Martingales, vol 1 and 2, Rogers, Williams

Further Topics on Discrete-Time Markov Control Processes by Onesimo Hernandez-Le

Markov Decision Processes: Discrete Stochastic Dynamic Programming by

Diffusions, Markov Processes and Martingales (Volume 1 Foundations)

Discrete-Time Markov Control Processes - 9781461268840