Finite Markov Processes and Their Applications by Marius Iosifescu

MARKOV CHAINS by DAVID FREEDMAN

Markov Models: Introduction to Markov Chains, Hidden Markov Models and Bayes...

Markov Chains (Cambridge Series in Statistical and Probabilistic Mathematics...

Markov Chains (Cambridge Series in Statistical and Probabilistic

Counterexamples In Markov Decision Processes: 6... - Piunovskiy, Alexey B

Queueing Networks and Markov Chains: Modeling and Performance Evaluation wit...

Queuing Networks and Markov Chains: Modeling and Performance Evaluation With Co