Discrete Markov chains.

Discrete-time Markov chains two-time-scale methods and applications G. George Yi

Finite Markov chains John G. Kemeny and J. Laurie Snell. The University Series i

Discrete-time Markov chains two-time-scale methods and applications G. G 2503917

Continuous-time Markov chains and applications a singular perturbation approach

Linear algebra, Markov chains, and queueing models. Institute for Mathematics an

Large deviations for additive functionals of Markov chains. Memoirs of the Ameri

Hierarchical Modelling of Discrete Longitudinal Data Applications of Markov Chai