This book provides the essential theoretical tools for stochastic modeling. The authors address the most used models in applications such as Markov chains with discrete-time parameters, hidden Markov chains, Poisson processes, and birth and death processes.
The authors have also added new topics, including semi-Markov processes, marked Poisson processes, Hawkes processes, time reversibility and detailed balance in continuous-time Markov chains, and age-dependent branching processes.