1. The Poisson and Related Processes -- 2. Renewal-Reward Processes -- 3. Discrete-Time Markov Chains -- 4. Continuous-Time Markov Chains -- 5. Markov Chains and Queues -- 6. Discrete-Time Markov Decision Processes -- 7. Semi-Markov Decision Processes -- 8. Advanced Renewal Theory -- 9. Algorithmic Analysis of Queueing Models -- App. A. Useful Tools in Applied Probability -- App. B. Useful Probability Distributions -- App. C. Generating Functions -- App. D. The Discrete Fast Fourier Transform -- App. E. Laplace Transform Theory -- App. F. Numerical Laplace Inversion -- App. G. The Root-Finding Problem
