Learning Outcomes:
Knowledge and understanding of the subject
Indicative Module Content:
Definition and examples; Markov property; transition probabilities; hitting times; recurrence and transience; harmonic functions and martingales; invariant distributions; reversible Markov chains; convergence to equilibrium.