Ergodicity of a Stationary Markov Chain
Erdodic’s Wikipedia definition is very general (and confusing) — “time averages equal ensemble averages”? Here’s a simplified version for finite-state markov chain: Let $\{X_k\}_{k \geq 0}$ be a Markov chain on state $S$. Let $\pi\in \Delta(S)$. Let Let transition operatro be $P$, so $\pi^{t + 1} = P \pi^t$. Define stationary distribution $\bar \pi$ as $X_0 \sim \bar \pi$ where $P\bar\pi = \bar\pi$, the stationary process satisfies $$ (X_0, X_1, \dots) \overset{d}{=} (X_1, X_2, \dots) $$ Definition. The stationary process $\{X_k\}$ is ergodic if for every bounded function $f: S \to \mathbb{R}$ the following convergence hold a.s.: ...