Probability
Central Limit Theorem
The sum of i.i.d. random variables converges to a normal, no matter the source
Key idea
- $Z_n = \frac{S_n - n\mu}{\sigma\sqrt{n}}$ standardizes the sum to zero mean and unit variance.
- As n grows, the histogram of $Z_n$ converges to the standard normal $N(0,1)$, shown in green.
- This holds for any source distribution with finite mean and variance. Try switching between them.
- Symmetric distributions converge faster than skewed ones. Compare Uniform (fast) vs Exponential (slower).