Here I put some useful links that helped me understanding “why Gaussian / normal” distribution is such a special distribution.

It’s commonly used in Robotics not because of its expressiveness, but because it can be reasoned in close form, and can be parameterized by its moments, which is very convenient.

Why it can be reasoned in close form? Say and are random variables of normal distribution, then A + B also forms normal distribution. That’s where we got the central limit theorem, adding stuff up and we always got Gaussian.

Heres’s 3Blue1Brown series:

Moment parameterization

Natural parameterization

Also known as canonical parameterization.

\begin{aligned} P&=\Sigma^{-1} \\ J&=\Sigma^{-1}\mu \end{aligned}$$ $J$: information vector, $P$: matrix.