K-means, GMM, EM: Three Nested Russian Dolls of Clustering

K-means is actually an extreme case of GMM, and GMM is the canonical application of the EM algorithm. How these three connect within a single framework, and how information geometry explains the relationship.

December 10, 2023 · rick

Information Geometry: How AI Learns Most Efficiently

Just as Newton’s F=ma describes the physical world, information geometry describes how AI learns. An intuitive guide for beginners.

January 13, 2021 · rick