top | item 44427929

Entropy of a Mixture

54 points| cgadski | 8 months ago |cgad.ski | reply

5 comments

order
[+] mreid|8 months ago|reply
Really nice presentation of divergences. I made a similar attempt (math + interactive JS visualizations) a long time ago for the Bregman divergences: https://mark.reid.name/blog/meet-the-bregman-divergences.htm...

These visualizations are much nicer than mine though.

Curious fact, the Bregman divergences are a different class of divergences to the f-divergences that intersect at the KL divergence. That is, KL is (essentially) the only divergence that is both an f-divergence and a Bregman divergence. This is basically because log turns a ratio into a difference.

[+] esafak|8 months ago|reply
Forgive the meta comment, but is the source for your blog template available? I admire the presentation.
[+] prophesi|8 months ago|reply
Looks custom with simple HTML & CSS, KaTex for LaTex rendering, and Haxe 4.3.6 for the interactive charts. Never thought to use Haxe in such a way!