[wlib]

Exactly - the twitter thread would be really improved if everyone read an introduction to information theory. There are 1024 bits of information in a kilobit, and that's enough information for 2^1024 unique messages. The interpreter of the messages judges what the message information means, but the Kolmogorov complexity of a message is inescapable - you would need to modify the interpreter to squeeze out more messages (which is nothing more than pre-transferring information to the receiver)

[b33j0r]

Shannon’s insight into the hyperspheres of transmission blew my mind 15 years ago, and I’m still not over it.

The idea of an ideal communication channel rivals most ideas ever had. The original paper is surprisingly accessible. Highly recommended if anyone hasn’t had a chance to give it a tour.

And here’s the book, just to not be a tease: https://pure.mpg.de/rest/items/item_2383164/component/file_2...

[lulzury]

This is a fantastic paper. Any tips on how to digest some of the more math-y parts of the paper? For example in understanding Theorem 1.