Compression is Intelligence

Modern LLMs store all kinds of information in their billions of parameters, a massive amount in fact. But significantly less than the size of the training corpus used to train them. Which means they are compression of that training data.

If you think of a brain in the same way, as a statistical model for survival based on past experiences, then in a way our brains are a compression of reality.

1Blue3Brown has more to say here as well:

 https://members.3blue1brown.com/posts/reinventing-part-160410360?utm_medium=newsletter_post_email&utm_campaign=patron_engagement&utm_source=post_link&post_id=160410360