Hacker News
points by tclancy 2 days ago | 0 comments
Humans don’t need that? How many words have you taken in from all possible sources by the time you’re 18? And many of those words came with additional data due to tone of voice, inflection and context. And then some of those (in-person, filmed art) came with incredibly subtle data from body language and facial expressions. I think we take in a massive corpus of data every year. Think just of any book you re-read: why did you do it? Did you glean additional insight?
[–] nextaccountic 2 days ago
We experience tons of data, but it's still much less than the pretraining step of LLMs

I think it's clear that LLMs are massively less intelligent than they could be, based on the amount of training data and compute they consume. Or rather, humans are orders of magnitude more efficient on training, and we don't know why

The answer is probably in the DNA. We are born highly intelligent and our brain is still growing. The DNA itself was optimized for billions of years

[–] tclancy 2 days ago
How have you quantified this that you are asserting it to me?