Hacker News
points by nextaccountic 2 days ago | 0 comments
We experience tons of data, but it's still much less than the pretraining step of LLMs

I think it's clear that LLMs are massively less intelligent than they could be, based on the amount of training data and compute they consume. Or rather, humans are orders of magnitude more efficient on training, and we don't know why

The answer is probably in the DNA. We are born highly intelligent and our brain is still growing. The DNA itself was optimized for billions of years

[–] tclancy 2 days ago
How have you quantified this that you are asserting it to me?
Hacker News