points by nextaccountic 2 days ago | 0 comments
We experience tons of data, but it's still much less than the pretraining step of LLMs
I think it's clear that LLMs are massively less intelligent than they could be, based on the amount of training data and compute they consume. Or rather, humans are orders of magnitude more efficient on training, and we don't know why
The answer is probably in the DNA. We are born highly intelligent and our brain is still growing. The DNA itself was optimized for billions of years
[–] tclancy 2 days ago