Hacker News
points by jacquesm 3 days ago | 0 comments
I'm running a max of 1M context locally. I think the next real move will be continuous learning/infinite context. That will be another game changer.
[–] throwaway85825 3 days ago
Infinite context requires Infinite memory.
[–] jacquesm 3 days ago
It wasn't a theoretical thing, it was a practical thing. Just like when we talk about 'infinite tape' when looking at Turing machines. As opposed to 'clear boundaries to how much context you can have because that is baked into the model'.