Hacker News

points by throwaway85825 3 days ago | 0 comments

That's the push factor. The pull is, say there's a giant repo like windows or Adobe. LLMs produce spaghetti code because the repo doesnt fit in the context and it wasn't in the training set. If Adobe fine tuned it the LLM would be much more useful.

[–] mattm 3 days ago

This will be the future model for businesses. Buy a generalized frontier model and finetune it and make it available internally. This model offers a lot more business benefits than the current risk.

[–] jacquesm 3 days ago

I'm running a max of 1M context locally. I think the next real move will be continuous learning/infinite context. That will be another game changer.

[–] throwaway85825 3 days ago

Infinite context requires Infinite memory.

[–] jacquesm 3 days ago

It wasn't a theoretical thing, it was a practical thing. Just like when we talk about 'infinite tape' when looking at Turing machines. As opposed to 'clear boundaries to how much context you can have because that is baked into the model'.