Hacker News
points by joelthelion 11 hours ago | 0 comments
I'm not an expert, but maybe updating an existing open-weights model to give it up to date knowledge would be more tractable?
[–] singpolyma3 7 hours ago
There's not even any point in that IMO. A model doesn't "know" things anyway everything useful it's going to get from tool calls and context.
[–] crimsoneer 10 hours ago
I think the problem is up to date knowledge isn't really the difficult or useful bit. We're sort of moving to a world where the real value in training comes from tool calling and performance over long context - your models shouldn't really be relying on their internal knowledge, but instead calling various tools. But the performance gap between now and six months for that is pretty huge.
Hacker News