Sure. I can see how the problems being solved would be very different, and would require "re-training." I'm wondering though how much is it the LLMs and how much is it the humans driving them? Could this have been done with the models currently accessible? Could I have just prompted "solve this conjecture" and hand the work over to a PhD to verify? Or is it "unlimited budget" + "super smart ppl prompting" + "SOTA model" ?

I guess I just see this like how NASA went to the moon. In theory there wasn't a lot stopping us from going besides a good reason (and money). OpenAI has a good reason (PR) and money, so they're doing it. Will these things stop coming out after funding and motivation is no longer there? Or by next year will we have access to this model and anyone can solve any of these open conjectures with time + money?