Hacker News

points by baggy_trough 3 days ago | 0 comments

[flagged]

It is just that we never considered how advanced stochastic parrots could be so powerful when dealing with basically the whole library of acquired human knowledge and guided by experts to generate.

It is not a demerit, actually I think that it is a very elegant outcome how many problems could be solved by generation and this probably show us how language is a far more important thing than we ever thought it was.

[–] freecodeio 3 days ago

math major here, I can't read the paper for shit

[–] moishe_syzslak 3 days ago

Not a math major here. But is this paper way too long? So long that it raises the possibility that OpenAI's staff mathematicians passed through AI's raw output as-is?

[–] eru 3 days ago

That problem seems independent of the 'stochastic parrot' accusation?

[–] freecodeio 3 days ago

A parrot might squeak the theory of everything and it won't matter to any of us cause nobody speaks parrot.

[–] eru 3 days ago

We can record a lot of parrot speech and train LLMs against it and eventually build a translator.

They are making good progress on similar research programmes for many cetaceans.

In the case of our stochastic parrots it's even easier, since they already speak something like human language. And for the math proofs it's even easier, because once they are formalised into something like Lean the humans only need to understand the statement of the theorem, and a mechanical computer program can check the proof.

[–] freecodeio 3 days ago

Yes we can just train llms against it and it's all solved. Just a few more trillion dollars and a bunch of deforestation for datacenters bro.

[–] CaptWorld 3 days ago

Ironically yeah.. if it can solve more complex problems across domains like biology, econ, finance then all the deforestation is worth it

[–] freecodeio 2 days ago

I would take a living, breathing forest over math papers that nobody knows what to do with. Hell I would take a leaf with an ant over it.