Hacker News
points by throwawayffffas 3 days ago | 0 comments
Eh, you read compiler and linter output don't you? Nobody read that before you did.

Sure LLMs are not nearly as rigorous about their output but that doesn't mean it's entirely not useful.

At a minimum you can have your LLM summarize the other LLMs output and go from there.

[–] johannes1234321 3 days ago
Compiler output is somewhat deterministic and there is a logical path (even if caused by a compiler bug) and not dealing with it will definitely(!) lead to a broken product. Also at least I rarely read the full output, but I have an intuition, as the structure is consistent, what to look for in the output.

LLM output may or may not be relevant, may or may not tell me something new and by the way it is structure is often hard to quickly oarse for the relevant piece in a wall of text.

[–] pantalaimon 2 days ago
If I ask Claude to 'Review this PR' it will usually generate a very useful output and find bugs I wouldn't have spotted.

It does not have to be a wall of slop, maybe you only used LLMs 2 years ago where this would have been all you'd get.