Hacker News
points by rbehrends 3 days ago | 0 comments
I think this is where we may have to agree to disagree, because this not something that I'd do outside of toy projects. Not necessarily because I'm worried about the correctness of a single MR (in fact, it may very well be more likely to be correct than a human-authored and -reviewed one), but because I'm concerned about the accrual of technical debt. Even if each individual MR is correct, the trajectory for code quality can trend downwards.

The recent update to SlopCodeBench that includes Astra and Opus 5.5 (including the insight that higher reasoning levels may not improve the situation) seems to match my intuition. [1]

[1] https://github.com/humanlayer/advanced-context-engineering-f...

[–] redox99 2 days ago
That benchmark only prompts the agent once. You shouldn't do that. The first implementation of agents is very often flawed.

My pipeline is

Opus implements -> Opus and Sol review changes -> Opus verifies the issues from the reviews are real and worth fixing -> Opus fixes the issues.

Hacker News