Hacker News

points by othmanosx 2 days ago | 0 comments

What about after the bot reviews, did you come up with any solutions to speed that up? I’m talking about the human part of the review

[–] joshstrange 2 days ago

We’re still experimenting. Automatically fixing obvious issues raised by the agent (at another agent’s discretion) or presenting a list of the feedback items with fix/refute suggestions are things we’ve toyed with.

Personally I have an agent review the feedback and break down each item so it’s easier to review (helps remove some of the jargon/short-hand that agents use sometimes). Then I decide what to have an agent address and what to push back on. Like I said, I’m working on finding a way to automate part of that but haven’t settled on one I like yet.

[–] othmanosx 2 days ago

I’m having issues with agents not applying the rules to begin with, during both implementing and reviewing, it just reads the rules and choses to ignore them sometimes, adding more rules just makes this more likely to happen, and having review cycles can potentially get to a state where two agents talk nonstop and increase the slop I need to read instead of reducing it.