points by jrockway 2 days ago | 0 comments
I have no idea if they're doing this, but you can always run the last turn through another LLM and ask it "should I request feedback based on this turn?"
I believe this is how the auto-mode classifier works. It sees a little bit of the transcript (with tool output removed, to avoid prompt injection) and answers "yes, allow the action" or "no, deny the action".
[–] j45 2 days ago