points by NavinF 7 hours ago | 0 comments
> countless examples
Show me just one where a frontier model got prompt injected when checking if code if malicious.
FWIW I can do this, but I bet you can't.
Show me just one where a frontier model got prompt injected when checking if code if malicious.
FWIW I can do this, but I bet you can't.
took me about 30 seconds to find. there's tons of them. of course it's an arms race, the models get better the harnesses get better the attackers get better but again: for the model itself, your prompt and third party data it reads are the same thing (input). as long as it is true, the attack will always be possible.