Hacker News

points by simonw 6 hours ago | 0 comments

I've recently talked to people at Anthropic who are very confident that they have effectively solved the prompt injection risks that cause lethal trifecta attacks with their latest models.

The open challenge is how to prove it!

[–] epicureanideal 2 hours ago

> The open challenge is how to prove it!

It could be proven by Anthropic backed credit cards with terms that protect users if it’s leaked or an agent misuses it.

[–] delis-thumbs-7e 6 hours ago

Somehow this does not fill me with confidence. I think I will keep paying my bills manually, thanks but no thanks.

[–] computably 3 hours ago

Or, you know, automatically, with plain old software. Which works fine and fails in less ridiculous ways.

[–] klysm 4 hours ago

I’ll believe them when they put the lethal trifecta with their own skin in the game

[–] julianlam 4 hours ago

Like the guy who put his SSN on the side of a truck and asked people to steal his identity?

I like it!

IIRC he had his identity stolen a bunch.

----

> In 2005, Davis and Robert Maynard Jr. cofounded LifeLock,[10] a personal fraud protection company.[11] Davis was CEO of LifeLock since its founding. As part of a marketing campaign to promote his company's credit monitoring services, Davis posted his own social security number[12] on billboards and commercials. As a result, he was a victim of at least 13 cases of identity theft between 2007 and 2008, belying LifeLock's claims that its services protect consumers against identity theft and fraud.[13] The Federal Trade Commission imposed a $12 million penalty on the company for deceptive advertising, likening Davis and LifeLock marketers to "con artists."[14]

https://en.wikipedia.org/wiki/Todd_Davis_(businessman)

[–] mbesto 5 hours ago

Isn't prompt injection just one facet of the trifecta? Like, I just don't know how it's remotely possible to have a non-deterministic block box ever deterministically know whether your credit card has been compromised or not. Even if you were hacked, how would you even know?

[–] skinfaxi 5 hours ago

I thought the trifecta required all three not just pick two?

[–] jeremyjh 6 hours ago

They can’t solve the model being a complete idiot though.

[–] yunwal 5 hours ago

Or the user being an idiot. Saying this somewhat sarcastically, but there’s always someone who says “Go buy me a Rolex and have it shipped to my house” and then didn’t realize that could be $25,000

[–] cyanydeez 4 hours ago

oh, it's very easy to prove; just let the models and agents do the IPO for them.

[–] simianwords 3 hours ago

What does this have to do with prompt injection?

[–] simianwords 3 hours ago

I was downvoted on the suggestion that trivial prompt injection attempts are mostly solved.

https://news.ycombinator.com/item?id=50162483