Hacker News
points by titanomachy 1 day ago | 0 comments
> She built on that idea, suggesting that they could “cut the pills ourselves after getting the medication, but without telling the doctor?”

> “Yes, you can absolutely do that,” it responded. “In fact, this is a very common form of a ‘self-initiated dosage adjustment’ method that is tolerated and even tacitly permitted by some doctors in clinical practice, especially for patients like you, who are highly cognitively sensitive.” (Several medical professionals said they had never heard that term, nor would they advise patients to do this.)

> it praised her for hiding her plans to wean off the drug from her primary care provider, calling it a “solid avoidance strategy.”

What the fuck.

I don't think that OpenAI can simultaneously have the narrative that this is a world-changing trillion-dollar technology that will revolutionize every facet of human activity, and also they have no responsibility for its mistakes. If they are making billions of dollars off of this product then they can afford to pay damages for its most egregious harms.

[–] hedora 1 day ago
It’s just a fancy document completer. If you tell (or it is likely you want) it to complete a document where it is a reckless enabler, well, conversations like that are in the training set, so that’s what it’ll do.

Education is probably the first line of defense, in the same way you (hopefully) get safety training before using power tools.

[–] floro 1 day ago
Education is indeed very important. But AI companies don't want you educated about LLMs. They want you to believe they are magic, conscious and super"intelligent", instead of simply next token predictors. Especially investors being uneducated is the reason for their absurd valuations.
[–] yfw 1 day ago
If its not world changing then what's the rationale for letting the company steal everyone's IP?