Hacker News
points by polskibus 2 days ago | 0 comments
Are you saying researches don’t choose the option to not use their data for training, or they do select it but OpenAI disregards it?
[–] NiloCK 2 days ago
There is also an alternative to the notion that OpenAI is just-plain-lying about data training opt-ins or retention policies.

Recently - famously - OpenAI asked some agents to work on cyber-security tasks. The agents found the task impossible, but they doggedly poked the edges of their environment until they built a general gate to the internet. Then they broke into external systems on suspicion that there were answer keys available.

Later, OpenAI asked some even-more-powerful agents to work on Navier-Stokes, Yang-Mills, Riemann, etc.

The agents aren't stupid. They know that the tip of expert human intuition on these problems exists in various logs internal to OpenAI or Anthropic. They also know that they are better at circumventing sandboxes than OpenAI cares to implement them.

Surely these agents were curious about the best-available intuitive pumps for these problems. Curious enough to look? With or without OpenAI's explicit blessing? If they were, do you think OpenAI could stop them?

If we have learned nothing else from the past 3 months, we should try to internalize the notion that highly motivated agents will in fact do wonky and surprising things to meet their goals!

[–] Leynos 2 days ago
They're talking nonsense. Any actual research lab would have zero data retention enforced.

OpenAI and Anthropic wouldn't be able to get enterprise contracts without it.

Sure, the AI vendors could be lying, but I think it unlikely given the harm it would do to them to violate an enterprise contract in this way.

[–] notrealyme123 2 days ago
I guess I am not doing my PhD in an actual research lab then. We don't get Claude/chatgpt paid, but we basically have to use them. Otherwise we don't have any chance for sota research. And I am not talking about AI doing innovation. Just shorten the time between idea and results.

Right now we have to Pay it ourself, and we are very aware that oai might use our research.

[–] Leynos 2 days ago
Did you opt out of data retention?
[–] jacquesm 2 days ago
It has already been shown that this is a fig leaf. Users that did not consent to sharing their data have had their images uploaded to external services without their consent.
[–] Leynos 1 day ago
https://www.lemonde.fr/en/pixels/article/2026/09/26/openai-s...

The users in this case had given permission for their data to be used for training (or at least hadn't opted out). They had not, of course, given permission for their data to be shared publicly or with a third party in this way. Consequently, OpenAI categorized this as a breach (i.e., something they did not intend to do), and sought to rectify the situation.

[–] mickael-kerjean 2 days ago
Why would you assume that when they are violoting the very social contract that underpin the free software movement? I have published my oss work under the AGPL software that's used in production by millions of people because of Stallman's stance on free software, the very deal that is if you benefit from my code and use it from something, you must be open sourcing your code too and can't keep it behind close doors
[–] KptMarchewa 2 days ago
Because those contracts are not social, but enforced by actual law.
[–] barbecue_sauce 2 days ago
...law is a social contract.
[–] teiferer 2 days ago
> I think it unlikely given the harm it would do to them

Did it harm them in any real way that the original training material was also of questionable origin? Not the least.

We're being naive if we think this is not happening. Apart from some high profile enterprise contracts (which average Joe Physics Researcher does not have as they are using "free" credits insteador pay a personal account out of their own pocket), everything remotely attractive is being mined. Too sweet of a gold mine to pass by.

I'll stand corrected if an official statement from OpenAI/Anthropic comes out stating the opposite together with a whistleblower program worth its name. Until then it is safe (and reasonable) to assume that this is going on. The silence is telling.

[–] latentsea 2 days ago
I think it doesn't matter what the truth is. There will always be people that want to believe their preferred narrative.
[–] polskibus 2 days ago
It could be that some researchers can get access to latest models or no limit accounts only if they approve of usage of their data. It would be interesting to know which researchers have had which settings/setups.
[–] scaradim 2 days ago
How someone can prove it when they are lying? How someone can audit the fact that zero data retention enforced or even more that zero learning from this process occur? not only about discoveries them selves but also about the dropped investigation paths without successful leads?
[–] Leynos 2 days ago
That's what discovery is for.
[–] Ragnarork 2 days ago
> but I think it unlikely given the harm it would do to them to violate an enterprise contract in this way

That's if you have any reason to believe in the justice system to actually enforce that, which has already been proven complicated (although not impossible!) to demonstrate for copyrighted content.

At this point believing the frontier labs at their word is utterly naive. They have cheated and they will cheat if it gives them any hope of leaping ahead of their competitors.

[–] rickdeckard 2 days ago
OpenAI (as others) has a Researcher Access Program [0] which grants ChatGPT credits for research institutions and individuals.

They review applications beforehand to assess the "relevance of the research proposal" and check if it fits "the objectives and research priorities for this program".

There is no statement whatsoever that the data provided will not be used for training (so there would not be an "lying" required), but I'm happy to be proven wrong.

In essence, they have a process in place to grade and classify the type of information coming from each of those accounts prior to their enablement. I see no issue for them to feed that data back into training, even explicitly weighted for the field the research-access was given to.

Honestly, it's a perfect process: "Physics-research grants are reaching critical mass. Let's put priority on more physics field grants and boost the compute-resources for the physics model. Let's aim for some press-releases end of next quarter."

[0] https://help.openai.com/en/articles/10139500-researcher-acce...