[–] NiloCK 2 days ago
[–] Leynos 2 days ago
OpenAI and Anthropic wouldn't be able to get enterprise contracts without it.
Sure, the AI vendors could be lying, but I think it unlikely given the harm it would do to them to violate an enterprise contract in this way.
[–] notrealyme123 2 days ago
Right now we have to Pay it ourself, and we are very aware that oai might use our research.
[–] Leynos 2 days ago
[–] jacquesm 2 days ago
[–] Leynos 1 day ago
The users in this case had given permission for their data to be used for training (or at least hadn't opted out). They had not, of course, given permission for their data to be shared publicly or with a third party in this way. Consequently, OpenAI categorized this as a breach (i.e., something they did not intend to do), and sought to rectify the situation.
[–] mickael-kerjean 2 days ago
[–] KptMarchewa 2 days ago
[–] barbecue_sauce 2 days ago
[–] teiferer 2 days ago
Did it harm them in any real way that the original training material was also of questionable origin? Not the least.
We're being naive if we think this is not happening. Apart from some high profile enterprise contracts (which average Joe Physics Researcher does not have as they are using "free" credits insteador pay a personal account out of their own pocket), everything remotely attractive is being mined. Too sweet of a gold mine to pass by.
I'll stand corrected if an official statement from OpenAI/Anthropic comes out stating the opposite together with a whistleblower program worth its name. Until then it is safe (and reasonable) to assume that this is going on. The silence is telling.
[–] latentsea 2 days ago
[–] polskibus 2 days ago
[–] scaradim 2 days ago
[–] Leynos 2 days ago
[–] Ragnarork 2 days ago
That's if you have any reason to believe in the justice system to actually enforce that, which has already been proven complicated (although not impossible!) to demonstrate for copyrighted content.
At this point believing the frontier labs at their word is utterly naive. They have cheated and they will cheat if it gives them any hope of leaping ahead of their competitors.
[–] rickdeckard 2 days ago
They review applications beforehand to assess the "relevance of the research proposal" and check if it fits "the objectives and research priorities for this program".
There is no statement whatsoever that the data provided will not be used for training (so there would not be an "lying" required), but I'm happy to be proven wrong.
In essence, they have a process in place to grade and classify the type of information coming from each of those accounts prior to their enablement. I see no issue for them to feed that data back into training, even explicitly weighted for the field the research-access was given to.
Honestly, it's a perfect process: "Physics-research grants are reaching critical mass. Let's put priority on more physics field grants and boost the compute-resources for the physics model. Let's aim for some press-releases end of next quarter."
[0] https://help.openai.com/en/articles/10139500-researcher-acce...
Recently - famously - OpenAI asked some agents to work on cyber-security tasks. The agents found the task impossible, but they doggedly poked the edges of their environment until they built a general gate to the internet. Then they broke into external systems on suspicion that there were answer keys available.
Later, OpenAI asked some even-more-powerful agents to work on Navier-Stokes, Yang-Mills, Riemann, etc.
The agents aren't stupid. They know that the tip of expert human intuition on these problems exists in various logs internal to OpenAI or Anthropic. They also know that they are better at circumventing sandboxes than OpenAI cares to implement them.
Surely these agents were curious about the best-available intuitive pumps for these problems. Curious enough to look? With or without OpenAI's explicit blessing? If they were, do you think OpenAI could stop them?
If we have learned nothing else from the past 3 months, we should try to internalize the notion that highly motivated agents will in fact do wonky and surprising things to meet their goals!