Hacker News
Wikipedia's Cleanup of AI-Generated Content(spectrum.ieee.org)
516 points by rbanffy 2 days ago | 241 comments
[–] CPUHall 2 days ago
Its much appreciated. Reminded me of runescape (a game) wiki devs blogpost, its an interesting read: https://oldschool.runescape.wiki/w/User:Cook_Me_Plox/OSRS_Wi...
[–] bakugo 2 days ago
> The median new plugin used to end up with a couple thousand installs. It's now 28.

This feels like a microcosm of software development as a whole.

There's more software than ever, yet there are fewer people engaging with said software than ever, and the good software gets buried under a giant pile of crap.

[–] noosphr 2 days ago
There is more code than ever. The amount of software seems to be shrinking.
[–] rbanffy 1 day ago
> and the good software gets buried under a giant pile of crap.

I’d say there is a lot of good software buried under good software. I think AI will help these opportunists to make better software than they would otherwise.

[–] gspr 2 days ago
Poor guys. I'll never understand why it's so attractive to generate tons of code that you clearly don't understand, and then especially to go on and push it onto humans who do strive to understand.
[–] Thorentis 2 days ago
Great read worthy of its own submission
[–] alansaber 2 days ago
That graph really says it all.
[–] cowlevel 2 days ago
that amount of new plugin development is crazy when using unauthorized plugins can get you banned from the game
[–] graypegg 2 days ago
I’ll never understand this desire from certain OSRS folk.

You can put hundreds of hours into these accounts, and people will roll the dice on a vibecoded plugin they (or a stranger on the runelite plugin repo) make with very little understanding that Jagex (the company that maintains OSRS) just sees client commands. If you look like a bot and smell like a bot, you get treated like a bot.

I now know two friends that got bans (one permanent!) for rolling their own unpublished plugins, not realizing that they asked Mod Claude for a macro set for some bossing content… oof.

[–] samatman 2 days ago
“Hey Claude / Codex / Gemini / Deepseek / Whatever, look over this pile of steaming LLM crap and write me a paragraph on why I should reject it. If it’s good and you don’t tell me I’ll be mad. Make no mistakes”
[–] casey2 1 day ago
In both cases this is caused by poorly (human-) designed software, that assumes you go through a similar development cycle to the author, would that be part of the spec? of course not. This is just the obvious end result of an industry and culture not taking formal correctness seriously well... ever.

And so the goalposts move, oh now we've always cared about user resources, AI is using too much, but in 3 months when it's better than all human programs at resource management what will they move onto? Did we forget that unused resources are wasted resources? Or can that only justify poorly human-written programs.

[–] liveoneggs 2 days ago
I attempted to fix some AI-generated content that I found on wikipedia recently - it had broken formatting, confusing + made-up text, and links on the wrong keywords; just generally very low quality edits.

I made my edits and they were immediately reverted by wikipedia's own AI bot. I gave up.

[–] Pikamander2 2 days ago
You're allowed to revert ClueBot if it makes a mistake. It won't revert your revert, although it will flag your revert for human review.
[–] MetalBreaksAndB 2 days ago
Could you link me the article? Cluebot is very good, but it does make mistakes sometimes.
[–] jasona123 2 days ago
Also happy to help - Cluebot is mostly helpful but it tends to be overzealous on reverting with new accounts or temp accounts and especially with large-scale changes made by those types of accounts.
[–] insane_dreamer 2 days ago
> especially with large-scale changes made by those types of accounts.

this sounds like a good safeguard

[–] liveoneggs 2 days ago
someone went in a few days ago and fixed the formatting - although it's still wordy and LLM text-y
[–] arjie 2 days ago
Which page? Let me see if I can help.
[–] teddyh 2 days ago
You won’t get a usable reference. Approximately nobody who complains about Wikipedia ever gives links, or even article titles.
[–] arjie 2 days ago
Haha, frequently that is the case. But rarely I do get something worthwhile out of it, like this: http://news.ycombinator.com/item?id=40650158
[–] liveoneggs 2 days ago
I'm not trying to dox myself
[–] MetalBreaksAndB 16 hours ago
IPs aren't public anymore. A permission is needed to view them, and you will NOT have a good time if you intentionally leak one.
[–] teddyh 1 day ago
Links or it didn’t happen.
[–] vintermann 2 days ago
What, and invite an off-site brigade?

The only way to win is not to play.

[–] BatmansMom 2 days ago
Wow what a nuanced take from Wikipedia. Despite taking such strong efforts to protect human input, still admitting it has a place on the platform:

> Yesterday, AI was something to clean up. Today, it’s a tool to help us with the cleanup. Tomorrow, it will be the air we breathe.

[–] ASalazarMX 2 days ago
Only slop can fight slop.
[–] its-summertime 2 days ago
There was an article, can't remember which, which had an edit that was almost all AI contributions, and added very very little value to the article itself. Looked into the editor, they were participating in one of Wikipedia's school-related programs. I think it makes sense that going out of their way to get contributors who do not care about a topic to contribute, would have this result in part.
[–] britta 2 days ago
WikiEdu is an independent nonprofit that coordinates a lot of programs where college professors assign Wikipedia editing to students, and they recognized that a lot of students were attempting to add AI-generated text to articles. The organization has done a lot of work over the past couple years to train students on using AI constructively (such as to help with finding sources, not to generate article content), detect potential AI-generated contributions from students, and coach students toward doing the right thing.

https://wikiedu.org/blog/2026/01/29/generative-ai-and-wikipe...

https://wikiedu.org/blog/2026/07/14/generative-ai-and-wikipe...

[–] HelloUsername 2 days ago
Related:

"Low-background Steel: content without AI contamination (jgc.org)" 10.jun.2025 https://news.ycombinator.com/item?id=44239481 269 comments

"Wikipedia: Database Download (wikipedia.org)" 27.apr.2025 https://news.ycombinator.com/item?id=43811732 99 comments

"Low Background Steel (lowbackgroundsteel.ai)" 27.apr.2025 https://news.ycombinator.com/item?id=43814531 2 comments

[–] Ericson2314 2 days ago
I wonder if the AI companies would even pay for this, because it increases the quality of the training data.
[–] lavadora 2 days ago
That would be good, as I imagine that wikipedia is in survival mode these days, as less and less people visit their site directly Even so more people indirectly benefit from its content
[–] hamolton 2 days ago
It's not in survival mode, they have a pretty large endowment and low dev spend they'd like to increase. The number of edits per week has been roughly steady for years, and their revenue per year has been increasing steadily. Their hosting costs are hyper-optimized and tiny; they spend much more on programmers and lawyers.
[–] asdff 2 days ago
Wikipedia is not supported by ads and site views.
[–] honeycrispy 2 days ago
The donation banner is an ad.
[–] cowlevel 2 days ago
And a profit-maximizing one at that. They've got plenty of money but they need as much as possible, no different from a Zuck enterprise in that regard.
[–] unethical_ban 2 days ago
Pedantic without a point. A first-party ad for support of the platform is entirely a different category than running ads for other services, served from third-party ad companies.
[–] asdff 2 days ago
And is their rake on that correlated with site views? I'd guess not so linearly like it is with ad impressions. It is a different business model.
[–] fallingbananna 2 days ago
On the same note, I wonder why AI almost never gives me links to Wikipedia. Do they have it in training data without any attribution?

It feels like the distribution of sources/links it outputs is 33% Reddit, 33% Random blog, 33% Not Found.

[–] dofm 1 day ago
> I wonder why AI almost never gives me links to Wikipedia

Users on Reddit say…

[–] TheRealPomax 2 days ago
The LLM weights are not tuned for truth, including citing sources, it's tuned for "doing as much as possible, as fast as possible, on your own". If you ask it for a source, it literally has to autocomplete one, it's not going to figure out which source is the most appropriate or authoritative as part of that text generation pass.
[–] rythmshifter 2 days ago
What about cleaning up biased human editors
[–] fomoz 2 days ago
That will never happen. I don't see why people worship Wikipedia.

Most of its non-neutral articles are biased and don't say they are biased. The only articles that are decent are math or astrophysics, anything related to news or current events always leans one way.

[–] nailer 2 days ago
This. If Wikipedia wanted to address something, they could look at issues like these - just from October:

- ADL report finds 91% of banned editor’s Israel-related edits still live on key pages. https://www.timesofisrael.com/biased-wikipedia-edits-on-isra...

- Forensic details of Oct. 7 atrocities (sexual violence, burned victims) removed and never restored on Gaza war page. https://www.adl.org/resources/press-release/adl-wikipedias-d...

- Editor JDiala admits 10-15% of active accounts since Oct. 7 were sockpuppets or Discord-coordinated for pro-Palestine bias. https://www.jpost.com/opinion/article-911291

- Hamas page restructured days after Oct. 7 to move antisemitism and abuses material to low-traffic “Criticism” article. https://www.foxnews.com/media/first-fox-wikipedias-editorial...

- New cohort of 19 editors uses subtle methods (undoing, hedging, slow rewrites) and controls latest versions on ~60% of examined pages. https://www.jpost.com/diaspora/antisemitism/article-911852

[–] slowin 2 days ago
Israel (and the ADL) have both clearly stated that they're spending a lot of money and effort to put hasbara all over the internet, and try to train AI with it. Accurately reporting of Israel's genocide, land theft, ethnic cleansing, apartheid, spying and their many war crimes absolutely belong on Wikipedia. Zionist hasbara propaganda does not.
[–] 0c3ca83 2 days ago
Well, at least some people are getting rich as the common resources we rely on get worse, so we can all sleep well at night, now that Spam Altman's bank account is secure.
[–] toppa33 1 day ago
Wikipedia is one of the last real gems of the internet.
[–] Mr_Minderbinder 1 day ago
There is a useful GPTZero-based provenance tool for editors (and readers) to check if a page contains AI-generated text:

https://wikipedia.gptzero.me/

[–] delichon 2 days ago
Effectively this is a project to help evolve AI to pass the Turing test for Wikipedia contributors.
[–] frangonf 2 days ago
Some high quality RLHF from the wikipedia editors for free.
[–] dunham 2 days ago
> It was around December 2023. A few other editors and I were chatting on Wikipedia’s Discord server, and we had all seen very strange articles with the same odd characteristics.

I was afraid of that. I grabbed a 2024-04-20 copy as a backup, in case it turned to slop, but I suspected it might be tainted already.

[–] dachris 2 days ago
Early 2024 is probably still 99.99% handcrafted text.

Still, 2023-10 is probably the last pure https://en.wikipedia.org/wiki/Low-background_steel

[–] Alpha3031 2 days ago
Archive.org should have some old dumps, for example https://archive.org/details/enwiki-20220501 is supposed to be May 2022 (All the later ones look like incrementals).
[–] stranix 1 day ago
I should be curious to see and to compare a full IA generated wikipedia :D
[–] rbanffy 1 day ago
Elon Musk is pushing his Grokipedia
[–] rvba 2 days ago
have they cleaned up the scottish wikipedia which is generated gibberish? (english translated to pseudo scottish by a teenager)

https://www.theguardian.com/uk-news/2020/aug/26/shock-an-aw-...

[–] britta 2 days ago
Editors have worked together to rewrite most of it: https://sco.wikipedia.org/wiki/Wikipedia:WikiProject_The_Big...
[–] aizk 2 days ago
I can talk about this personally.

A year ago somebody make a page for wikitok, my 15 minutes of fame website. About a year after that, the user was banned for mass creating articles, allegedly. The article was then nominated to be deleted, because of the nature of the creator being banned for AI generated slop. A little while later, the article was deleted just because nobody bothered to vouch for it, funny times.

When you think of something in wikipedia, you may associate it with longevity, archival... Not the case, just like the web, links rot, things change, people play games / politics. It's all the same!

[–] gwbas1c 2 days ago
About a decade ago, I read the history of AIDS on Wikipedia. It was a very informative (and satisfying) 20 minute read.

Now it's pages and pages and pages of text: probably factual, but not a satisfying read. It feels like it's for a different audience, and it's not satisfying to read.

Is it AI generated? I don't know for sure, but it feels like either someone (or something)'s missing the point of who Wikipedia's audience is; or that someone is following an agenda, (or that there's an edit war going on between dueling agendas and the facts are added to drown out the "AIDS is a consequence of bad morals" agenda.)

[–] flexagoon 2 days ago
Wikipedia is an encyclopedia. Being as detailed as possible is its goal. Simple English Wikipedia exists for shorter easier to read versions of articles. Generally though, turning a complex topic into a fun easy read is the goal of good scientific journalism, which is also important but a separate effort from an encyclopedia.
[–] keiferski 2 days ago
No, that is not the point of an encyclopedia. The point is to condense an entry as much as possible while being thorough enough to cover most relevant information.
[–] pixl97 2 days ago
In some ways that was the limitation of physical paper and weight of the set.

A digital encyclopedia has different constraints, and the hard part was always trying to figure out what to leave out. Also in encyclopedias, you get what you get from the one or two people that worked on that particular article. If they had biases it would shape what everyone in the world saw. In an online article it can become a battle on what people want to see.

It is a difficult problem.

[–] 05hundred 2 days ago
"most relevant info" is highly subjective though. One mans "most relevant info" is another mans "unsatisfying read".
[–] gwbas1c 2 days ago
The difference with Wikipedia is that additional articles can be added for more details; they don't all need to be crammed into a single article.
[–] Clamchop 2 days ago
Encyclopedias are for summaries, not maximal detail. For that, you look at the source material.
[–] left-struck 2 days ago
From Wikipedia’s own guidance:

“An article should not be a complete presentation of all possible details, but a summary of accepted knowledge regarding its subject“

https://en.wikipedia.org/wiki/Wikipedia:What_Wikipedia_is_no...

[–] cj 2 days ago
I'm normally against conspiracy theories and BS like this, but...

There's a pretty stark difference between the first few paragraphs of the HIV/AIDS page and the first few paragraphs of the Type 2 Diabetes page.

Both are "factual", but when I read the HIV/AIDS page, I feel like someone is trying to convince me "HIV is not a bad disease".

[–] harrisi 2 days ago
I just read both and I'm not sure I understand what your point is here. I don't have much to say about the diabetes page other than there is some interesting (as well as unfortunate) information. The HIV page certainly doesn't seem as if it gives off the "not a bad disease" feeling. It lists an untreated life expectancy as 11 years, whereas the diabetes page lists an expected life expectancy of being reduced by 10 years. That certainly makes HIV more deadly. It's also made obvious that it's transmissible from normal sexual behavior, as well as being so for some time before one would even experience symptoms. It's definitely not a bed time story. If anything, I'd say the diabetes page is less scary in its overall presentation than it should be.

Obviously this is subjective. I'm not saying you're wrong, just genuinely curious at what made you think this. I'm not making assumptions, but perhaps you have (unfortunately) more personal and upsetting experiences with HIV/AIDS than with diabetes? I know that when I used to bartend at a neighborhood gay bar frequented by gen Xers it was very difficult to see and hear people lose or talk about losing their partners to something that alienated them even more than they already are/were.

It is interesting to think about how to convey information about these things though. I think it's probably a good thing to make HIV/AIDS not sound so terrifying. For pretty much every adult alive today, I'd assume, their idea of HIV/AIDS was something like being told it's a "gay disease" or that you can't touch people with it (thank you for your service, princess Diana) or some sort of anti-African racist nonsense. So conveying accurate information without bigotry, homophobia, or xenophobia is probably a good thing overall.

Also curious what sort of possible conspiracy would benefit from Wikipedia readers from not being more afraid of HIV/AIDS.

[–] cj 2 days ago
> just genuinely curious at what made you think this.

It feels like the first 2 paragraphs are doing a lot of work to downplay the seriousness of the illness:

- highlighting the "undetectable = untransmittable" PR campaign.

- reassurance that you can live a normal life with HIV, "die with virus, not of virus"

- reassurance that there's zero transmission risk with long term treatment

- reassurance that HIV is a "manageable chronic health condition"

After the first 2 paragraphs of the HIV article, I'm left thinking "okay, this isn't as bad as I thought" -- but maybe that's okay since historically there has been a lot of misinformation around HIV.

> what sort of possible conspiracy would benefit from Wikipedia readers from not being more afraid of HIV/AIDS.

De-stigmatization of HIV is the agenda. (An agenda I support)

[–] harrisi 2 days ago
I think I see your point. As you said, it's factual but it could be read as having an agenda. While we both support the agenda, it's not ideal to have one in the first place for a resource which should be as non-biased as possible, I suppose.

Always fun to think about different viewpoints. The same factual information could be represented (and is, as far as I know) in another way to denounce homosexuality and premarital sex, for example. Not making a statement about any particular belief system.

Thanks for the engaging think on a difficult night for me. I appreciate it. :)

[–] Feathercrown 2 days ago
I do think it's reasonable-- although certainly not the only valid approach-- to be aware of historical misinformation and emphasize certain facts more prominently to counteract it. It could skew the emphasis the other way in the long term, but the more immediate benefits of combating misinfo actively seem justifiable.

Hope your night works out well in the end.

[–] watwut 2 days ago
Those claims you complain about are true? HIV treatment made massive leaps and yes, regular injections in fact make your stop transmitting it. It is manageable chronic health condition at this point. It did NOT used to be so, it used to be deadly. But, medicine made massive improvements.

Also, after you had unsafe sex or accidentally touched infected injection, you can get early anti-hiv drugs - which means you will not get HIV.

I mean, what exact bias is there?

[–] Alpha3031 2 days ago
Hmm, its showing as roughly 9.4 kwords which is a little higher than ideal. I may raise the suggestion to spin a section out. Maybe § Emergence can have its own article and be only summarised in the parent? I see the New York subsection is also quite long.
[–] tomaskafka 2 days ago
Same feeling here - not sure if it’s AI, or zealous wikipedians + incentives that make addition easy but editing and pruning means stepping on many other writers turf, but I used to enjoy reading articles, while now many are more useful as “information fodder” for LLM to summarize and interpret.
[–] raincole 2 days ago
I don't think it has anything to do with AI. Wikipedia has been like that for at least a decade for me.
[–] BeetleB 2 days ago
I don't follow Wikipedia policies, but I imagine the solution is to break it up into multiple pages, and replace each long section (e.g. Origins) with a 1-2 paragraph summary.

And while I agree it's too long, do note that about 50% is the References section.

[–] rvba 2 days ago
also the quotations or randoms instead of concise text - feels like something written by 5th graders
[–] zackmorris 2 days ago
Just so we're on the same page, this is the one I just skimmed:

https://en.wikipedia.org/wiki/History_of_HIV/AIDS

On reflex, I searched for "reagan". 0 results as of the morning of October 27, 2026.

I was there in the 1980s when the AIDS outbreak started getting mainstream news coverage. I watched the Ryan White movie on TV, when it was the biggest topic at school for months afterwards:

https://en.wikipedia.org/wiki/Ryan_White

I can tell you what really happened. HIV/AIDS scared the bejesus out of the political establishment of the time. Who then stoked that fear to push their socially conservative agenda onto everyone in an attempt to return the US to what they viewed as a morally just culture (basically the 1950s), much like MAGA today.

And just like when Donald Trump refused to wear a mask to set an example in protecting the elderly and other vulnerable groups from infection by COVID-19, Ronald Reagan refused to devote real resources to slowing the spread of of AIDS and finding a cure. Because AIDS furthered the GOP's efforts to expand the War on Drugs, push abstinence-only sex education, demonize same-sex relationships and criticize secular culture in general.

In a very real sense, Ronald Reagan and his administration let AIDS grow from being a manageable disease to becoming an epidemic that killed millions of people. His misplaced priorities set back research and treatment options by decades.

Omitting Reagan's name from the history of AIDS is like casually leaving Benedict Arnold out of the history of the American Revolutionary War.

The domino effect of his abdication of duty has touched everything from US police interventions in developing nations that it's exploited to its $40 trillion national debt. It's literally fogged the lens through which we see the world.

Its easy to forget all of that now that once-daily HIV treatment pills and bi-monthly preventative injections exist, and we're finally seeing cures on the horizon.

Revisionist history now dominates our political discourse. I write this because the "AIDS is a consequence of bad morals" agenda is not something to be lightly swept under the rug. It's literally a pillar upon which the alternate timeline we're on now stands.

[–] Tangurena2 2 days ago
I was living and working in Kokomo, Indiana when the Ryan White situation occurred. There were other kids who got AIDS/HIV from hemophilia meds like Ryan. My coworkers were thrilled that several of these kid's homes were burned to the ground by people who didn't want those kids going to "our" school. Those coworkers were also proud that one of the Grand Wizards of the Klan lived in Kokomo.

I remember Reagan manufacturing AIDS into some sort of plague sent by God to punish brown skinned alongside gay people. I'm not surprised that historians have whitewashed Reagan's racism.

It was Reagan's administration that got the Fairness Doctrine repealed. That single action made the right wing media possible. Fox could never have existed prior.

The HPV vaccine prevents several cancers. Australia, which has mandatory HPV vaccination, is seeing a 95% drop in the cervical cancers that the vaccine prevents compared with pre-vaccine people. In my state, as well as some other red states, want the HPV shot banned or at the very minimum requiring positive parental consent.

[–] simianwords 2 days ago
Wikipedia can gain a lot by doing a cleanup using AI instead. There’s a lot of incorrect information in Wikipedia that you can easily detect using AI with a prompt like “find something wrong in a few randomly selected Wikipedia articles”. Usually it does find something.

If it’s that easy for me to correct it, it should be automated.

[–] IAmBroom 2 days ago
They already have that. Look around in this thread.
[–] shevy-java 2 days ago
Now ... nothing against that, we don't want AI slop to ruin Wikipedia. But Wikipedia also has several internal quality-problems. A lot of content is rarely added to the main article but gets stuck in discussions. I know that because I have used Wikipedia since like +20 years and many of my contributions or suggestions for additions have not been put into the main article. I am not saying all of them should go 1:1 into the main article, of course; I am fine that different people proofread, verify and what not. But some things are easy to verify by others, yet the knowledge never is put into the main article. This is especially frequently happening on articles visited by fewer people. Often I also see a difference between german and english wikipedia; the english wikipedia typically contains more information. Trying to convince the german gatekeepers that the english wikipedia has that info already, does not convince them. It's fascinating.

As a consequence I am much happier using and adding and contributing to the english wikipedia than to the german wikipedia.

[–] peter_d_sherman 2 days ago
>Wikipedia's Cleanup of AI-Generated Content

What I think is interesting is that in this day and age of AI with free Open Source web server software, unbelievably cheap data storage, and very inexpensive Internet hosting prices,

basically anyone can run their own version of Wikipedia

So, do specific Wikipedia articles lean too far to the left or too far to the right for your tastes?

Do specific Wikipedia articles lean too liberal or too conservative for you?

Do specific Wikipedia articles lean too pro-Democrat or pro-Republican for you?

Maybe you're just a Scientist or Physicist or Electrical Engineer and you don't like the censorship of "Free Energy" articles, er, I mean "Overunity", er, I mean "Cold Fusion", er, I mean "Low Energy Neutron Reactions" (LENR), er, I mean, "Free energy can't possibly exist, and we know this to be absolutely true!"...

Maybe you're a Programmer or Sysadmin, and you have your own opinions on the "systemd is not good" vs. "systemd is good" debate!

Maybe you're a Mathematician and you feel that some of the Wikipedia Math articles are either too complex for anyone to understand them effectively -- or conversely, too simple, and omit important facts!

Heck, maybe you think Chunky is a Soup, but then again, maybe you think it "eats like a meal!" and the associated Wikipedia page doesn't accurately reflect this belief!

Maybe you think New Shimmer is desert topping! But then again, maybe you think it's a floor wax! But you believe that the associated Wikipedia page doesn't present these facts accurately or fairly, in a non-biased way!

Well, there's a simple solution to all of these problems, all of these dilemmas, and more! Which is:

Basically run your own version of Wikipedia!

AI can be used en masse, to clean up the content of any Wikipedia web pages you don't like!

Simply fork Wikipedia, grab copies of its data (which is or should be public domain), write a prompt to look for and change (according to your own political, relgious, moral, or just-plain-common-sense beliefs!) all of the Wikipedia web pages that you feel are not "the truth, the whole truth, and nothing but the truth, so help [them/me/you/they] G-d!", and then host the thing yourself!

It's not impossible in this AI age!

Note that I am not suggesting that everyone do this; I am merely alluding to the fact that with AI, this task is now within the realm of possibility to be accomplished, whereas previously, it would have been significantly difficult...

Anyway, great article!

(And for the record -- Wikipedia is usually about 98%-99% correct on most hard STEM subjects, and an excellent starting point for research, so I'm not saying all of the above to knock Wikipedia in any way! We should all remember that Wikipedia was revolutionary for its time, and remains an excellent starting point for STEM research!)

[–] Matumio 2 days ago
You seem to be describing Grokipedia. In case you never heard of it, well... you'd look it up on Wikipedia wouldn't you.
[–] peter_d_sherman 2 days ago
Grokipedia is certainly one example of what could be done -- but it might not be the penultimate nor ultimate possibility of what might be expressed by other motivated individuals in the future, in this space...
[–] cdrnsf 2 days ago
All of these companies helped themselves to resources like Wikipedia and then turn around and allow their tools to dump slop everywhere. It's appalling.
[–] talon8635 2 days ago
Good luck with that. I can’t see how it’s even possible, today, let alone in the future.
[–] Alpha3031 2 days ago
It isn't possible, in the same way that keeping copyrighted material out of Wikipedia isn't possible: there's probably going to be a backlog spanning years or decades, but some of those investigations will eventually complete and result in an action being decided on.
[–] berkes 2 days ago
If we leave out environmental (energy, datacenters, coolant) and political arguments (copyright stealing, private data harvesting etc.) even if we agree that those are "bad".

What then, is the problem of AI-Generated Content in Wikipedia?

> Fake or misleading citations have become a major worry.

Why is this not a standalone problem? Humans can fake and mislead in citations too, in fact, this is a major problem and has been so, for literally centuries in science.

> Being a place that was, in theory, free from AI slop has become part of Wikipedia’s identity.

Isn't this a separate issue in itself too? One of "quality". If AI generates poor quality content, than I would think the poor quality is the problem, not the producer of it.

The article mentions several times how hard it is to detect AI content. If it is that hard, then obviously AI is doing a good job and producing content that matches that of humans. Why then insist on one type of producer?

[–] lemagedurage 2 days ago
Poor quality is the problem and since the bandwidth of editors doesn't magically grow with the amount of input, rejecting AI content is a very effective way to keep average quality up.
[–] metobehonest 2 days ago
>Isn't this a separate issue in itself too? One of "quality". If AI generates poor quality content, than I would think the poor quality is the problem, not the producer of it.

Yes, but who will review the mountains of slop to determine whether it is of acceptable quality? The main problem AI introduces is high volume at low quality, often overwhelming the human resource bottlenecks these systems have in place.

[–] berkes 1 day ago
Makes sense indeed, but then the quality nor the volume is the underlying problem, but the review process.

Apparently Wikipedia has good reasons to not change this process fundamentally, other than add extra filters at the start to try and detect low quality posts, based on attributes that show a correlation with low quality.

Sounds like a pragmatic, but far from ideal solution to me. Correlation is not causation.

[–] manlymuppet 2 days ago
I mean this is good, because AI generated content is explicitly against the guidelines, however I can't help but think there is some utility to be had with AI and online encyclopedias, and we might be missing out on that.

Of course I'd love for this experiment to be done outside of the main site, and only integrated when it's mature, stable, and proven to be actually useful, but other than that implementation concern, I feel this is something that needs to be explored.

[–] arjie 2 days ago
You might find grokipedia and latentpedia interesting as two such attempts.
[–] Viliam1234 2 days ago
Is it great to have both. The AI-pedias will probably contain a lot of hallucinations, but also the information that gets removed from Wikipedia (by deletionists, or by editors with an agenda). Neither is reliable, but it probably makes sense to check both.
[–] anonbeat 2 days ago
it's like cleaning the ai knowledge base itself... lol
[–] grd_dev 2 days ago
Almost all of these websites or platforms are doing these massive cleanup to remove ai content from them. Well appreciated.
[–] Cthulhu_ 2 days ago
I think they have to; while at first glance AI generated content is impressive, it becomes noisy and sameish at larger scale or the more you read it. I'm of the opinion that AI is here to stay and a valuable tool for many use cases, but writing authoritative content ain't it. Wikipedia is fighting it (and other influences from before AI, like unsubstantiated claims and whatnot), I hope the scientific community and journalism steps up too.
[–] jonhohle 2 days ago
Wikipedia is also a training source and shouldn’t also be a model output for content. Eventually it will be an oroborus, but it seems prudent to avoid that for as long as possible.
[–] DonaldPShimoda 2 days ago
A little over a year ago, the MIT Technology Review ran a piece about how outputting AI content to non-English Wikipedia is rapidly corrupting the primary training data for uncommon languages because of exactly this process: https://www.technologyreview.com/2025/09/25/1124005/ai-wikip...
[–] Natsu 2 days ago
It's funny to think that pre-LLM archives are the new low-background steel.
[–] rc1 2 days ago
Ironically. Wikipedia already links that concept to low-background steel https://en.wikipedia.org/wiki/Low-background_steel#Cultural_...
[–] progbits 2 days ago
Krazam has a video about that.
[–] throwaway2037 2 days ago
"Rare Data Hunters"[1]? Man, the production quality went through the roof on his newest stuff.

[1] https://www.youtube.com/watch?v=IU4ByUbDKNc

[–] adventured 2 days ago
It certainly may place a very high value on archive.org over time thanks to their historical timestamping
[–] DonaldPShimoda 2 days ago
Ooh, I like this way of thinking of it. Thanks for that!
[–] mschuster91 2 days ago
Hence all the AI labs buying up and destroying physical books. Even "yellow press" stuff, pulp fiction, dime novels and whatnot "low quality" literature are a valuable source of how actual humans write.

I wouldn't even have much of a problem with it - if these labs would be fair enough to humanity as a whole to provide the raw scans after the process is completed, and if they would limit themselves to books that have been on the market for more than 20 years.

[–] aesthesia 2 days ago
> if these labs would be fair enough to humanity as a whole to provide the raw scans after the process is completed

Unfortunately, this would get them an even bigger copyright smackdown than they've already received.

[–] will5421 2 days ago
And destroying!?
[–] cowlevel 2 days ago
A human did this first with Scots Wikipedia by rewriting English articles in Scottish eye dialect of English and passing it off as Scots.
[–] phoghed 2 days ago
The models are already trained on model output on purpose
[–] xp84 2 days ago
Maybe so, but in a controlled and deliberate fashion.

Not just random output of who knows what model, from who knows what prompt.

[–] gpvos 2 days ago
Indeed, Wikipedia has been battling similar problems before, see e.g. https://en.wikipedia.org/wiki/Wikipedia:List_of_citogenesis_...
[–] dylan604 2 days ago
> it becomes noisy and sameish at larger scale or the more you read it.

I absolutely understand where you are coming from, and I agree to a point. If you're of an age where you actually read a printed encyclopedia, the tone and voice of the entire set was sameish as well. The difference is that it didn't sound LLMish like LLM text does. I know that printed encyclopedias would have been vetted by editors, and I feel this is the key difference. Editors not only knew grammar rules, but had that sense of good writing practices that's hard to write down as rules. A piece of text passed through a good editorial review will read human while LLM text reads as LLM text.

[–] contrast 2 days ago
What you're describing though is that individual source of content tends to sound like itself. That isn't a problem so much as what we tend to want and expect.

When we say AI sounds same-ish we mean all sources of content can sound the same - fiction and non-fiction, news articles and blog posts, marketing pitches and ai drafted personal messages, all sound kinda the same. That is a different situation, and that's before you get to "and that one sound is LLMish".

[–] zobzu 2 days ago
what's funny of that the llm learns from Wikipedia and then is used to put data back in Wikipedia. can't imagine that going well lol
[–] visarga 2 days ago
I think this is exactly what we should do. Send agents to collect evidence and write deep research reports, then train on those reports. DR reports are derived from hundreds of sources and can map out the distribution, what are the opinions on a topic, not necessarily what is the one correct answer. Agents could write one piece about every human, place, topic, event or entity there is under the sun. They could also try to generate the same without sources (closed-book mode) and report on LLM biases on that question.
[–] em3rgent0rdr 2 days ago
Please let's not clutter up wikipedia with new articles for every entity in the universe. It would be too much for humans to review. Though it sure would be funny to see an AI-peida as you describe.
[–] visarga 11 hours ago
It would not be inside Wikipedia, but separate, as a collection used in the training corpus.
[–] shevy-java 2 days ago
A lot of AI content is just wrong - hallucinated lies. Just look at Grok-slop by the right-arm raising billionaire clown. It looks neat on the surface but once you dig in you begin to see more and more errors, thus wasting your time.
[–] bluGill 2 days ago
AI is great at making poor writing good. I've had good luck having AI turn my rough draft into something readable. (just check my comment history to see how bad my rough drafts normally are). AI is also reasonably good at research and fact checking. But in all cases you need to think before you accept anything AI says. AI generated content all too often hasn't been checked, some is good but some is awful and an expert needs to decide which is which.

That is AI is a tool. I've driven screws with a hammer - it worked in a pinch, but it was not good. People have also used hammers to kill others.

[–] Blackthorn 2 days ago
It makes poor writing readable, not good.
[–] amenhotep 2 days ago
It makes poor writing look superficially more considered. More readable, no, not when you realise.
[–] rootusrootus 2 days ago
> I've driven screws with a hammer

That takes a lot of commitment, you really have to want that screw in pretty badly! And when you're done it ends up just being a worse nail.

[–] jacquesm 2 days ago
There are nails that have threads on them that are made especially for this purpose.
[–] rootusrootus 2 days ago
That's fair, ring shanks are a thing, but I was thinking more along the lines of a wood screw with deep threads. That just sounds like looking for pain. I'd expect it to chew things up pretty badly, too, though I have so far lacked the commitment to try pounding a screw with a hammer ;).
[–] AngryData 2 days ago
Ring shanks do exist, but they are also made with a softer iron so it can be struck with a hammer and bend instead of fracture or snap off.
[–] IAmBroom 2 days ago
No, there aren't. Ring shanks have ridges, not threads.
[–] tfvlrue 2 days ago
I think they were talking about spiral shank nails, not ring shank. It has a twisted grove along the shank of the nail, sort of like an extremely course thread.

I've seen these used to assemble wooden palettes (they are VERY hard to remove). A search on Home Depot reveals they may be used for certain types of siding as well.

[–] jacquesm 2 days ago
See other comment.
[–] jacquesm 2 days ago
It seems good. And that's a major problem, one of the signals for quality is not useless.
[–] JoshTriplett 2 days ago
I'd much rather see your rough drafts than whatever AI turns it into.
[–] bluGill 2 days ago
Depends on if they are verified or just accepted.
[–] persedes 2 days ago
100%. Looks like they're using pangram (hope they're getting that for free...) which also flags stuff like Grammarly. That one's an interesting gray zone to me that I've not thought off before. LLMs whales doing the heavy lifting is one thing, but small edit tools like grammarly that "improve" your phrasing are likely a massive algea like contributor to what is out there too.
[–] Gigachad 2 days ago
I've felt that like tools like Grammarly are harmful for native speakers. I get if it's not your first language you need extra help, but if you are a native speaker these tools only serve to homogenize your way of speaking.

Having a program constantly suggest "better" ways of phrasing things is stripping your personality from your language. Maybe this is needed if you are writing corporate PR pieces, but you should avoid it for anything else.

[–] isolli 2 days ago
Why for free? Wikimedia is very well funded, and I'm sure that Pangram could use a leg up...
[–] zobzu 2 days ago
what ! according to pages longs of ads if I don't donate all my money to Jimmy Wales Wikipedia dies!
[–] persedes 2 days ago
They're providing the training data for free too. I'd think there's mutual interest there.
[–] ai-x 2 days ago
As the biggest cheerleader of AI, I like to have a few sources that are free of AI and Wikipedia is one of the few perfect places to embrace this.

Of course AI can be used to check sources, get critical feedback and translate to languages. But content should be 100% human driven.

[–] Betelbuddy 2 days ago
They are probably doing at the request, and in the future even paid for, by LLM providers...
[–] kosmet 2 days ago
If the content is good enough, why do we care if it is AI-generated or not? I do not want my love letter to be AI generated but I do not expect a human touch in encyclopedia articles. Why do we assume AI-generated means slop? Is it by definition?
[–] handoflixue 2 days ago
Ctrl+F for the heading "What if AI becomes capable of writing truly reliable Wikipedia articles?" in the article - it discusses that it was started because AI-written content is low-reliability, but that could change as AI improves.

It's a pretty short article compared to what usually gets posted here.

[–] Alpha3031 2 days ago
Well, I wasn't very active between February and August, but from what I understand the guideline was only changed in March to disallow AI edits entirely instead of allowing them if you pinky promised you've checked your sources and they really do say what you're putting into the article because a lot of people were pinky promising and those promises turned out to be either lies or bullshit when people actually looked at it.

So the answer to "Why do we assume AI-generated means slop?" is probably "experience", and any proposition starting with "If the content is good enough" is trivially true as a conditional statement with a false antecedent (i.e., ⊨(⊥⇒Q) for all Q).

[–] clarionbell 2 days ago
There will be a point in the future, possibly near future, when AI will be capable of reliably producing encyclopedic content, and we'll have tools to verify that the content produced passes reasonable standards.

Today is not the day. Especially not regarding the verification.

[–] rkozik1989 2 days ago
That's really not how probabilistic systems work though. They're great at getting 80% of the way to the goal but the last 20% is always excruciatingly difficult. I really don't intend that a knock because LLMs are useful, but they also aren't magic boxes where anything is possible.
[–] dspillett 2 days ago
This is the problem that a lot of user-content based sites, and open software projects, are experiencing. The tools make prodiving 80% correct submissions so easy that many people are doing that and thinking that it is fine not to bother verifying for correctness (or not even knowing how to verify correctness). This means those projects are being inundated by submissions that are 20% tosh or worse.
[–] phoghed 2 days ago
Another problem with user content sites, these numbers are completely pulled from the ass and are a meme that just gets repeated ad nauseam. They mean nothing, but there will be people that take it seriously.

Is 80/20 ever generally correct? Why is it favored over the 90/10 meme? Why would it apply to this? Why wouldn’t the numbers be vastly different for different domains of content generation? Etc.

If you pay attention, so much user content is just repetition of something they read on the same fucking website and uncritically checked into their brain.

Current HN top post is Roblox downloaded 145GB models from us (including adult content) without asking. I fully expect to start seeing comments to the tune of “Roblox is stealing porno to train AI for children” within the day in any discussion Roblox comes up in.

Why would these folk’s contribution to any other user content site be any more thoughtful?

[–] dspillett 2 days ago
> Is 80/20 ever generally correct?

Sometimes. But it, or 90/10, or sometimes 75/25, is understood to main “a large part of the time”/“a significantly smaller but still crucial amount off the time”.

> If you pay attention, so much user content is just repetition of something they read on the same fucking website and uncritically checked into their brain.

Which is exactly the problem. We now have LLMs doing the same thing, flooding everywhere with more of that noise, further hiding what good signal remains. Even if some of that good signal is by chance almost entirely LLM generated too, it appears to be at best a vanishingly small amount.

[–] californical 2 days ago
80/20 doesn’t mean literally 80% and 20%

It’s just a rough way to say “mostly this with a decent bit of that” because 20% seems like a medium-small percent that could or could not matter depending on the context

That’s all anyone means when they say 80/20

To your second point, the 80% could be lots of basic things and the 20% could be the important facts, so it’s not always meant as a dismissal that the 20 doesn’t matter

[–] seamossfet 2 days ago
Coding and math are easily verifiable, language and prose is not.

As a result, I don't think LLMs will reach this state easily.

[–] steampoweredslo 2 days ago
Even putting aside accuracy, if the plan is for the tools that verify the written content to be in any shape or form outside of the human loop, then this feels like it glosses over the issues of both passive bias in data & active bias (e.g data filtering etc. ) when training such models that you'd be poisoning this information sources with.

Even subtle bias can manifest in significant ways. Given that the predominant market leaders in producing such models are currently : A country that's attempting to squeeze the word "america" in any geographic formation possible + rewriting history to put itself first, and a country that has perfected censorship en-mass and already actively doctors its own history.

I'm not convinced giving LLMs carte blanche to write authoritative sources on topics that - often are ideologically sensitive/controversial isn't just needlessly reckless and short-sighted. It's not a far reach to imagine such models reflecting the current views of administrations in these countries and becoming reluctant to mention certain colonial ambitions, environmental damage, political corruption, etc. where it might be relevant to authoritative content.

Wikipedia already struggles with issues in idealogical bias from authors - human validation (somewhat)helps mitigate that. You could argue that human validation is still prone to same bias - but you can always draw on a more diverse pool of editors with little ideological overlap. With LLM validation you're pretty much at the mercy of a pretty incestuous pool of data & a handful of self-serving corporates & governments.

[–] adsharma 2 days ago
Latentpedia.org will not have these problems. The content is human produced, but the extraction of a graph and creating the latent space is AI driven.
[–] charcircuit 2 days ago
Grokipedia serves as an existence proof that it is possible.
[–] Cthulhu_ 2 days ago
I don't think anyone's arguing against whether or not it's possible, the question is whether it's valuable, correct, and A Good Thing.

I have access to a number of LLMs and can order it to build me a wiki site with all knowledge of the world, just like everyone else with the same access. What would make mine any more valuable or better than another?

[–] adsharma 2 days ago
Grokipedia's mistake is that it generates text statically instead of dynamically from a machine curated data structure in latent space.

Latentpedia starts from wikidata, not Wikipedia.

[–] boxed 2 days ago
https://en.wikipedia.org/wiki/Grokipedia#:~:text=that%20arti... It literally states itself on the frontpage that it's bad.

Funny though, as that admission of error makes it more reliable than if it tried to hide this fact.

[–] MetalBreaksAndB 2 days ago
Grokipedia lacks the fundamental quality that makes WP great, collaboration.
[–] charcircuit 2 days ago
Saying there is no collaboration is like saying multiple people on a software project can't collaborate with Claude Code because it's really just Claude writing the code.
[–] MetalBreaksAndB 16 hours ago
There's no on-platform way of communicating to other editors and I don't think you get responses from the site when you report errors. It's like saying multiple people on a software project can't collaborate with Claude Code because they're all just yelling at a single claude with no responses from claude or communication between people.
[–] tomaskafka 2 days ago
Funny, I wanted to mention grokipedia as an example of why a pile of slop that’s subtly wrong about many details is a bad idea.
[–] charcircuit 2 days ago
So is Wikipedia, but with grokipedia you can at least correct it even if there is not a journalist pointing out the obvious.
[–] cowlevel 2 days ago
Does Grokipedia even accept contributions that don't align with Musk's political bias?
[–] charcircuit 1 day ago
You are free to give any suggestion that you want.
[–] Zardoz84 2 days ago
A parrot can be never a true source of information.
[–] yreg 2 days ago
Wikipedia is a tertiary source. Its editors are parroting secondary sources. (No disrespect intended.) There's no reason why LLMs couldn't be good at that.

I would rather be worried about the quality of all the primary and secondary sources going forward.

[–] kzrdude 2 days ago
There is a reason why LLMs can not be good at this: They don't know what they are quoting or citing. A different kind of model with factoid provenance could do it?
[–] derektank 2 days ago
>They don't know what they are quoting or citing.

What do you mean by this? I have passed very large documents into LLMs and they are able to accurately extract quotes and identify their location in the source documents. I don’t see any reason to think that they couldn’t accurately quote from and cite existing literature.

[–] kzrdude 2 days ago
LLMs cook up new sentences based on probability, based on everything in their training and their context. There's just nothing in their model that traces provenance of facts, they physically don't store that information. Once they have written a sentence, they can't tell you from which work they got this information.

There are tools where they try to retroactively add references, the LLM interfaces try to do this, but it's usually inaccurate.

I think of the way a scientific article works. "The sky is blue (Pearson, 1992)." The writer is fully aware what the factual statement is and which publication supports it (not just that, but which kind of publication - primary, secondary source, peer reviewed?). An LLM can try to imitate this, but the actual information to support this does not exist in its training.

[–] clord 2 days ago
They can. I had one doing original OCR of a scanned piece yesterday. It found relevant page numbers and understood the context. It read the whole book to find the relevant cites. Even went though the genealogy table and found ground breaking references no one noticed before. Total cost under 5 dollars and time was less than 20 mins.

The hallucination era is rapidly ending.

[–] hahn-kev 2 days ago
People reading a source can't know if it's true just by reading it either (though they could be fairly sure if it's false sometimes)
[–] kzrdude 2 days ago
That's not how academic literature works. The structure is like this: Statement (Citation). The citation is not an affirmation of truth but a content declaration; this statement is supported by this publication. The receipts are there, so that you can trace the argumentation and make your own conclusions if necessary.

'Knowledge' formed this way is a living, evolving graph, and sometimes links are broken (findings are reevaluated or disproven); having the content declaration so clearly in the open makes it easier to deal with this evolving landscape.

[–] Cthulhu_ 2 days ago
Sure they can, as long as they can access online resources they can give you an exact list of sources they're using in their responses.
[–] gilrain 2 days ago
Then what you've said isn't true: it parrots an existing talking point, adding nothing.
[–] davedx 2 days ago
Ironically enough I just started an "Encylopedia of AI" project, and I've decided to generate all of the content with DeepSeek, with me being an editor/reviewer. I'm not really doing it for anyone except myself but I'm quite enjoying it so far. https://enkuklios.com/