News for hackers. Stuff that matters.
Re:Wikipedia's Cleanup of AI-Generated Content by grd_dev on Tuesday October 27, 2026 @08:53AM (#50258388)
Almost all of these websites or platforms are doing these massive cleanup to remove ai content from them. Well appreciated.
Re:Wikipedia's Cleanup of AI-Generated Content by Cthulhu_ on Tuesday October 27, 2026 @09:41AM (#50259175)
I think they have to; while at first glance AI generated content is impressive, it becomes noisy and sameish at larger scale or the more you read it. I'm of the opinion that AI is here to stay and a valuable tool for many use cases, but writing authoritative content ain't it. Wikipedia is fighting it (and other influences from before AI, like unsubstantiated claims and whatnot), I hope the scientific community and journalism steps up too.
Re:Wikipedia's Cleanup of AI-Generated Content by jonhohle on Tuesday October 27, 2026 @10:10AM (#50259648)
Wikipedia is also a training source and shouldn’t also be a model output for content. Eventually it will be an oroborus, but it seems prudent to avoid that for as long as possible.
Re:Wikipedia's Cleanup of AI-Generated Content by DonaldPShimoda on Tuesday October 27, 2026 @10:14AM (#50259720)
A little over a year ago, the MIT Technology Review ran a piece about how outputting AI content to non-English Wikipedia is rapidly corrupting the primary training data for uncommon languages because of exactly this process: https://www.technologyreview.com/2025/09/25/1124005/ai-wikip...
Re:Wikipedia's Cleanup of AI-Generated Content by Natsu on Tuesday October 27, 2026 @11:53AM (#50261153)
It's funny to think that pre-LLM archives are the new low-background steel.
Re:Wikipedia's Cleanup of AI-Generated Content by progbits on Tuesday October 27, 2026 @12:10PM (#50261384)
Krazam has a video about that.
Re:Wikipedia's Cleanup of AI-Generated Content by throwaway2037 on Wednesday October 28, 2026 @12:32AM (#50269381)
"Rare Data Hunters"[1]? Man, the production quality went through the roof on his newest stuff.

[1] https://www.youtube.com/watch?v=IU4ByUbDKNc

Re:Wikipedia's Cleanup of AI-Generated Content by adventured on Tuesday October 27, 2026 @12:11PM (#50261387)
It certainly may place a very high value on archive.org over time thanks to their historical timestamping
Re:Wikipedia's Cleanup of AI-Generated Content by DonaldPShimoda on Tuesday October 27, 2026 @12:29PM (#50261655)
Ooh, I like this way of thinking of it. Thanks for that!
Re:Wikipedia's Cleanup of AI-Generated Content by mschuster91 on Tuesday October 27, 2026 @01:15PM (#50262420)
Hence all the AI labs buying up and destroying physical books. Even "yellow press" stuff, pulp fiction, dime novels and whatnot "low quality" literature are a valuable source of how actual humans write.

I wouldn't even have much of a problem with it - if these labs would be fair enough to humanity as a whole to provide the raw scans after the process is completed, and if they would limit themselves to books that have been on the market for more than 20 years.

Re:Wikipedia's Cleanup of AI-Generated Content by aesthesia on Tuesday October 27, 2026 @01:42PM (#50262855)
> if these labs would be fair enough to humanity as a whole to provide the raw scans after the process is completed

Unfortunately, this would get them an even bigger copyright smackdown than they've already received.

Re:Wikipedia's Cleanup of AI-Generated Content by sho_hn on Tuesday October 27, 2026 @08:06PM (#50267670)
Wait, they received a copyright smackdown? When?
Re:Wikipedia's Cleanup of AI-Generated Content by aesthesia on Thursday October 29, 2026 @12:42PM (#50291955)
Re:Wikipedia's Cleanup of AI-Generated Content by will5421 on Tuesday October 27, 2026 @01:28PM (#50262616)
And destroying!?
Re:Wikipedia's Cleanup of AI-Generated Content by frozenseven on Tuesday October 27, 2026 @07:27PM (#50267340)
So, just like libraries and retailers already do?
Re:Wikipedia's Cleanup of AI-Generated Content by matkoniecz on Tuesday October 27, 2026 @02:03PM (#50263253)
From my understanding, they are legally obligated to in this case.
Re:Wikipedia's Cleanup of AI-Generated Content by shevy-java on Tuesday October 27, 2026 @03:21PM (#50264371)
The Holy Inquisition was also required to burn witches in the medieval era.

That does not really make it a law though.

Re:Wikipedia's Cleanup of AI-Generated Content by Natsu on Tuesday October 27, 2026 @04:37PM (#50265432)
It's copyright law, they're not supposed to have extra copies of the work, just one.
Re:Wikipedia's Cleanup of AI-Generated Content by msla on Tuesday October 27, 2026 @04:47PM (#50265574)
What do you think bookstores do?

https://en.wikipedia.org/wiki/Stripped_book

> A stripped book is a mass market paperback that has been stripped of its cover in order to be recycled. The covers are returned to the publisher as evidence that the books have been destroyed and to obtain a credit on the purchase price.[1] The books are meant to be destroyed by pulping but some find their way to street merchants, sometimes by illegal means, and are resold.[2]

I grew up reading books with this ditty in them:

> If you purchased this book without a cover you should be aware that this book is stolen property. It was reported as “unsold and destroyed” to the publisher and neither the author nor the publisher has received any payment for this “stripped book.”

Those books certainly weren't scanned before being pulped. Would've been illegal. Really, the big thing that destroys books is the copyright term being as long as it is.

Re:Wikipedia's Cleanup of AI-Generated Content by paradox460 on Tuesday October 27, 2026 @07:33PM (#50267392)
Every tor SF book I've ever read had that. Neat little bit of history
Re:Wikipedia's Cleanup of AI-Generated Content by DonaldPShimoda on Tuesday October 27, 2026 @05:51PM (#50266354)
AI companies weren't buying up tons of unsold mass-market materials, and I think it's disingenuous to even make the comparison.

What was going on recently was AI companies were specifically seeking out rare — or sometimes irreplaceable — books to supplement their data sets (and hopefully getting a leg up on their competitors). The destruction of the books wasn't the point, it was just a consequence of the business-oriented realization that they could scan the contents of more books faster if they just chopped off the bindings rather than investing the time to care for the books and keep them intact (plus supposedly playing along with copyright law by "only having one copy of the copyrighted material").

Re:Wikipedia's Cleanup of AI-Generated Content by msla on Wednesday October 28, 2026 @09:31PM (#50283401)
> What was going on recently was AI companies were specifically seeking out rare

A lot of worthless books are rare. That was what people in the trade call "Clickbait"; in that it isn't technically a lie but it sure ain't the truth.

> The destruction of the books wasn't the point

It was to the people who shared the stories for clicks and outrage farming.

Re:Wikipedia's Cleanup of AI-Generated Content by rc1 on Tuesday October 27, 2026 @06:05PM (#50266499)
Ironically. Wikipedia already links that concept to low-background steel https://en.wikipedia.org/wiki/Low-background_steel#Cultural_...
Re:Wikipedia's Cleanup of AI-Generated Content by cowlevel on Tuesday October 27, 2026 @01:16PM (#50262442)
A human did this first with Scots Wikipedia by rewriting English articles in Scottish eye dialect of English and passing it off as Scots.
Re:Wikipedia's Cleanup of AI-Generated Content by phoghed on Tuesday October 27, 2026 @10:12AM (#50259694)
The models are already trained on model output on purpose
Re:Wikipedia's Cleanup of AI-Generated Content by xp84 on Tuesday October 27, 2026 @11:51AM (#50261123)
Maybe so, but in a controlled and deliberate fashion.

Not just random output of who knows what model, from who knows what prompt.

Re:Wikipedia's Cleanup of AI-Generated Content by rightnutwingjob on Tuesday October 27, 2026 @11:59AM (#50261233)
Unsubstantiated claims is one thing.

If it doesn’t act to fix the politically Left biased perennial sources list, it will continue to be a propaganda machine.

Re:Wikipedia's Cleanup of AI-Generated Content by piperswe on Tuesday October 27, 2026 @12:02PM (#50261269)
...accurate username? I'm genuinely not sure if this comment is satire or not
Re:Wikipedia's Cleanup of AI-Generated Content by NichoPaolucci on Tuesday October 27, 2026 @12:12PM (#50261412)
Not picking a side, but do you really think that language models should have a political bias? I personally don't interface with AI in a way that engages political / social bias - but if I did I definitely wouldn't want that to be predetermined, whether left or right.

Though, with the safeguards put into place on these models, they are naturally going to have SOME amount of bias, but we should be working to minimize that, no?

Re:Wikipedia's Cleanup of AI-Generated Content by autoexec on Tuesday October 27, 2026 @12:25PM (#50261593)
Ideally an AI model's output would have a basis in reality which already means it will be considered "Left biased propaganda" by conservatives.
Re:Wikipedia's Cleanup of AI-Generated Content by ipaddr on Tuesday October 27, 2026 @12:55PM (#50262073)
I always thought left wing politics had little basis in reality from transitioning babies to deplatforming scientist for practising science.
Re:Wikipedia's Cleanup of AI-Generated Content by autoexec on Tuesday October 27, 2026 @01:46PM (#50262951)
> I always thought left wing politics had little basis in reality from transitioning babies to deplatforming scientist for practising science.

That does sound like exactly the kinds of lies that a good model would want to avoid, but which conservatives would believe, along with "Climate change isn't real", "There is a war on Christmas", and "Trump won the 2020 presidential election"

Re:Wikipedia's Cleanup of AI-Generated Content by ipaddr on Tuesday October 27, 2026 @08:33PM (#50267875)
Biden was fully functional. Putting on a mask as you walk to your dinner table only to take it off will prevent catching covid. A guy in a dress can get a period.
Re:Wikipedia's Cleanup of AI-Generated Content by asveikau on Tuesday October 27, 2026 @01:16PM (#50262431)
The issue is when people flag neutral information as having a political bias.
Re:Wikipedia's Cleanup of AI-Generated Content by Retric on Tuesday October 27, 2026 @01:23PM (#50262548)
There’s models created by people with heavy right wing affiliation, but it’s harder than you think to bias models consistently because political beliefs are so broad reaching.

Calling out bias however is a standard practice for groups whose beliefs don’t match reality. You see that on political extremes, but also revisionist history, many religious groups, conspiracy theories, etc.

Re:Wikipedia's Cleanup of AI-Generated Content by bunderbunder on Tuesday October 27, 2026 @01:27PM (#50262600)
There's really no such thing as no bias, because bias in the eye of the beholder.

The worrying thing about using LLMs to do the "thinking" about what to say and how to say it is that you replace a plurality of human biases with the opinions of the small number of people who get to decide how these models are trained. Which will only seem unbiased if the bias baked into the LLM happens to align with your own.

Re:Wikipedia's Cleanup of AI-Generated Content by piperswe on Tuesday October 27, 2026 @01:45PM (#50262933)
Everything always has bias, and nothing is ever neutral. Claiming something is "unbiased" just means you either don't know or don't care what bias it has.

(ultimately I believe objectivity is somewhat of a lie we tell ourselves, but that's a discussion for another time)

Re:Wikipedia's Cleanup of AI-Generated Content by bluGill on Tuesday October 27, 2026 @10:54AM (#50260318)
AI is great at making poor writing good. I've had good luck having AI turn my rough draft into something readable. (just check my comment history to see how bad my rough drafts normally are). AI is also reasonably good at research and fact checking. But in all cases you need to think before you accept anything AI says. AI generated content all too often hasn't been checked, some is good but some is awful and an expert needs to decide which is which.

That is AI is a tool. I've driven screws with a hammer - it worked in a pinch, but it was not good. People have also used hammers to kill others.

Re:Wikipedia's Cleanup of AI-Generated Content by Blackthorn on Tuesday October 27, 2026 @11:03AM (#50260452)
It makes poor writing readable, not good.
Re:Wikipedia's Cleanup of AI-Generated Content by amenhotep on Tuesday October 27, 2026 @09:09PM (#50268125)
It makes poor writing look superficially more considered. More readable, no, not when you realise.
Re:Wikipedia's Cleanup of AI-Generated Content by rootusrootus on Tuesday October 27, 2026 @10:57AM (#50260368)
> I've driven screws with a hammer

That takes a lot of commitment, you really have to want that screw in pretty badly! And when you're done it ends up just being a worse nail.

Re:Wikipedia's Cleanup of AI-Generated Content by jacquesm on Tuesday October 27, 2026 @11:18AM (#50260656)
There are nails that have threads on them that are made especially for this purpose.
Re:Wikipedia's Cleanup of AI-Generated Content by rootusrootus on Tuesday October 27, 2026 @11:36AM (#50260920)
That's fair, ring shanks are a thing, but I was thinking more along the lines of a wood screw with deep threads. That just sounds like looking for pain. I'd expect it to chew things up pretty badly, too, though I have so far lacked the commitment to try pounding a screw with a hammer ;).
Re:Wikipedia's Cleanup of AI-Generated Content by jacquesm on Tuesday October 27, 2026 @02:08PM (#50263332)
Re:Wikipedia's Cleanup of AI-Generated Content by IAmBroom on Tuesday October 27, 2026 @01:14PM (#50262404)
No, there aren't. Ring shanks have ridges, not threads.
Re:Wikipedia's Cleanup of AI-Generated Content by jacquesm on Tuesday October 27, 2026 @02:09PM (#50263335)
See other comment.
Re:Wikipedia's Cleanup of AI-Generated Content by tfvlrue on Tuesday October 27, 2026 @10:02PM (#50268483)
I think they were talking about spiral shank nails, not ring shank. It has a twisted grove along the shank of the nail, sort of like an extremely course thread.

I've seen these used to assemble wooden palettes (they are VERY hard to remove). A search on Home Depot reveals they may be used for certain types of siding as well.

Re:Wikipedia's Cleanup of AI-Generated Content by jacquesm on Tuesday October 27, 2026 @10:23PM (#50268623)
'coarse'

I built a house with them. You really want to check twice if you're putting them in where you want them because getting them out is - as you noted - annoyingly difficult. But they're very nice for large surfaces that are going be battered by the wind, they're much longer than your typical screw and working with them is very fast.

Re:Wikipedia's Cleanup of AI-Generated Content by AngryData on Wednesday October 28, 2026 @12:47AM (#50269438)
Ring shanks do exist, but they are also made with a softer iron so it can be struck with a hammer and bend instead of fracture or snap off.
Re:Wikipedia's Cleanup of AI-Generated Content by jacquesm on Tuesday October 27, 2026 @11:17AM (#50260643)
It seems good. And that's a major problem, one of the signals for quality is not useless.
Re:Wikipedia's Cleanup of AI-Generated Content by JoshTriplett on Tuesday October 27, 2026 @12:33PM (#50261714)
I'd much rather see your rough drafts than whatever AI turns it into.
Re:Wikipedia's Cleanup of AI-Generated Content by bluGill on Tuesday October 27, 2026 @02:24PM (#50263565)
Depends on if they are verified or just accepted.
Re:Wikipedia's Cleanup of AI-Generated Content by dylan604 on Tuesday October 27, 2026 @12:54PM (#50262051)
> it becomes noisy and sameish at larger scale or the more you read it.

I absolutely understand where you are coming from, and I agree to a point. If you're of an age where you actually read a printed encyclopedia, the tone and voice of the entire set was sameish as well. The difference is that it didn't sound LLMish like LLM text does. I know that printed encyclopedias would have been vetted by editors, and I feel this is the key difference. Editors not only knew grammar rules, but had that sense of good writing practices that's hard to write down as rules. A piece of text passed through a good editorial review will read human while LLM text reads as LLM text.

Re:Wikipedia's Cleanup of AI-Generated Content by zobzu on Tuesday October 27, 2026 @12:58PM (#50262121)
what's funny of that the llm learns from Wikipedia and then is used to put data back in Wikipedia. can't imagine that going well lol
Re:Wikipedia's Cleanup of AI-Generated Content by visarga on Tuesday October 27, 2026 @01:44PM (#50262901)
I think this is exactly what we should do. Send agents to collect evidence and write deep research reports, then train on those reports. DR reports are derived from hundreds of sources and can map out the distribution, what are the opinions on a topic, not necessarily what is the one correct answer. Agents could write one piece about every human, place, topic, event or entity there is under the sun. They could also try to generate the same without sources (closed-book mode) and report on LLM biases on that question.
Re:Wikipedia's Cleanup of AI-Generated Content by em3rgent0rdr on Tuesday October 27, 2026 @06:34PM (#50266817)
Please let's not clutter up wikipedia with new articles for every entity in the universe. It would be too much for humans to review. Though it sure would be funny to see an AI-peida as you describe.
Re:Wikipedia's Cleanup of AI-Generated Content by visarga on Thursday October 29, 2026 @04:12PM (#50295119)
It would not be inside Wikipedia, but separate, as a collection used in the training corpus.
Re:Wikipedia's Cleanup of AI-Generated Content by contrast on Tuesday October 27, 2026 @04:28PM (#50265315)
What you're describing though is that individual source of content tends to sound like itself. That isn't a problem so much as what we tend to want and expect.

When we say AI sounds same-ish we mean all sources of content can sound the same - fiction and non-fiction, news articles and blog posts, marketing pitches and ai drafted personal messages, all sound kinda the same. That is a different situation, and that's before you get to "and that one sound is LLMish".

Re:Wikipedia's Cleanup of AI-Generated Content by shevy-java on Tuesday October 27, 2026 @03:20PM (#50264356)
A lot of AI content is just wrong - hallucinated lies. Just look at Grok-slop by the right-arm raising billionaire clown. It looks neat on the surface but once you dig in you begin to see more and more errors, thus wasting your time.
Re:Wikipedia's Cleanup of AI-Generated Content by gpvos on Tuesday October 27, 2026 @03:20PM (#50264360)
Indeed, Wikipedia has been battling similar problems before, see e.g. https://en.wikipedia.org/wiki/Wikipedia:List_of_citogenesis_...
Re:Wikipedia's Cleanup of AI-Generated Content by persedes on Tuesday October 27, 2026 @11:06AM (#50260479)
100%. Looks like they're using pangram (hope they're getting that for free...) which also flags stuff like Grammarly. That one's an interesting gray zone to me that I've not thought off before. LLMs whales doing the heavy lifting is one thing, but small edit tools like grammarly that "improve" your phrasing are likely a massive algea like contributor to what is out there too.
Re:Wikipedia's Cleanup of AI-Generated Content by isolli on Tuesday October 27, 2026 @12:00PM (#50261237)
Why for free? Wikimedia is very well funded, and I'm sure that Pangram could use a leg up...
Re:Wikipedia's Cleanup of AI-Generated Content by persedes on Tuesday October 27, 2026 @12:48PM (#50261952)
They're providing the training data for free too. I'd think there's mutual interest there.
Re:Wikipedia's Cleanup of AI-Generated Content by zobzu on Tuesday October 27, 2026 @12:59PM (#50262137)
what ! according to pages longs of ads if I don't donate all my money to Jimmy Wales Wikipedia dies!
Re:Wikipedia's Cleanup of AI-Generated Content by Gigachad on Tuesday October 27, 2026 @06:47PM (#50266955)
I've felt that like tools like Grammarly are harmful for native speakers. I get if it's not your first language you need extra help, but if you are a native speaker these tools only serve to homogenize your way of speaking.

Having a program constantly suggest "better" ways of phrasing things is stripping your personality from your language. Maybe this is needed if you are writing corporate PR pieces, but you should avoid it for anything else.

Re:Wikipedia's Cleanup of AI-Generated Content by Betelbuddy on Tuesday October 27, 2026 @12:34PM (#50261731)
They are probably doing at the request, and in the future even paid for, by LLM providers...
Re:Wikipedia's Cleanup of AI-Generated Content by ai-x on Tuesday October 27, 2026 @02:37PM (#50263756)
As the biggest cheerleader of AI, I like to have a few sources that are free of AI and Wikipedia is one of the few perfect places to embrace this.

Of course AI can be used to check sources, get critical feedback and translate to languages. But content should be 100% human driven.