News for hackers. Stuff that matters.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by charlieo88 on Monday July 17, 2023 @12:38PM (#36760387)
I wish I had the time or facility to take a snapshot of wikipedia now before the imminent deluge of Chat-GPT based updates that start materially modifying wikipedia is some weird and unpredictable manner.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by speedgoose on Monday July 17, 2023 @12:41PM (#36760447)
Wikipedia doesn’t remove the old versions.

Otherwise you can find an archive there: https://archive.org/details/wikimediadownloads?and%5B%5D=sub...

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by masklinn on Monday July 17, 2023 @12:40PM (#36760431)
Wikipedia dumps are publicly available, both from themselves and from the Internet archives.

There’s no “time or facility” constraint, only storage space.

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by bombela on Monday July 17, 2023 @12:39PM (#36760406)
You can download a full archive already.

edit, link: https://en.wikipedia.org/wiki/Wikipedia:Database_download

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by ravetcofx on Monday July 17, 2023 @12:49PM (#36760579)
You can use Kiwix too as an easy way to get an archive of it
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by deepserket on Monday July 17, 2023 @01:19PM (#36761045)
"As of 2 July 2023, the size of the current version of all articles compressed is about 22.14 GB without media." - https://en.m.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by LeoPanthera on Monday July 17, 2023 @02:17PM (#36761926)
In late 2021 / early 2022 I got scared about the incoming consequences of LLMs and downloaded all the "Kiwix" archives I could find, including Wikipedia, a bunch of other Wikimedia sites, Stack Overflow, etc.

I'm pretty glad that I did. I'm going to hold onto them indefinitely. They have become the "low background steel" of text.

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by samwillis on Monday July 17, 2023 @02:21PM (#36761985)
I really like that analogy.

For anyone curious what low background steel is, it's steel that was made before the first atomic bombs were tested: https://en.m.wikipedia.org/wiki/Low-background_steel

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by tivert on Monday July 17, 2023 @03:07PM (#36762584)
> In late 2021 / early 2022 I got scared about the incoming consequences of LLMs and downloaded all the "Kiwix" archives I could find, including Wikipedia, a bunch of other Wikimedia sites, Stack Overflow, etc.

> I'm pretty glad that I did. I'm going to hold onto them indefinitely. They have become the "low background steel" of text.

Also, ironically, the Pushshift reddit dumps (still available via torrent), before they were taken down. The exact time Reddit shut down the API to sell their data for AI training is also exactly the time it started to become less valuable for that.

I believe a lot of subreddits started implementing protest moderation policies after reddit came down on the blackout. IMHO, they should implement rules like "no posts unless it's a ChatGPT hallucination."

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by bitcoinmoney on Monday July 17, 2023 @11:33PM (#36767494)
Link to the torrent for science ?
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by pradn on Monday July 17, 2023 @02:28PM (#36762072)
I'm unsure if this will happen. There's plenty of checks-and-balances for Wikipedia edits. There's automated spam detection, editors manually looking over edits for articles on their watchlist, editors who look over subtopics, and even editors that take a look at the general stream of edits. It's already possible to flag mass edits. As for whether ChatGPT will inflect the subtle tone and bias of edits made using it, that's the same as bias from human users. And the same mechanisms for dealing with human bias apply here.

In terms of practical utility, for the vast majority of humanity, access to translated articles in their local language is the biggest problem, I think. There is no Yoruba-language Wiki article on General Relativity, for example. Second comes entire biased communities - like some of the smaller Wikis are full of far-right editors, and most editors (like 90%) are men.

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by worrycue on Monday July 17, 2023 @03:16PM (#36762679)
I can see AI bots submitting convincing edits at random times in no particular pattern. Eventually they will overwhelm Wikipedia checks and balances.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by tivert on Monday July 17, 2023 @03:20PM (#36762714)
>> I wish I had the time or facility to take a snapshot of wikipedia now before the imminent deluge of Chat-GPT based updates that start materially modifying wikipedia is some weird and unpredictable manner.

> I'm unsure if this will happen. There's plenty of checks-and-balances for Wikipedia edits.

I think it will. It's so tedious to edit Wikipedia (due to bureaucracy and internal politics) that their editorial population is in a long-term decline, which means their oversight ability is declining too.

Probably what will happen is LLM generated content will creep into long-tail articles, then work its way into more "medium-profile" articles as editors get exhausted. The extremely high-profile stuff (e.g. New York City), political battleground articles (e.g. Donald Trump), and areas patrolled by obsessives (railroads, Pokemon) will probably remain unaffected by the corruption the longest. At some point, the only way to resist will to become much more hostile to new editors, but that's also long-term suicide for the project.

I think they're painted into a corner.

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by pradn on Monday July 17, 2023 @10:31PM (#36767084)
I mean, maybe. AI on the "good side" will also improve. It should be possible to check a sentence against its reference with LLMs. And anything not sourced is suspect, just as it is now.

I also don't like the attitude of Wikipedia being "them", as in "their editorial population". It's our public good, like our air, and everyone should care to ensure its high quality. If you see a problem in the world, you have to try to fix it, instead of sitting on the sidelines, looking from the outside in.

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by oxguy3 on Monday July 17, 2023 @03:10PM (#36762618)
The Wikipedia community has generally been pretty resistant to allowing fully AI-based tools in. We've had tools such as Lsjbot (https://en.wikipedia.org/wiki/Lsjbot) in the past, but they've failed to gain community consent on any of the large Wikipedias. If someone tries to bring an LLM-based tool to Wikipedia, it would take a lot of finesse to have any shot of the community allowing it.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by bruce343434 on Monday July 17, 2023 @03:41PM (#36763005)
I don't think it takes much finesse to just randomly start "improving" articles using the output of an LLM. It only takes a single well meaning yet misguided person. Remember this? https://www.theguardian.com/uk-news/2020/aug/26/shock-an-aw-...
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by oxguy3 on Monday July 17, 2023 @07:50PM (#36765784)
Yeah, definitely a potential problem on the smaller language Wikipedias as the Scots Wikipedia incident shows, but for the big ones, low-quality content from new editors is not really a new problem to deal with.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by 1270018080 on Monday July 17, 2023 @05:18PM (#36764255)
But what about the whole mass of tech bros who don't understand what LLM's are (random text generators and nothing more), and manually start to add changes? It's a virus polluting every industry.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by Der_Einzige on Monday July 17, 2023 @03:35PM (#36762910)
The wikipedia politburo already makes it impossible for normies to edit any wikipedia article worth editing. If you don't believe me, try it out with a stopwatch to see how long it takes for your edit to be reverted.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by _djo_ on Monday July 17, 2023 @04:25PM (#36763563)
That you call them a 'politburo' and refer to 'normies' gives an indication that the types of edits you were making were neither well sourced nor neutral.

I've never had an edit reverted on Wikipedia.

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by hulitu on Tuesday July 18, 2023 @02:29AM (#36768632)
> the types of edits you were making were neither well sourced nor neutral.

There are a lot of such edits at Wikipedia (neither well sourced nor neutral). For some reasons, a certain bias passes through the filter.

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by hughesjj on Monday July 17, 2023 @03:58PM (#36763223)
Wikipedia has released snapshots available for download for over a decade now including ones with full edit histories, meaning you can just revert all edits to before a chosen epoch.
Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by int_19h on Monday July 17, 2023 @04:24PM (#36763546)
Without article history and videos, it's small enough that many modern smartphones can have a local offline copy.

http://kiwix.org/

Re:Wikipedia-grounded chatbot “outperforms all baselines” on... by cheald on Monday July 17, 2023 @04:37PM (#36763717)
You can torrent a copy of Wikipedia, including article history. Locally, you can go back to any revision of any article you want. I keep a copy locally just because it seems something valuable to have.