News for hackers. Stuff that matters.
Re:Wikipedia says traffic is falling due to AI search summar... by parpfish on Tuesday October 21, 2025 @07:48PM (#45663239)
as somebody that has wrassled with the wikipedia dumps a number of times, i don't understand why wiki doesn't release some sort of sdk that gives you the 'official' parse
Re:Wikipedia says traffic is falling due to AI search summar... by skywal_l on Wednesday October 22, 2025 @03:10AM (#45665781)
This. I tried that a few years ago and fell off my chair when I started to realized how DYI the thing is. It's a bunch of unofficial scripts and half-assed out of date help pages.

At the time I though, well it's a bunch of hippies with a small budget, who can blame them? Now I learn that there is 600 of them with a budget in the hundreds of millions??

This is becoming another Mozilla foundation...

Re:Wikipedia says traffic is falling due to AI search summar... by philipkglass on Wednesday October 22, 2025 @11:29AM (#45670630)
I have wrestled with it too. I believe it's because wikitext is an ad-hoc format that evolved so that the only 100% correct parser/renderer is the MediaWiki implementation. It's like asking for an SDK that correctly parses Perl. Only Perl can do that.

There are a bunch of mainly-compatible third party parsers in various languages. The best one I've found so far is Sweble but even it mishandles a small percentage of rare cases.