Wikimedia Foundation spending

Re:Wikimedia Foundation spending by shshhdhs on Sunday May 07, 2017 @05:04PM (#14287667)

Thanks for working on that! Didn't know it was so bad. The following is a possibly stupid idea, but I'd like to hear your thoughts:

What if you just render the content into HTML and then "screen scraped" the text, and then convert into a more useful format (MarkDown, JSON, etc). Is that plausible?

[ Parent | on HN ]

Re:Wikimedia Foundation spending by GhostVII on Sunday May 07, 2017 @05:06PM (#14287678)

That would allow a basic UI change on Wikipedia to break your code. Sometimes it is necessary, but not usually the best option in my experience, and it's pretty annoying to do.

[ Parent | on HN ]

Re:Wikimedia Foundation spending by 3131s on Sunday May 07, 2017 @07:42PM (#14288319)

Wikipedia used to do HTML dumps but stopped a long time ago, unfortunately.

[ Parent | on HN ]

Re:Wikimedia Foundation spending by int_19h on Monday May 08, 2017 @12:34AM (#14289278)

You can get what amounts to an HTML dump (which is then indexed and compressed in a single huge archive) from Kiwix. Although they do them basically twice a year or so.

[ Parent | on HN ]