News for hackers. Stuff that matters.
Re:Wikipedia Redefined by jarek on Tuesday August 07, 2012 @08:14PM (#4353139)
No need to scrape, Wikipedia has full dumps for the articles available for download: http://en.wikipedia.org/wiki/Wikipedia:Database_download#Eng...
Re:Wikipedia Redefined by robryan on Tuesday August 07, 2012 @09:23PM (#4353375)
Yeah I am aware, but wikipedia changes daily. There would have to be a pretty impressive feature set built on top before many would consider using an out of date wikipedia when they can easily see the latest version.
Re:Wikipedia Redefined by gromgull on Wednesday August 08, 2012 @03:59AM (#4354440)
There is a feed of changes though - both a "realtime" IRC feed that is restricted access and some sort of batch feed (daily? Hourly?)
Re:Wikipedia Redefined by jarek on Tuesday August 07, 2012 @10:26PM (#4353545)
Hm... for most pages it shouldn't really matter, they don't change drastically within days. For developing or current subjects I guess it would...
Re:Wikipedia Redefined by apgwoz on Wednesday August 08, 2012 @07:03AM (#4354917)
This dump is updated once a month, though the API is live.

One problem I've found with the dump is that you still need to render it (unless someone knows of another dump) which has caused us a few problems with the current thing I'm working on.