News for hackers. Stuff that matters.

A comment on Seeding a startup without using fake accounts: anyone seed a startup with wikipedia content? How did that work out?.

Re:Seeding a startup without using fake accounts: anyone see... by picnichouse on Saturday May 19, 2007 @05:17PM (#23281)
I'm curious what technology you used to grab content from wikipedia?
[ Parent | on HN ]
Re:Seeding a startup without using fake accounts: anyone see... by dazzawazza on Saturday May 19, 2007 @07:53PM (#23305)
Wikipedia provides a query api for accessing pages and links within pages: http://meta.wikimedia.org/wiki/Query Its very useful and I think people should use it if they want to scrape Wikipedia. At least it gives the Wikipedia guys a chance to throttle bandwidth if they need to.
[ Parent | on HN ]
Re:Seeding a startup without using fake accounts: anyone see... by amichail on Saturday May 19, 2007 @06:43PM (#23298)
You can download it here:

http://download.wikimedia.org

[ Parent | on HN ]
Re:Seeding a startup without using fake accounts: anyone see... by andre on Saturday May 19, 2007 @06:28PM (#23296)
it's pretty easy to write a scraper in most languages and customize it as needed. I've done in PHP.
[ Parent | on HN ]
Re:Seeding a startup without using fake accounts: anyone see... by spoonyg on Saturday May 19, 2007 @07:13PM (#23302)
Easy, but really if a site is nice enough to provide a legitimate way for you to get data you should respect that and download it.
[ Parent | on HN ]