News for hackers. Stuff that matters.

A comment on Download this Dataset of 12,118 Yahoo Answers for $1.

Re:Download this Dataset of 12,118 Yahoo Answers for $1 by johnm212 on Wednesday April 21, 2021 @05:39PM (#26895777)
> we scraped it all (at least as many as we could find on their English site) 12,118 questions

There's a lot more questions on Yahoo Answers. Their robots.txt file contains a sitemap: https://answers.yahoo.com/sitemaps/sitemap-us.xml

That sitemap contains links to 2,115 other sitemaps. Each of those sitemaps contains links to around 47k questions.

[ Parent | on HN ]
Re:Download this Dataset of 12,118 Yahoo Answers for $1 by jeromechoo on Wednesday April 21, 2021 @05:43PM (#26895829)
Good find! Worth a follow up to get more!
[ Parent | on HN ]