Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Ask HN: Why Is My Scraping So Slow?.
2) maybe your scraping is synchronous, without perhaps any level of parallelism at the same depth
3) use your code or a sitemap to get all the URLs into a txt, then loop through with bash/curl maybe
There are no comments on this comment yet.
2) maybe your scraping is synchronous, without perhaps any level of parallelism at the same depth
3) use your code or a sitemap to get all the URLs into a txt, then loop through with bash/curl maybe