What Are the Latest Scraping APIs or Services/Websites?
I'm working on a large web scraping project and looking to avoid building custom scrapers for every site using something like BeautifulSoup.
Anyone have recommendations for up-to-date scraping APIs or platforms that work well with a variety of websites?
(
7 comments
| 4 points
| on HN
)
https://github.com/spider-rs/spider
For those who want to self host.
https://newsloth.com
https://serpapi.com/search-api
Disclaimer: I work there!
Would highly recommend