Re:How to Crawl the Web with Scrapy
by tamaharbor on Monday September 13, 2021 @05:56PM
(#28517394)
Any suggestions regarding how to scrape Java-based websites? (For example, harness racing entries and results from: https://racing.ustrotting.com/default.aspx).
[ Parent
| on HN ]
Generally you use devtools to find out what endpoints the javascript is requesting data from, then you make an identically-styled request.