How we learnt to stop worrying and love web scraping

Re:How we learnt to stop worrying and love web scraping by sys_64738 on Wednesday September 09, 2020 @09:59AM (#24421029)

Won't switching to WASM do away with the ability to web scrape?

[ Parent | on HN ]

Re:How we learnt to stop worrying and love web scraping by dotancohen on Wednesday September 09, 2020 @02:15PM (#24424002)

Much scraping is done with automated control of a (possibly headless) web browser. It runs all the same scripts and has all the same features as a standard web browser for sighted users.

[ Parent | on HN ]

Re:How we learnt to stop worrying and love web scraping by detaro on Wednesday September 09, 2020 @10:03AM (#24421070)

a) it is unlikely the majority of the web will "switch to WASM"

b) what does "switching to WASM" mean for you? If it still generates a DOM or access a private API, many scraping techniques don't care.

[ Parent | on HN ]

Re:How we learnt to stop worrying and love web scraping by chundicus on Wednesday September 09, 2020 @02:12PM (#24423966)

why would it?

[ Parent | on HN ]