News for hackers. Stuff that matters.

A comment on Google Deactivates Web Search API. Parent comment

Re:Google Deactivates Web Search API by slig on Wednesday May 04, 2016 @10:40AM (#11628654)
Wouldn't it be easier if they generated the dom elements via JS? That would imply that they're getting a JSON or something like, parsing it and creating the DOM.
[ Parent | on HN ]
Re:Google Deactivates Web Search API by Ixiaus on Thursday May 05, 2016 @08:51AM (#11635594)
No because then you'd have to use a headless browser that can execute js. That increases time and cost when scraping, though it wouldn't surprise me if it ends up going that way.
[ Parent | on HN ]
Re:Google Deactivates Web Search API by slig on Thursday May 05, 2016 @09:27AM (#11635858)
Why execute the JS? Just parse the JSON (I'm just guessing here). No need to mess with DOM or JS.
[ Parent | on HN ]
Re:Google Deactivates Web Search API by Ixiaus on Thursday May 05, 2016 @05:00PM (#11639637)
From my last and admittedly cursory look it wasn't that simple. IIRC JSON wasn't even used, I think it was a binary protocol.
[ Parent | on HN ]