News for hackers. Stuff that matters.

A comment on Mimicking a device is becoming almost impossible. Parent comment

Re:Mimicking a device is becoming almost impossible by luffapi on Monday June 28, 2021 @09:26AM (#27661649)
You can get only scrape data you are allowed to access. If your eyes can see it, you should be able to scrape it. The analog hole is always there.
[ Parent | on HN ]
Re:Mimicking a device is becoming almost impossible by EMM_386 on Monday June 28, 2021 @07:14PM (#27669556)
This gets very tricky when you think about JavaScript.

What if you only pop up important information via an onBlur event in a dynamically created div element that is overlayed on the page, only after asynchronously querying a REST endpoint to get information from a database?

How would a crawler even know that this element is shown when you leave a specific input field? How would it know to wait a second while the database is getting the data?

Like it or not, we're well past the days of complete HTML documents being served for a request.

[ Parent | on HN ]