Stop crawling my HTML – use the API

Re:Stop crawling my HTML – use the API by bdcravens on Sunday December 14, 2025 @03:20PM (#46266449)

You can run virtual desktops in the cloud, like AWS's Workspaces, sold as a business rather than developer offering. AWS does publish the IP range those clients use, and I assume other similar offerings out there do the same.

[ Parent | on HN ]

Re:Stop crawling my HTML – use the API by johneth on Sunday December 14, 2025 @03:39PM (#46266649)

I'm sure people who can afford to run virtual desktops in the cloud can also afford a phone/laptop/desktop to access sites that block those virtual desktops in the cloud.

[ Parent | on HN ]

Re:Stop crawling my HTML – use the API by bdcravens on Sunday December 14, 2025 @05:13PM (#46267612)

I'm thinking more along the lines of people using virtual desktops assigned by their job, and those sites are part of their work. I don't feel like punting to BYOD is a good solution.

[ Parent | on HN ]

Re:Stop crawling my HTML – use the API by prmoustache on Sunday December 14, 2025 @04:34PM (#46267184)

I am working from a cloud desktop but I am only visiting corporate approved resources from that cloud desktop and I believe that is the case of most cloud desktop users as the whole point is to have a clear separation of duties.

[ Parent | on HN ]

Re:Stop crawling my HTML – use the API by bdcravens on Sunday December 14, 2025 @05:17PM (#46267658)

Correct, but I don't think it's a safe assumption that approved resources wouldn't have a reason to block requests from the cloud.

[ Parent | on HN ]