News for hackers. Stuff that matters.

A comment on Claude can now search the web. Parent comment

Re:Claude can now search the web by zupa-hu on Thursday March 20, 2025 @01:19PM (#43426038)
Every automated crawler follows human-driven actions.
[ Parent | on HN ]
Re:Claude can now search the web by josh-sematic on Thursday March 20, 2025 @01:30PM (#43426205)
Conversely, every browser is a program that automatically executes HTTP requests.
[ Parent | on HN ]
Re:Claude can now search the web by bayindirh on Thursday March 20, 2025 @01:47PM (#43426441)
Yet they respect a lot of things meant for machine to machine interaction. Like server return codes, cookie negotiations, and CAPTCHAs if they behave a certain way.

So they sometimes hit bollards and turnstiles made for other types of code which executes HTTP requests. So they're bots basically, but better (or suitably) behaving ones.

[ Parent | on HN ]
Re:Claude can now search the web by soulofmischief on Thursday March 20, 2025 @03:12PM (#43427636)
Browsers let you visit websites without regard for robots.txt.
[ Parent | on HN ]
Re:Claude can now search the web by gopher_space on Thursday March 20, 2025 @01:27PM (#43426158)
Welcome to "Context".
[ Parent | on HN ]