Re:Claude can now search the web
by joecool1029 on Thursday March 20, 2025 @01:28PM
(#43426171)
It's in a small circle of those that do. Blame the internet archive for starting this trend: https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...
[ Parent
| on HN ]
Re:Claude can now search the web
by hirako2000 on Thursday March 20, 2025 @01:57PM
(#43426610)
Given websites do disappear or worse, get their content adultered. Also given the long history of the internet archive as a non profit - and the commons service it has served so far, the joke would be to see that bot honor it.
Re:Claude can now search the web
by nikisweeting on Thursday March 20, 2025 @04:35PM
(#43428616)
lol IA did not start that, if anything they were late to the game. only the top handful of US-based search engines ever bothered respecting it in the first place
Sorry to intrude with something unrelated. But YC closed the earlier discussion. Saw your comment about Kannel WAP of few months back and wanted to ask if do you know of any WAP Push full service provider still in operation.
Re:Claude can now search the web
by joecool1029 on Sunday March 23, 2025 @01:14AM
(#43451036)
Nah I just know about that public gateway I linked. I can't use it anymore as 2G was shut down on my local towers back in January.