News for hackers. Stuff that matters.
Re:I was wrong about robots.txt by abirch on Thursday July 17, 2025 @03:35PM (#44597258)
With the advent of AI and the notion of actually going to a website as being quaint: each website should have a humans.txt such as https://www.netflix.com/humans.txt or https://www.google.com/humans.txt
Re:I was wrong about robots.txt by EPendragon on Thursday July 17, 2025 @03:55PM (#44597479)
I have not heard of humans.txt before. It is apparently used for acknowledgement and crediting the dev team who created the resource.
Re:I was wrong about robots.txt by PaulHoule on Thursday July 17, 2025 @03:44PM (#44597352)
What everybody is missing is that AI inference (not training) is a route out of the enshittification economy. One reason why Cloudflare is harassing you all the time to click on traffic lights and motorcycles is to slam the door from some of the exit routes.