News for hackers. Stuff that matters.

A comment on Fastly Outage. Parent comment

Re:Fastly Outage by utf_8x on Tuesday June 08, 2021 @09:14AM (#27434705)
Wonder what the story is behind these two...

    User-Agent: bender
    Disallow: /my_shiny_metal_ass
    
    User-Agent: Gort
    Disallow: /earth
[ Parent | on HN ]
Re:Fastly Outage by gaius_baltar on Tuesday June 08, 2021 @10:14AM (#27435470)
That's the good old Easter eggs, perhaps a memory from when Reddit was a nice place. They stop appearing and are replaced by dark patterns once sites jump the shark.
[ Parent | on HN ]
Re:Fastly Outage by toastal on Tuesday June 08, 2021 @09:58AM (#27435291)
I reod some people use false slugs in the robots.txt as a honey pot of sorts. IPs that actually read the robots.txt, ignore the disallow, and still access the uri are outright banned.
[ Parent | on HN ]
Re:Fastly Outage by taylorfinley on Tuesday June 08, 2021 @01:18PM (#27438032)
Then when a flamewar breaks out you just have to get your adversary to click a link to get them IP banned.
[ Parent | on HN ]
Re:Fastly Outage by jedberg on Tuesday June 08, 2021 @11:12AM (#27436238)
Ha, that would have been a really smart idea! Sadly we didn't think of that at the time. But we had other honey pot URLs.
[ Parent | on HN ]
Re:Fastly Outage by gostsamo on Tuesday June 08, 2021 @09:36AM (#27434989)
It might be related to the time few years ago when Google added exclusions for user agent t1300 in regard to its founders. Gort seems to be a robot from old scifi and bender might be something similar.
[ Parent | on HN ]
Re:Fastly Outage by h2odragon on Tuesday June 08, 2021 @10:15AM (#27435475)
Bender is from Futurama, Gort is old classic scifi: https://en.wikipedia.org/wiki/Gort_(The_Day_the_Earth_Stood_...
[ Parent | on HN ]
Re:Fastly Outage by jedberg on Tuesday June 08, 2021 @11:11AM (#27436224)
Just some fun humor we added for other nerds who read robots.txt files.
[ Parent | on HN ]
Re:Fastly Outage by iso1210 on Tuesday June 08, 2021 @09:22AM (#27434792)
Easter eggs
[ Parent | on HN ]
Re:Fastly Outage by pluc on Tuesday June 08, 2021 @09:24AM (#27434817)
It's neckbeard humor.
[ Parent | on HN ]
Re:Fastly Outage by jedberg on Tuesday June 08, 2021 @11:12AM (#27436243)
I'll have you know our beards were neatly trimmed when we added those.
[ Parent | on HN ]
Re:Fastly Outage by pluc on Thursday June 10, 2021 @05:18PM (#27465994)
I know you, and I find that hard to believe ;)
[ Parent | on HN ]