Re:The HTTP status code for a web server's default “hello” f...
by hughesjj on Sunday July 09, 2023 @04:26AM
(#36652690)
If they haven't set up their landing page I doubt they configured a robots.txt
[ Parent
| on HN ]
Re:The HTTP status code for a web server's default “hello” f...
by Chaosvex on Sunday July 09, 2023 @08:10AM
(#36653805)
This is clearly talking about default behaviours, so it'd already be there as standard. It's no different than expecting a different status code for the purpose of requesting crawlers not to index.