News for hackers. Stuff that matters.
Re:What one may find in robots.txt by egeozcan on Monday May 18, 2015 @10:30AM (#9564634)
Well, I was trying to point to the fact that how a small and not-so-useful feature can cause some unnecessary headaches. I know that it can work, just not worth it in my opinion. However, on second thought, I guess this could be implemented using less time than we used to write these comments :)

The login-form method would be a bit less silly, I thought, because it can be a POST. But, well...

Re:What one may find in robots.txt by laumars on Monday May 18, 2015 @12:12PM (#9565219)
The real benefit of a login form is you can easily seperate the casual nosy surfer from someone more interested in hacking your site.