Not everybody here is technical, and not every technical person necessarily has web development experience.

I've personally worked with some brilliant embedded software developers and compiler writers who likely wouldn't know what a robots.txt file is, because they've focused their skills and talents elsewhere. Despite not knowing what a robots.txt file is, they're still far more technically capable than even the best web developers I've ever encountered.