News for hackers. Stuff that matters.
Re:OpenAI's bot crushed this seven-person company's web site... by jonas21 on Friday January 10, 2025 @05:57PM (#42661290)
It's "robots.txt", not "robot.txt". I'm not just nitpicking -- it's a clear signal the journalist has no idea what they're talking about.

That and the fact that they're using a log file with the timestamps omitted as evidence of "how ruthelessly an OpenAI bot was accessing the site" makes the claims in the article a bit suspect.

OpenAI isn't necessarily in the clear here, but this is a low-quality article that doesn't provide much signal either way.

Re:OpenAI's bot crushed this seven-person company's web site... by Thoreandan on Friday January 10, 2025 @07:05PM (#42661873)
Hear hear. Poor article going out the door for publication with zero editorial checking.
Re:OpenAI's bot crushed this seven-person company's web site... by joelkoen on Friday January 10, 2025 @07:20PM (#42661976)
Haha yeah just noticed they call Bytespider "TokTok's crawler" too
Re:OpenAI's bot crushed this seven-person company's web site... by peterldowns on Friday January 10, 2025 @06:21PM (#42661522)
Well said, I agree with you.
Re:OpenAI's bot crushed this seven-person company's web site... by ted_bunny on Friday January 10, 2025 @11:41PM (#42663354)
I wish they'd add a little arrow you could click.
Re:OpenAI's bot crushed this seven-person company's web site... by peterldowns on Saturday January 11, 2025 @04:11PM (#42668959)
Well said, I agree with you.
Re:OpenAI's bot crushed this seven-person company's web site... by ted_bunny on Friday January 10, 2025 @11:43PM (#42663361)
The best way to tell a journalist doesn't know their subject matter: check if they're a journalist.