This is just a simple heuristic that's good enough for real code on the web. Usually whitespace and comments are stripped out during build step. I imagine this heuristic was implemented as something simple and working and that's that.

Remember that they are not writing a monument of perfect software but something pragmatic that should work good in most cases.