I think it's one of these dogma that just get around by word-of-mouth.

Personally, I need the slight downtime of using a mouse when compiling a program, a short moment to pause and clear my head. Without a mouse I'd probably be less productive.