Its more of a focus thing for me. Its easier to get into the zone when I'm in a terminal with no mouse and all the GUI noise stripped away.

I'm sure I'm missing out on quality of life enhancements and whatnot, but really all of those are lower on my hierarchy of needs than staying on task.