I think once you've been "living" in your terminal for a while you're pretty used to the keyboard-centric life and going to a separate mouse-centric window manager world can be considered to be cumbersome.

That said, I do agree with you. I also think any image viewing functionality needs to have a practical way to get that image sent through the same channel as that terminal connection itself so that if you're on it remotely it will still work...