The command line is contextually intelligent and presents interactive graphics and text. Not a simulation of a teletype on a simulation of a character terminal.
There's an Alpha workstation in my closet, waiting to have OpenGenera installed...
> Or, if I mouseover a filename, get a preview? ...I can't type "view lolcat.png"
Most GUIs don't even do this. However, on OS X with iTerm you already can cmd-click the filename to open the file. Or use the Finder's QuickLook utility from the command line: qlmanage -p "$@" >& /dev/null &
Basically I see no need to merge the two. They operate perfectly well together and compliment each other. To extend the functionality you could simply write shell scripts which generate custom HTML and send it to a browser (or quicklook in the case of OS X).
Furthermore, a lot of these suggestions are already implemented in ipython notebooks, which is a REPL with graphical capabilities.
I hope he hasn't totally abandonded the idea but I wouldn't be surprised if he did.
One of the craziest hacks on graphics terminals was NCSA Telnet. It supported multiple detached Tek terminals as well as a raster graphics protocol called "ICR". It had its own TCP stack built in, and could offer these features even on DOS. One of the weirdest rigs I ever saw was a guy at college who browsed the web, with graphics, using NCSA Telnet on a PC/AT running PC-DOS, at a time when that computer was at least 10 years old.
http://phk.freebsd.dk/AducLoran/animation2.gif
...part of a Loran-C receiver made by Poul-Henning Kamp which aparently outputs these plots over its serial port.
http://phk.freebsd.dk/AducLoran/
To play with it, for example gnuplot can output on an xterm running in tektronix-mode. Open an Xterm, then...
* mkfifo /tmp/tek
* cat /tmp/tek
* Ctrl-Middle-Mouse menu:
- show tek window
- switch to tek window
- (in Tek window:) hide vt window
Open a second terminal (Xterm or any other) * start gnuplot, on the gnuplot-prompt
* set term tek40xx
* set output "/tmp/tek"
* plot tan(x) {or whatever you want to plot}
Using two separate terminal emulators, and the fifo, makes it easier to coordinate the two different modes, because frankly gnuplot doesn't switch sensibly between the two display modes and will clobber one or the other either with Tek control codes on the VT, or write the prompt over the graphics.
I'm thinking a hybrid console meets explorer: When I type "ls *.png", why don't I get a sortable table? Or, if I mouseover a filename, get a preview?
I remember "type BBSAD.ANS" in the DOS days - you'd see an animated ANSI right in the terminal - but I can't type "view lolcat.png" in 2014 (without shifting focus to the GUI).
Maybe this is overkill and not worth it, but I've always felt there's room to make the CLI a little more GUI-like