That's essentially the idea of what we were building. Ran out of time due to moving and job change, but I had that working great on Chromecast. Chromecast at least then was awfully clunky though.

For some demos I used cheap Android-powered dongles (like the Amazon Fire Stick, but wide-open rootable Android) to make a plug-and-play display device. With some small work it would be a fun Kickstarter.