"I'd love to see a hack that lets one walk around in first-person inside an environment using Street View imagery, like a video game."

There was a TED video in 2010 doing almost that: http://www.ted.com/talks/blaise_aguera.html