Right, human assist would probably be needed for final verification and unfortunately it's impossible to correctly name the streets (unless everywhere were like Manhattan); number might be doable.

It just seems like a perfect fit for Deep Convolutional neural nets.