Many chargers have wifi or bluetooth connectivity. Seems to me that there's an obvious integration here. Visitor's phone and charger authenticate each other, charging starts.

OpenEVSE could be a perfect platform for prototyping this. Our hackerspace has one on the wall right now, and we're adding another because so many members drive EVs now.