We can on motorways, which is where I think driverless technology will actually start - motorways are simpler environments than most roads, and have convenient service stations along them.

Driverless lorries that go from one service station to another will be the first fully autonomous vehicles I think.