Keep in mind that self-driving cars will be loaded with sensors. Car's will basically be running continuous surveillance on their neighbours, and any "rogue" car will probably be reported by surrounding vehicles.