That's an over-worried worry. Just like existing road signs which also get tampered with, they would be a redundant source of information on top of the other self driving tech that would reduce instances of a human assistant or driver having to intervene.