Well, risks are always about probability of occurrence and impact. So while it is unlikely that some GM plant causes some catastrophic scenario, but when it does it is likely to spread so the impact would be big.

I know that unknown threats are everywhere and there are a lots of other things I am concerned of too, but in the end I am used to live with that and it doesn't change my view on the topic.