You're right! GMOs don't start from fresh crops from the wild. They start with existing strains. In that sense, they inherit old risks.

What they don't do is continue adding on the risks from the process of selective breeding itself. I don't expect that direct genetic engineering is clean, simple, and interaction-free. I just expect that it has a somewhat easier time targeting specific changes than barnyard breeding by light of Uranium.