There is nothing inherently dangerous about doing this, and it has the potential to do a lot of good for humanity. It's important not to conflate the demagoguing of massive agricorps with a useful scientific technique.
The bigger scam is that, despite producing more calories than we could possibly use, they've continued modifying crops for calorie yield and chemical resistance, which has made a lot of crops less nutritious (per kg eaten), less tasty, and more dependent on advanced human intervention to successfully grow.
I’m not that worried, but I’m not that fast to exclude the possible that something goes dangerously wrong somewhere, say some crop with new genes that make it spread uncontrollable through a whole ecosystem, in the same way invasive species sometimes do.
And then of course the issues you bring up in your last paragraph. The technique is in general not used to help humankind or the world, but to maximise revenue for the corporations. At least in the industrialised world, it is now more important to increase biodiversity than to maximise yield.
You don't need to worry about GMOs for that. We already have Kudzu vines.
How about checking the research papers cited in Wikipedia:
https://en.wikipedia.org/wiki/Genetically_modified_food_cont...
Point being, there is money to be made on both sides.
Of course Monsanto et al have invested a lot of money into research that shows that GMOs are safe. That is of course not in any way proof that there is anything wrong with that research, but it definitely makes me more careful in interpreting the results.