We really do not know the long term effects of exposure and to dismiss that aspect ignores the cautionary principal which has been ignored far too much in this debate.
We can look at DDT as an example of what can happen when ignore and dismiss long term results. It is true DDT didn't affect those who wallowed in it and that was used to "prove" it was safe, but it is also true it affected their children, especially females, and not until they were adults did those effects become apparent.
It is also true that eating food is not the only source of exposure for everyone. And it's also true that homeowners and farmers don't always follow the instructions and laws for using these products.
So, if we read Snopes "Fact Check" on this issue it's very easy to come away thinking all those who've done independent research are wackos and glyphosate is "Safe" and may even lead some of them to say they believe it's "Safe to drink a quart of it" and therein lies the problem.
The argument is just that glyphosate isn't dangerous at the doses found in food, and that seems to be true based on Wikipedia's summary of the existing research[2].
That's distinct from the argument that glyophosate is safe for the environment or that it's safe for workers handling it in large quantities.
1. https://en.wikipedia.org/wiki/International_Agency_for_Resea...
2. https://en.wikipedia.org/wiki/Glyphosate#Human