> Soy does have the obvious huge downside of containing a much higher amount of estrogen and causes havoc in some people

Do you have a study that confirms this? As far as I know this is a myth. See: https://en.wikipedia.org/wiki/Phytoestrogen#Effects_on_human...