Won't the headgear just make your head a larger target to glancing blows, not the big direct hits?
Also, the worst part of the headgear, in my opinion, is I find it way harder to breath when it's on and I can confirm that I've felt punch drunk up to an hour or two after catching a bad direct hit while sparing with headgear.
In my experience it makes my head a larger target than I'm used to, plus it affects my peripheral vision, making me take more shots to the head than I would have otherwise.
Plus, put on some headgear, let me punch you, and tell me how cushioned you felt.