The perception some have is instead that of inserting gender where it was irrelevant. (Those "some" do not associate 'he' and masculine, probably also for cultural reasons as expressed nearby.)
You may not fall into either of those two camps, but let me assure you, it's a lot of people.
For reference, the gender-neutral singular in English is "they/them/their"
they /T͟Hā/ pronoun
2. used to refer to a person of unspecified gender.
I think thou'st meant "Thou may not fall into either of those two camps, but let me assure thee, it's a lot of people."
The commenter thou art replying to is a singular person, not a group, and as we know, while other words may come and go, the use of pronouns in a language does not change over time.
Let me also assure you that "they" hasn't always been (and still isn't to many) accepted as a singular pronoun. Crazy how things change.