That depends on your translation - some translations will translate those to “They who do not”. Many of the ones who translate it as “he” are maintaining the Hebrew lack of gender neutrality, but that’s arbitrary. If the ancient Israelites spoke Finnish instead, the sentences would be gender neutral.

The bible wasn’t written in English. What exactly is your point?