It depends where you are. Some people do strongly see it as not gender-neutral, and will loudly criticise you for using it even if you mean it in a gender-neutral way. Which is a shame, because while language is important there are probably other bits of language that are worse.

Ireland has "hey lads" as a gender-neutral term which surprised me the first few times I heard it.