I can't always remember what a person's name either. No one gives me crap for asking what their name is. I don't feel like asking what someone's pronouns are is a safe question yet.

I'm more concerned about getting crap from someone who only thinks there should only pronouns for their notion of binary genders. For now I just use "they/them" for any given person if I'm not sure, because it's safer than asking in many cases.