Same thing here. I think the difference is whether the swear words are ingrained as part of "absorbing" the language as a child, as opposed to learning it "properly" as an adult. Basically, whether you only understand their meaning rationally, or it's a deeply ingrained taboo.