Except if the joke is straight up offensive or aims at mocking or stereotyping a certain type of people (whether you're part of this group or not), I fail to see how it can feel "creepy." Even doing a bad pun or joke related to the context has nothing creepy in it. At worst, it's cringey.