This is one of those situation where I wish there was a good loan-word like "schadenfreude": The dilemma of choosing whether to explain a joke/reference for those who aren't getting it, versus playing along and extending it.