It's egregiously ignorant to proclaim that his comments aren't taken seriously or don't have real life consequences. You don't get to dole out medical advice as a self-proclaimed expert and then hide behind "it's just entertainment, bro."
Also I've never heard him speak as an authority on anything other than stand-up comedy and MMA. Everything else I hear him ask his guests to clarify, like his recent episode with some skeevy psychologist/tech guy (Dr. Robert Epstein) who wasn't elaborating on dubious claims. At some point the guest was talking about Google "blocking the internet" and said condescendingly "Are you serious? You don't know this?" (my paraphrasing).
Joe just calmly responded with something along the lines of "Even if I do know this, my audience may not, so when I push back on you to elaborate or give more details or proof of a claim, it's not for me specifically". And yea, the guest was just a BS-er talking about big tech censorship, no Google can't block the internet, his claim ended up being about Google search and Chrome specifically.