Sounds like the podcasts from Sanspants Radio are right up your alley. "Shut Up a Second" is spitballing on a different random topic every show, and "Plumbing the Death Star" is discussion on different pop-culture related questions such as "what if Professor X ran Hogwarts?"

Their D&D podcast is probably my favorite of the genre as well.