I agree that it depends on the type of podcast. Deep technical stuff, for me, is much better as text. But something like The Ongoing History of New Music[0] would be greatly degraded by switching to text.

[0] https://en.wikipedia.org/wiki/The_Ongoing_History_of_New_Mus...