I used to speed them up as well but I stopped doing it for now as I feel like the time is not only there to hear the words and the surface meaning (I can do that at 2x), but to digest it and take it further inspire thought in myself. I sometimes even pause and think.

Depends on the type of show of course. But if they are talking about some interesting deep topic, I find it useful to use that time to think more. It's kind of the difference between skimming and flipping through a book vs reading a paragraph and looking up, pondering a bit, then reading along, after a chapter standing up and walking back and forth a bit in the room, thinking.