I think you and your GP are right on. I edited a short-lived podcast and regularly spent 1.5 hours producing and editing each 25 minute show. Even if you're using good equipment and have a solid connection, producing a tight podcast necessarily takes more effort than is obvious to the listener. That's kind of the point.