Less true for Joe Rogan but more true for Rich Roll.
Of course this depends on what books you read in each category, if it’s a physics textbook vs Colleen Hoover then it’s the opposite.
Even so, I tend to rewind when I notice I missed something, e.g. due to my attention being needed elsewhere for a bit. I mostly listen while cycling and as long as I'm outside the city there's few distractions, but when sharing the streets with others there's often distractions that are more important than listening.
For me what is often challenging is how much variation can go into the audio that can challenge my purpose, a dry or mechanical recitation of the text vs a skilled telling vs a full cast that is comprised of a huge variety of performers.
Very true - for me this is source of the problem with difficulty to find good quality technical audiobooks, I think that in order to "work" correctly, to properly deliver technical knowledge such audiobooks would have to be structured differently and thought out with upfront knowledge that information will be delivered in audio form.
They also help sometimes in getting the "musicality" of a work. I didn't know how musical Moby Dick was until I heard the audiobook narrated by Frank Muller. He transformed the whole thing. Like when one reads Shakespeare and only afterwards watches it live.
I tend to have audiobook+book combos for almost every book I love, since it's also a good way to continue "reading" even when ones eyes are tired...
The answer to this question will be unique to every person and every book. I read quite a few books for the entertainment value they provide - I like getting lost in a good novel occasionally without having to reflect too seriously on each passage. Audiobooks provide a convenient means of enabling me to enjoy the book, especially if driving, commuting, or performing some other task. However, if I am reading a nonfiction book, I want the book in front of me so I can double back to certain passages, check references and footnotes, write in the margins, skip to chapters and pages. I want more control over the reading experience. The audiobook forces me to trade all of that for an experience it provides.
I think for some people, audiobooks can end up like podcasts. People will sometimes listen to podcasts with intelligent people in the hopes that they learn something from the podcast. Maybe by listening to interviews with a famous mathematician or startup founder, one can learn some crucial aspect of becoming a successful mathematician or founder. However, the main value one gets out of podcasts is entertainment. Because you typically engage passively with a podcast, you are less likely to retain some useful bit of information that you hope to get.