It's like anything else; it takes practice. For my first months of regular audiobooking I had to reread sections pretty regularly. Five years in I listen between 1.6x and 2.6x, depending on the subject and reader, and almost never have to reread anything (unless something taxing pops up suddenly and I don't pause immediately). Over 100 of the books I read last year were audio.