For the same reason I don't do audio books. I tried listening in the car during low overhead highway driving and quickly realized my attention faded in and out too much.

Along the same lines, I also came to theorize that books that were written to be read don't make good audio candidates. Yes, doable. But I found lectures and speeches to be better suited for listening (as it was their original and intended medium).