Have you tried mindfulness? I have had the same experience as you have (it sounds like) in that I am able to speed listen more effectively at 2-2.5x than at 1x. Since I've started trying to be more mindful and meditate regularly, the improvement in focus I've experienced is incredible.