I do enjoy subtitles as well, but for me I have the most trouble with accents I'm not used to. My favorite examples are scifi/fantasy/historical shows where for some reason the "way the peoples talk" is invariably a heavy English, Irish or Scottish accent that is very hard to follow for me, used to American accents, even if enunciated properly. Add in the other sounds and it becomes even more difficult.

The other nice feature of subtitles is sometimes there is helpful metadata there, like identifying the song playing in the background or some words not intended to be heard like a whisper or voice coming from a phone receiver.