I'm the same and it drives me (and my wife if Im honest) crazy. For whatever reason I pick up background noise with much more intensity than most people. Surround sound is useless to me, I'll hear cricket chirps and background music over the dialog.

I can more of less push through it at a pub and in other social situations but its extremely draining.