I used to listen to podcasts while working. I could only focus on one or the other, but not both. I listen to them now when I cook or do other non-work activities where I can let my mind wander a bit.

At my latest position, I am the only one who puts headphones on so I only do that when eating lunch at my desk every day since that is a thing there.