Of course not, what you need is model the way your ear handles sound coming from various locations then model this and reproduce it. It's like VR, but for your ears. That's how ASMR effectively works. If you want full immersion you can add head tracking so that the sound "rotates" around you when you move your head. I know that Apple offers that with their latest headphones.

Admittedly in order to do this you need to have post-processing specific for every person since we don't process sound exactly the same depending on our physiology. I know that Sony attempted something like that with its "3D audio". I think it's a bit of a gimmick myself, but it's technically doable.