To maintain that belief you have to either believe there is a physical source of consciousness, or that consciousness doesn't exist, neither of which most people can accept, yet LLMs are forcing people to confront.
The problem is that subjective experiences don't fit well with objective explanations. Nagal laid this out in his paper, "What it's like to be a bat", and other philosophers like Chalmers expanded on it with p-zombies and blind color scientists.
The only reason "avoid dangerous things like snakes so I continue to live" is a goal is emotions.
Emotions do not only exist in the not actually a real thing system 1. People who take damage to the emotional centers of their brains become passive and apathetic not hyper intelligent system 2 Vulcans.
I think it's an incoherent concept. If the 'soul' is anything, there is some difference in the brain that would allow it. You can't have two people with identical brains and claim that one has a soul, unless you believe in magic.