Would you be "you" in a different body?
To claim otherwise would mean anyone who's gotten a transplant or amputation is no longer themselves.
If you delete the hardware and buy new hardware and write in the same weights its still the same LLM. If you delete your brain, get a new brain and put in the same weights in the neurons its a clone, its not you. We know what happens when we create a clone, the clones aren't the same person they are separate consciousness, so consciousness is tied to the hardware.
Your whole argument hinges on this, and I don't think it's true.
A clone is not what you describe, not even close. Clones are copies of DNA, not of the actual physical neuron structures.
If you were to vanish, and the next moment a perfect atom-for-atom, particle-for-particle, quark-for-quark copy appear in exactly the same place, I think that is you. As far as I know, that does happen every single planck second.
For it to be you, though, it needs to occupy the same space you were previously in. You can't copy your atoms 5 times over in 5 different locations; those aren't you, they're just similar. Like copying an LLM 5 times over to different hardware, seeding its RNG differently each time.
If "I" am in a different body, then what makes that "me" who's in a different body?
The experience of “you” is just your specific memories and world model, continuously updated with sensory input.
If another body “runs” the same exact pattern, that is you. Theres no link and nothing was transferred; the pattern of thoughts and memories is all “you” ever was.
Same as playing the same song on two different speakers. Nobody asks what links the song across them; it’s the same song wherever it’s played. You’re just a far more complicated pattern on a far more complicated speaker.
You might ask, “but why am I this pattern?” Because this is the specific pattern modeling itself from the inside in asking that question.
And my intuition is that no, you can’t, they are two aspects of the same reality.
I don't see why hardware is any more fungible than a kidney. If your LLM reads the serial numbers of its motherboard/RAM/etc as a seed for entropy you can make identical arguments about body fungibility and self.