> Isn't that how actual sci-fi teleportation would work behind the scenes as well?

Depends. Some versions are materialize/dematerialize, some, IIRC, are basically traversable short-lived artificial wormholes.