They do however use facilities that are paid for by taxes, people remote working and travelling are already in a privileged position with their job and freedom/flexibility.

Skipping taxes just seems unfair on locals and personally I wouldn't do it as I don't agree with super rich people that have complex tax arrangements so I'm not going to forgive the smaller fish either.