I think your concerns are valid, but I think we can come up with ways to avoid them without forcing people to declare and be bound to a specific location.

Just want to add that for example in France there is a "gens du voyage" status for nomadic people that allows then to access government services without a fixed address. I don't know enough about it to say if it's successful, just saying there are options.