I had the opposite experience. I have a personal iPhone and a work iPhone and every time my work iPhone is near my work computer, it switches to it whether I want it to or not. It drives me nuts. It's fine when I want to initiate it but the number of times I've just set my work phone down on my desk thoughtlessly and then tried to start a video meeting in Slack or Teams or Zoom only to not have video because it's using the camera pointing at my desk is too many.