It wouldn’t. To me most arbitrator’s would look at a change from remote to in office in a similar vein to “the office moved across town”. Pre-pandemic, no one would question whether a company had the right to change the physical location of the office, and you would either adjust to the new office location…or quit because the new commute or location became problematic for you.

Your location was here, and now it’s here.