My setup is similar to your multi-monitor arrangement, except instead of moving my head I switch between respective window sets in Stage Manager (macOS).

One downside is that my neck does not exercise much because I do not look in different directions while working. Another downside is that at certain times context can involve multiple window sets, but that is rare, and it comes with an upside: it is easier to focus on one task without windows on other monitors distracting me.