I don't remember if this was the game or not, but I tend to set the settings ahead of time, and I specifically recall a game getting to this sort of in-game mechanic of look up/ look down and reversing the setting I had previously set because it assumed I didn't already choose what I wanted (e.g. it re-inverted my reverted settings back to "normal").