Note that Quaternions didn't fix the issue by themselves. I had to change the interpretation of cursor movements to use axis-angle rotation based orientation.

The fix could be deployed with or without Quaternions.