For me there is a muscle memory component. I can easily switch between keys that I regularly play in, but going to something like c# is difficult because I don’t have the muscle memory for it. I mainly play by ear and chord notations too. I have never been able to read sheet music real time.