PID controllers are used to do exactly this with quadcopters. There is a lot of finesse on top to deal with oddities and problems like I term windup. Common ones are zeroing it out when it’s no longer valid or clamping it within specific bounds.

For games you might just get away with a PD controller and not need to worry about the I term at all.