Planes do balance themselves. Stability was traditionally achieved with a carefully placed center of gravity.

Modern fighter planes are unstable, but are stabilized by computers, not the pilot.