The best non-geometric interpretation of complex numbers is algebraic closure, IMO. Basically, mathematicians invent new kinds of numbers when they want to do things and have the result of the operation always be a number. Adding and multiplying natural numbers gets you a natural number. Subtraction on integers yields integers. Division for rational numbers. Infinite series for real numbers. And factoring all polynomials is the raison d'etre for complex numbers.