Computer Modern is largely a copy of Monotype Modern, which dates from 1896. Monotype Modern was, I assure you, not designed by a mathematician nor was designed for use in printing math books. However many math books had lately been printed using typefaces similar to Modern, and Knuth liked how it looked.