For me it was the finding that mathematics is quite arbitrary. There is no deeper meaning in using functions, sets or logic, it just seems to work. These still are just models of the world for us.