Speaking from experience as I taught myself math at the age of 25, it is not too late to start. I would recommend starting from set theory and combinatorics, which do not require any advanced math knowledge and will help improving your critical thinking.