Do you have recommendations for other books? I stopped at multivariable calculus as well. For what it's worth those yellow Graduate Texts in Maths books feel like reading TaoCP or CLRS; I'm looking for more approachable textbooks. I feel like I'm not even up to the 1800s, math-wise, not even up to Gauss.
For a broad overview at an undergraduate level, with a great job explaining the context of various mathematics topics, these Russian books from the 50s, Mathematics: Its Content, Methods and Meaning by Aleksandrov, Kolmogorov, and Lavrentiev, are pretty fun. Amazon link to the one-volume Dover reprint (but I’d recommend finding a used three-volume hardback copy): http://amzn.com/0486409163
Or check out John Stillwell’s Mathematics and its History: http://amzn.com/144196052X
While I do agree, we have to remember why most math classes actually exist: to teach calculus to physicists and engineers, and, as my stepfather's undergraduate advisor once said, "to keep the children from running in the halls".
(For the mathematician's extremely self-centered view of "children" as "anyone who has yet to ace two semesters of real analysis".)
I've been starting into real analysis myself via Pugh's textbook[1] after not taking a serious math class since multivariable calculus, and found that, once I get past the applied stuff, I really like the approach of building up calculus from its foundations in real numbers (taken as Dedekind cuts), limits (Cauchy-convergent sequences), the set-theoretic construction of functions, and the construction of topological and metric spaces "from scratch". But I can tell that I like it because, deep down, I have the mind of a theoretical computer scientist (which is what I like to be when I'm not writing firmware), which is a kind of mathematician. I appreciate that someone has to teach the applied classes to the people who aren't going to kvetch about "how can I trust that works!?" and who demand to just get their math over with as quickly as possible.
[1] -- http://www.amazon.com/Mathematical-Analysis-Undergraduate-Te...