I have Spivak's book actually, I got the hardcover from a used book store several years ago. It did seem a bit daunting to me from what I recall, I had used Tom Apostle's book when studying calculus back then.
I'll give more time to working through Spivak, hopefully it feels more approachable this time around.
[1] http://www.amazon.com/dp/0914098918/