I've never liked people who don't understand math and dress it up with philosophical gook. Math is a practical matter, not high philosophy. If you don't know math, your bridges will fall down and your airplanes won't fly.
The reliance of analysis on Cauchy sequences is not "philosophical gook". zemaj may be naïve in her conclusions (or at least unaware of just how much mathematics one must give up when one takes a constructivist view), but she is hardly alone in her hesitancy about infinity. I wouldn't be sure what to make of the claim that Brouwer, Markov or Martin-Löf didn't know mathematics.
Equally if all you care about is working out if your bridge is going to fall down, you don't really have any need for infinity. In fact you can spend an entire career using math to do all kinds of really awesome things without ever actually understanding math. I'd say that a good 95% of engineers fall into that last category, and I'm certainly not worried about driving over bridges because of it.
No infinity required.
The point, though, was that the behavior characterized by the notation is perfectly reasonable even with finite domains (even if the specific notation is not, which was a fatal flaw).
Not only that but the obviousness of "and so on" is often elided. "And so on" assumes unbounded time and/or resources and also assumes you know intimately the (undoubtedly recursive) algorithm and can codify it. These proofs often blatantly ignore that _in practice_ someone or something must perform this algorithm. (Er, not sure if I used elided correctly back there.) Anyhow, if you have an innate distaste for these types of proof then rest assured that you are not alone.
You may check out the esoteric philosopher René Guénon, R. (1946) The Metaphysical Principles of the Infinitesimal Calculus http://books.google.com/books?id=9KyLPwielTEC
Also check out intuitionism by keerazy Dutch mathematician L.E.J Brouwer which asserts that we must essentially modify some preconceived logical tenets/laws in the face of infinity.
See also intuitionistic logic, intuitionistic type theory and constructivism (mathematics). http://en.wikipedia.org/wiki/Constructivism_(mathematics)
Apologies if you were aware of all this already. I have found it very helpful to respect my suspicions. Regardless of what people may tell you, this stuff is neither simple nor straight-forward once you start thinking deeply enough about the minutiae.