Yeah, Maple's actual language is hideously slow. The functions within it seem to run pretty quick, but we were always tought that the moment you wanted to do a loop you should fire up Matlab and do it in that.
The reason I mention Maple is because I found it spectacularly easy to use when I first picked it up, as long as you think like a math student instead of a programming student.
As an amusing anecdote, I had to use Maple for a course once, and compared the speed of a simple algorithm to find the order of an element of Z/nZ (by taking x, and adding it to itself in a loop until you get to 0). The Maple code ran approximately 100x slower than the Sage code, even though the Maple code used machine integers but Sage uses bigints by default.
With Mathematica, the general impression that I get is that for making interactive graphics, Mathematica is slightly better, but otherwise they're mostly approximately even for the first-year case, with a slight edge to Mathematica. Sage's friendly user interface is a web-based notebook, whereas Mathematica has a native application, but it's pretty good. Sage has very good documentation for common use-cases, but I haven't used the Sage notebook in a while, so I can't really say how discoverable it is.
There are some resources on using Sage in an undergrad curriculum here, if you're interested:
http://www.sagemath.org/doc/prep/index.html
though the examples presume you're actually running a Sage notebook, so they don't show what happens, for instance, when you add an @interact decorator to make an interactive thing, like so:
http://wiki.sagemath.org/interact/
which has a nice example of an interactive Taylor-series approximation.