I've had mixed experiences with autograders, but they seem to be important for scaling large classes. Georgia Tech has recently begun using an autograder for some classes in the MS program. It works better for some courses than others, and (inevitably) students end up considering the autograder the ultimate authority of correctness (even when some features can't be tested that way).