Google's Compute Cloud. You can play with a powerful GPU for 0.20$/hour, and you get 300$/year free I think.

Its quite easy to set up as well, basically a workstation that you can just connect to with remote desktop, but migrate the hardware it runs on.