nVidia's Tesla cards work relatively painless in HPC environments. When you install a supporting driver and set the cards' persistence mode to your needs, the rest is generally automagic.

However, they're hot and need serious juice to run, so you cannot just shove 36 of them to a rack and just power them on.