The main advantage of a hardware synth is the user experience. Its controls are tailored specifically for that synth.

If it has a built-in keyboard, it also has the benefit of being a self-contained unit, and can feel (psychologically) more like a real instrument.