I always uninstall pulseaudio as the first thing I do on my Linux box.

I have always noticed a latency between the time that a sound is supposed to be played and when it is actually played with pulse. This doesn't matter so much when listening to an MP3 or whatever but if you are trying to use a sequencer or play a game it becomes a deal breaker.