GPU's are parallel, which means they are better if you perform the same operation multiple times. GPU's also are better optimized for floating point arithmetic, but not always integer arithmetic.

This makes sense since GPU's are optimized to calculate graphic-related things, which is often a bunch of floating point operations.