Well, yes and no. If you're just talking about integer primes then sure. If you consider gaussian integers though (a + b*i where a and b are integers) then you would have to say "the gaussian prime numbers that aren't 1, -1, i, or -i.

The definition of primes that excludes units makes sense in more places than one that includes units (especially once you start talking about prime ideals instead of prime numbers)