Second, precision machining. It is much easier to balance 1 set of rotors weighing hundreds of pounds than it would be to balance 4 of them. I'm guessing your typical quadcopter is too small right now for this to be a real concern.
Size of the aircraft is a very important point, but there are other reasons besides the two you mentioned. Generally, larger motors are more efficient than smaller ones. Larger, slower, props are more efficient than smaller, faster, ones, because Thrust ~ Rotor Speed^2 but Power ~ Rotor Speed ^ 3. Why? I don't recall, sorry. I'm more interested in the software. (If you do figure it out though, let me know.)
At least that's my guess. And if I'm right, it's also why, to a first approximation, the power generated by a windmill is proportional to the cube of the wind speed.
It's a scale-dependent effect of air.