The overhead of long-polling isn't quite so bad in practice thanks to persistent HTTP connections, where an existing TCP connection is reused for future HTTP requests. Pretty much all browsers support this, and so a re-poll is usually 1 packet.
Of course, long-polling is still more overhead than a streaming connection.
Of course, that may well be enough for some situations, for others, there's too many server-pushed messages to keep up with that model as well.