An individual pole is relatively fragile indeed, but they're stringed together with steel cables, so the whole assembly is pretty solid.

Source: Worked as a phone technician a while ago, climbed in these poles for a living. I hated climbing in "service poles" (individual poles not connected to the steel cable, used in cases where a house is far from the street), they'd wobble like crazy.