There is also significant cost to society when large companies don't fail, just from their dominant position. Monopoly (and monopsony) is arguably a market failure, and oligopoly or other near-monopoly thus at least a serious market distortion.
There is a cost to society either way.
Reviving a corrupted entity to allow it to continue must have a cost that needs to be weight against the perceived loss of its benefits.
But there's a significant economic cost to society when large companies fail catastrophically like this. Which is why size matters. Large companies mean putting all of our economic eggs in one basket, which is exactly what systems like capitalism are supposed to avoid.