The "bigger, heavier" part does indeed seem to be a tradeoff. It's been blamed for a significanted rise in pedestrian fatalities, even as vehicles get safer for the people inside.

One source, just after a quick search: https://www.ghsa.org/resources/Pedestrians20