Unfortunately the size/speed arms race in cars has left streets extremely dangerous for pedestrians, cyclists, and anyone who isn’t driving something weighing 1500+ kg.
Perhaps if vehicle manufacturers/vendors were made partially liable for anyone injured in collisions involving their vehicles it would provide some pressure in the right direction.
(and why did you think a rightsized car would forego seatbelts and had restraints?)
If you look at the "supermini" class cars in NCAP, there are several 5 star cars. Sure they are heavy (~1000-1300kg), but they also represent great potential for improvement if one were to re-think this category.
Right now the technologies that make sports cars and race cars lighter and stronger are expensive. Because composites are hard to manufacture cheaply. What if we were to invest in lowering the cost of cars made from composites? By improving process, by developing new design strategies and by focus on volume?
(As for "impossible": a decade ago, most current Tesla owners wouldn't have dreamt of there being a desirable electrical car. Much less one they themselves would own)
I have some sympathy for this, but not for the accident death toll associated with vehicles that lack crumple zones, collapsible steering columns, head restraints, seat belts, and other stuff we take for granted ... all of which contributes weight and complexity.
It might be possible to revive this purpose if improvements in anti-collision software/hardware makes it cheap and light enough to fit to small vehicles: avoiding an accident is always preferable to having to survive one. But we're not there yet.