My observation is that the industry ("we") as a whole is slowly but steadily making progress, without throwing our hands and say we need AGI. A big part of this comes from the upscaling of test fleets, which now generate data with enough quantity and variety that you can leverage the existing data tools to analyze and give developers precise and actionable feedback. While Tesla might seem like a popular punch bag in the ADV world, they are a big practitioner of this paradigm and did get good value out of it. That, and the trend of replacing more and more hand-crafted rules with fuzzy numerical models designed to "blend together" the rules (therefore retaining explainability).

In some cases you need to invest as risk mitigation. If someone else does self driving cars and proves that it is safer than human driven cars by a large margin yiy might find yourself out of the car business when governments mandate the technology and you can't afford the license.