News for hackers. Stuff that matters.
Re:San Francisco cops pull over a Cruise driverless car for ... by bo1024 on Monday April 11, 2022 @08:25AM (#30987744)
To add to your point: it doesn’t bother me so much that the AI system doesn’t share these priorities. What I worry about is that the companies designing them are not incentivized to.
Re:San Francisco cops pull over a Cruise driverless car for ... by ricochet11 on Monday April 11, 2022 @09:03AM (#30988080)
surely a company is absolutely incentivized to share these priorities?

every accident is a hit to their profits and pr.

Re:San Francisco cops pull over a Cruise driverless car for ... by bo1024 on Monday April 11, 2022 @11:21PM (#30998225)
No, because they can benefit even more from recklessness than the expected profit/PR damage. Someone already mentioned Tesla, but there is also the Volvo emissions scandal, Boeing's safety failures, and many more examples.

At the extreme end, picture a company that manages to get an okay from the city of SF for public testing, but whose internal tests show there is a small but significant risk of serious accidents and the product needs another two years of development to be safe. Their funding runs out in one year.

What do you think they would do?

Re:San Francisco cops pull over a Cruise driverless car for ... by pempem on Monday April 11, 2022 @10:48AM (#30989552)
I think Tesla has shown this fairly clearly to be untrue.

It takes a hit if there isnt' a very solid marketing/pr/charismatic leader to distract