News for hackers. Stuff that matters.
Re:Tesla FSD Beta Lunges Toward Bicyclist by prof-dr-ir on Tuesday February 08, 2022 @07:08PM (#30266689)
It should by now be pretty clear that Tesla, like Uber before it, are taking the Lord Farquaad approach to self-driving: "Some of you may die, but it's a sacrifice I am willing to make."

It does not have to be this way, and these companies and their leadership deserve every bit of reputational damage they will get out of this.

Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @07:12PM (#30266725)
It's quite literally a public beta, just that the other traffic participants didn't get a say in the opt-in. Given the stakes for them I agree that it begs the question.

In the end it's a regulation problem, not a Tesla problem (even though yes, the specific decision to exercise their options is theirs) - do you allow unlicensed drivers to perform this on-road testing of unfinshed vehicles or not?

It's not quite a deliberate information hiding campaign as with MCAS (as far as we know). But it is pre-production testing of experimental engineering on safety-critical equipment. Experiments not guaranteed to pan out, and engineering lacking a mature certification process.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Barrin92 on Tuesday February 08, 2022 @07:48PM (#30267089)
the fact that there is such a thing as a 'public beta' for moving two tons of steel through pedestrian areas at lethal speeds seriously makes me question our collective sanity. Imagine if gun vendors did public betas where random police officers just get a beta testing gun.

"It might fire in random directions at arbitrary intervals 5% of the time, but that's just how innovation goes folks. You don't like that, do you hate progress?"

Re:Tesla FSD Beta Lunges Toward Bicyclist by FireBeyond on Tuesday February 08, 2022 @08:41PM (#30267534)
Someone said in another thread earlier today that there is a worry that we are making the path towards FSD too erratic, and that if we screw it up, the next shot might be in generations.

People are arguing, with a straight face, that we are ruining (aspects of) humanity by not letting Tesla be laisez-faire with such things (and lets be real, it's predominantly Tesla who is just in full Cowboy/YOLO mode... other players in this field certainly aren't perfect, but they are at least trying to be conservative and cautious).

Re:Tesla FSD Beta Lunges Toward Bicyclist by jimmydorry on Tuesday February 08, 2022 @11:01PM (#30268646)
It's still a regulatory failure in the end. If the government does not want to lay down exactly what path should be taken in getting to FSD, then we should not complain when we don't agree with the path that the manufacturers choose.

As long as Tesla can demonstrate a similar or better rate of serious harm than human drivers, why should we stop them? It's up to government to do their job and outline exactly what price society should bear in the pursuit of this paradigm shift (because let's not kid ourselves, FSD is a complete shift in paradigm for society).

Re:Tesla FSD Beta Lunges Toward Bicyclist by FireBeyond on Wednesday February 09, 2022 @12:20AM (#30269169)
> As long as Tesla can demonstrate a similar or better rate of serious harm than human drivers, why should we stop them?

Because it can't, or won't. Instead they release statistics that _imply_ that it is better, that they have to know are absolutely misleading, because anyone who did high school statistics would be aware thereof.

Everything else, they refuse to release.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jimmydorry on Wednesday February 09, 2022 @09:35AM (#30273067)
I'm not aware of _anyone_ releasing such data in a way. Not that I have been looking that closely for it (so I certainly could have missed this!).

This is another major regulatory failure. Government should lay out the minimum data that the companies must publish, so we can get a better idea of their performance. (It's still a chicken and egg scenario though. You can't get that kind of data anywhere but on public roads in uncontrolled environments.)

Re:Tesla FSD Beta Lunges Toward Bicyclist by dkjaudyeqooe on Tuesday February 08, 2022 @08:00PM (#30267213)
That reminds me of the ED-209 prototype in Robocop: "You have 20 seconds to comply!"
Re:Tesla FSD Beta Lunges Toward Bicyclist by pmoriarty on Tuesday February 08, 2022 @08:31PM (#30267474)
Here's the "20 seconds to comply" scene from Robocop:

https://www.youtube.com/watch?v=Hzlt7IbTp6M

Re:Tesla FSD Beta Lunges Toward Bicyclist by renewiltord on Tuesday February 08, 2022 @08:08PM (#30267269)
This is a fair point. It's pretty bad that we have learner drivers on the road. Can't think of anything more public beta-y than that. Maybe trainee doctors?
Re:Tesla FSD Beta Lunges Toward Bicyclist by gvb on Tuesday February 08, 2022 @08:17PM (#30267348)
I've had three "learner drivers" in my family and I spent quite a few hours as the "safety person" during their apprenticeship. During all those hours I never touched the wheel, brake, or gas. I gave advice occasionally, but never felt that the "learner driver" was driving unsafely.

I assure you that 15 year old young adults drive much better than a Tesla "self driving" computer with millions of miles and millions of hours of training.

Re:Tesla FSD Beta Lunges Toward Bicyclist by renewiltord on Wednesday February 09, 2022 @12:50AM (#30269381)
Oh I’m sure you were convinced but you never asked me if I consented to you randomly putting underaged kids behind the wheel of a two ton vehicle on a road which I share with you.

You’re a regular Yaroslav Kudrinsky, just with better luck. But I suppose one can go around swinging swords in a crowd, hit no one, and convince oneself of one’s good judgment.

Re:Tesla FSD Beta Lunges Toward Bicyclist by rhizome on Tuesday February 08, 2022 @08:26PM (#30267424)
Category error: people have brains.
Re:Tesla FSD Beta Lunges Toward Bicyclist by HarryHirsch on Tuesday February 08, 2022 @08:36PM (#30267510)
That's the important one - a Tesla has no concept of the real world. Remember that clip where a Tesla was slowing down because it mistook the full moon in the sky for a traffic light? Likewise, no one would aim at a cyclist, except when they are a homicidal criminal.
Re:Tesla FSD Beta Lunges Toward Bicyclist by ehvatum on Wednesday February 09, 2022 @07:14AM (#30271753)
> no one would aim at a cyclist, except when they are a homicidal criminal.

The process of not wanting to impact something and attempting to avoid it can occupy so much attention that hitting that thing becomes inevitable. People tend to go where they are looking.

https://www.google.com/search?q=target+fixation

Re:Tesla FSD Beta Lunges Toward Bicyclist by noizejoy on Tuesday February 08, 2022 @08:45PM (#30267576)
… or under the influence of some substance, or a health event, or voluntary or involuntary distraction, or …
Re:Tesla FSD Beta Lunges Toward Bicyclist by HarryHirsch on Tuesday February 08, 2022 @08:50PM (#30267623)
In other words - not living in shared reality.
Re:Tesla FSD Beta Lunges Toward Bicyclist by noizejoy on Tuesday February 08, 2022 @09:04PM (#30267722)
A seatbelt also doesn’t have a concept of the real world and doesn’t live in a shared reality either.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lolinder on Tuesday February 08, 2022 @09:08PM (#30267759)
A seatbelt isn't given control of 2 tons of steel moving at 70 mph.
Re:Tesla FSD Beta Lunges Toward Bicyclist by throwaway0a5e on Tuesday February 08, 2022 @07:51PM (#30267125)
>Imagine if gun vendors did public betas where random police officers just get a beta testing gun.

This is a thing. They give marketing samples to organizations they want to sell to on a "try 'em out and let us know if you want to buy more" basis.

Re:Tesla FSD Beta Lunges Toward Bicyclist by bbarnett on Tuesday February 08, 2022 @07:56PM (#30267177)
Marketing samples are not public betas. They are marketing samples of tested product.
Re:Tesla FSD Beta Lunges Toward Bicyclist by throwaway0a5e on Tuesday February 08, 2022 @08:28PM (#30267449)
If your complaint is that a very conservative manufacturing industry doesn't have 1:1 analogues with software development then I guess it's valid.

Giving organizations stuff you haven't 100% nailed down yet expecting them to come back with stuff they want changed in order to buy is pretty par for the course in the firearms industry. That's as close to a public beta as you're gonna get.

Re:Tesla FSD Beta Lunges Toward Bicyclist by everforward on Wednesday February 09, 2022 @12:39AM (#30269299)
The big difference is that marketing firearms are still safe, or as safe as firearms tend to get. It's a fully functional firearm; they want feedback on whether the ergonomics are good, whether the weight is good, how it handles recoil, etc.

It would be more akin to handing out prototype weapons to police departments, which doesn't happen specifically because they might fire themselves or blow up or fail in some annoying but not spectacular way like failing to feed new rounds.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwaway0a5e on Wednesday February 09, 2022 @06:48AM (#30271579)
The key mechanical features always "work" but little stuff like "gun fails to cycle 500% more often with the particular spec of ammo a particular force uses". A rifle spec'd out for sale to Cambodia probably is going to have a lot of teething issues if you try and sell it to the Swedes unchanged. Are these things "safe"? IDK. But no force is going to put in an order for tens of thousands of guns unless correctable issues like those are proven fixed. Infantry arms are a battle of margins. Everything "works" but a marginally more finicky gun to use is going to mean the people using it are marginally less effective which extrapolates pretty directly to "safety".

At the end of the day the analogy isn't great and we're building a castle in a swamp here.

Re:Tesla FSD Beta Lunges Toward Bicyclist by bcrl on Tuesday February 08, 2022 @08:54PM (#30267660)
A public "beta" of a self driving car should lean towards failing safe. I would expect it to have sudden braking issues and be overly conservative. The kind of bugs we're seeing where obstacles are blatantly ignored make it feel more like an "alpha" release. But hey, we're not designing airplanes here, just thousand pound chunks of metal flying around roads capable of killing people.
Re:Tesla FSD Beta Lunges Toward Bicyclist by salawat on Tuesday February 08, 2022 @08:02PM (#30267222)
...I am aware of zero other manufacturers brazen enough in terms of blatant disregard for Engineering Ethics to have embarked on this type of testing before Silicon Valley did.

In fact, there were licensure processes for this sort of thing already in place in California iirc, so this is less gray area, more "lets outsource testing to the end user".

Frankly, it's downright disturbing.

Re:Tesla FSD Beta Lunges Toward Bicyclist by paulcole on Tuesday February 08, 2022 @07:59PM (#30267205)
> In the end it's a regulation problem, not a Tesla problem

Are you joking? If you’re the one causing the problem, you’re the problem.

No regulation can prevent me from kicking someone in the shins. This isn’t a regulation problem, it’s a me problem.

Re:Tesla FSD Beta Lunges Toward Bicyclist by nrb on Tuesday February 08, 2022 @08:18PM (#30267352)
The <Insert State Here> Code certainly applies penalties for assault and battery, and you can rest assured knowing shin-kicking would happen regularly without it.

The car problem presented here is quite a bit more shades of gray and we absolutely need to set acceptable parameters for the technology.

Re:Tesla FSD Beta Lunges Toward Bicyclist by paulcole on Tuesday February 08, 2022 @11:49PM (#30268969)
Yes, but my point is that if you’re being a jerk, then you’re the problem, not the person who is not saying, “please don’t be a jerk.”

You don’t need a regulation telling you not to be a jerk — unless of course you are a jerk. And even then, you’d probably still be a jerk, regulation or not.

Re:Tesla FSD Beta Lunges Toward Bicyclist by XorNot on Tuesday February 08, 2022 @08:22PM (#30267386)
Except it is: literally none of this is illegal. And it's not clear how it could be illegal: what's the distinction between cruise control and lane keeping and these systems? Very little - nothing you can codify.

It's also very likely that this system can pass a standard driving test: AIs are really good at handling fixed test cases. So any regulation you do pass has a complicated assurance problem: how does it prove the system is safe?

Pretend Tesla just knocked "beta" off the name and said "this is a limited self driving system, Tesla exclusive" - then you wind up in the same bucket with the same "it's the drivers responsibility problem".

People see this footage and assume Tesla self drive does this all the time - but it wouldn't. It probably passes this scenario in testing 100% of the time: but the issue of course is the test is not quite whatever this circumstance is, and the system has a dramatic failure.

There is absolutely a regulation problem.

Re:Tesla FSD Beta Lunges Toward Bicyclist by joeblubaugh on Tuesday February 08, 2022 @08:36PM (#30267507)
There is an extremely bright line.

Can the software automatically make lane changes? Can it initiate turns? Can it decide to make non-emergency stops at lights and signs? Can it accelerate from a stop? What is the expected level of human intervention?

Re:Tesla FSD Beta Lunges Toward Bicyclist by XorNot on Tuesday February 08, 2022 @08:42PM (#30267546)
That determines what the system is.

The question I'm posing is, how do you prove it works to an independent authority?

It would be extremely reasonable for us to regulate along these lines, but I'm also absolutely willing to bet that Tesla and every other system would get through an approval process just fine.

Which sort of loops around too a wider issue: if self driving is a priority, then it needs to be a government, collective priority for public safety and development.

I.e. independent reading institutes, a suite of diverse randomised tests and yes: because this is no longer "on the driver" for accidents then both the government and company will be taking responsibility for failures.

The issue is that the law of the land is: these systems aren't illegal, and the driver is responsible for how the car handles including any automation they engage.

To make any progress you have to break driver responsibility - or use that bright line and just outlaw the whole lot.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jowsie on Wednesday February 09, 2022 @08:31AM (#30272385)
>but I'm also absolutely willing to bet that Tesla and every other system would get through an approval process just fine.

It would be Diesel Gate all over again. The testing would have to be documented somewhere and the car could just be trained for the test scenarios. Considering how often Tesla like to massage their numbers (nurburgring data, sales figures in basically every country, most recently Australia, the big asterisk next to their 1.9s 0-60 run, etc etc) I can't trust they wouldn't train directly for the test and neglect everything else just so they can have the best headlines once again.

Re:Tesla FSD Beta Lunges Toward Bicyclist by oogabooga13 on Tuesday February 08, 2022 @08:52PM (#30267646)
I've wondered if it would be a good idea to have some sort of external indicator on cars that indicates to others that are driving, cycling, on foot that the vehicle is in autonomous mode. At least then maybe one can understand the potential risk driving around them. (Noted that an indicator doesn't really help if the vehicle is behind you in a lot of instances!)
Re:Tesla FSD Beta Lunges Toward Bicyclist by heavyset_go on Tuesday February 08, 2022 @09:04PM (#30267725)
One thing I've noticed the past couple of years is that it isn't that hard to determine whether or not a car is autonomously driving. If they're driving like they're drunk and they're in a Tesla, 9 out of 10 times, you'll see that that the driver isn't paying attention to the road at all because they're using Autopilot or FSD. I just treat the Tesla drivers around me on the road as if they're drunk and keep my distance.
Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @09:21PM (#30267873)
Elsewhere in the thread a FSD Beta participant is imploring other drivers to keep their distance to Teslas because the software "gets easily spooked".

This makes it even harder to assess the safety of the system - other drivers are helping it along as well.

Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @09:19PM (#30267864)
Several manufacturers have experimented with such systems in concept cars, e.g. animated grilles that signal in green when an oncoming car has recognized a pedestrian and is slowing in response.
Re:Tesla FSD Beta Lunges Toward Bicyclist by jrib on Tuesday February 08, 2022 @09:50PM (#30268108)
Re:Tesla FSD Beta Lunges Toward Bicyclist by cwkoss on Tuesday February 08, 2022 @08:02PM (#30267223)
What does MCAS mean here?
Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @08:06PM (#30267258)
It's a software system overriding pilot input on Boeing 737 MAX airplanes, designed to make up for cost reductions in adequate hardware design. Pilots were deliberately not well-informed and the system caused two crashes. It was brought up elsewhere in the discussion. In general cars are headed into an aviation-like situation with automation, so case comparisons are becoming more frequent.

It's very apples to oranges here, but loosely relevant wrt/ information/documentation and in the cameras-vs-LIDAR/sensor fusion debate.

Re:Tesla FSD Beta Lunges Toward Bicyclist by rhizome on Tuesday February 08, 2022 @08:30PM (#30267466)
I'm sure the policy and regulatory systems will be able to fend off the lobbyists of the richest person in the world working to get the word "liability" redefined in the law. \s
Re:Tesla FSD Beta Lunges Toward Bicyclist by ofcrpls on Tuesday February 08, 2022 @08:04PM (#30267244)
Re:Tesla FSD Beta Lunges Toward Bicyclist by wavefunction on Tuesday February 08, 2022 @08:02PM (#30267230)
lol @ public beta
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @07:51PM (#30267119)
I was expecting autopilot to be seriously dangerous, but the data doesn’t back that up. Out of 234 deaths from accidents involving Tesla’s 12 people have died while Tesla autopilot was known to be in use or had recently been in use. http://www.tesladeaths.com Autopilot might be slightly worse than human drivers depending on how you slice the data but that’s about it.

I don’t think it’s a regulation problem as much as it is an acceptance by regulators that driving is inherently dangerous and autopilot isn’t dramatically worse. It’s not even obvious if on net more people would have died if Tesla had never released autopilot.

Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @07:57PM (#30267189)
Note that FSD beta participants are selected/limited by Tesla based on proprietary "safe driver" scoring, so FSD data doesn't say much about how the gen pop might fare at managing the system. (I know you were writing about Autopilot -- discussion is on FSD Beta though.)

Note also that other drivers are learning behaviors such as keeping their distance from Tesla's, etc., making it harder to assess the system functionally.

Edit: Actually, there are docs for the scoring, sans changelog though: https://news.ycombinator.com/item?id=30267858

Re:Tesla FSD Beta Lunges Toward Bicyclist by FireBeyond on Tuesday February 08, 2022 @08:43PM (#30267562)
Or social media clout (maybe not so much any more) where several prominent "influencers" got access regardless of scoring.
Re:Tesla FSD Beta Lunges Toward Bicyclist by bryanlarsen on Tuesday February 08, 2022 @08:25PM (#30267414)
Autopilot and FSD are two different things. Elon claimed 0 accidents for FSD late last year, but this year there is video of a Tesla running into a post.
Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @07:54PM (#30267156)
the data is extremely questionable
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @07:57PM (#30267190)
In what way?
Re:Tesla FSD Beta Lunges Toward Bicyclist by tom-_- on Tuesday February 08, 2022 @08:25PM (#30267418)
1. Dangerous means causing injury, not just death.

2. How many times has autopilot disengaged and would've caused injury without human intervention?

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @08:06PM (#30267257)
Sampling bias, confirmation bias.

Did you delete your link to tesladeaths.com because you realized the fine print about sketchy autopilot data contradicted your point? Oops!

Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @08:11PM (#30267285)
No, I was trying to keep the link without a http://, https://www.tesladeaths.com/ or https://www.tesladeaths.com/ works www.tesladeaths.com doesn’t nore does www.tesladeaths.com/

I am sure I have seen comment links without the http:// but might have just gotten so used to it than I stopped seeing it.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @08:22PM (#30267390)
uh huh. why do you think it's reasonable to conclude that this system is safe given that the reported data is based on faulty analysis [0] and inexplicably exempt from reporting requirements for testing self-driving cars?

[0] https://jalopnik.com/feds-tesla-autosteer-safety-investigati...

Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @08:58PM (#30267690)
I don’t think it is safe.

I just don’t have data showing it’s terrible.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @09:05PM (#30267732)
ok but you think it's reasonable to let them test their unproven software (which has already killed people) on public roads anyway?
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @10:08PM (#30268250)
Yes, as there is no other way to prove it’s safe. Aka your suggesting an impossible standard for any company to meet.

Further the only reasonable standard is roughly average human competency. As soon as a tired driver can turn on self driving and be safer on the road then banning that technology has a real cost.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @10:44PM (#30268517)
of course there is, it's what every other company is doing: safety drivers with reporting requirements
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Wednesday February 09, 2022 @09:11AM (#30272785)
Testing hardware and software via safety drivers on public roads doesn’t actually prove safety in the hands of the general public. Just as FSD being released to the safest drivers first doesn’t prove safety in the hands of the general public.

The general public doesn’t use products like you might assume. For example toilet plungers have killed or seriously injured people and not because they where used as a weapon.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Wednesday February 09, 2022 @11:26PM (#30282450)
what??? they're not subject user error. that's the whole point, and how many times fallible humans had to take over is exactly what the disengagement report tracks
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Thursday February 10, 2022 @11:53AM (#30288959)
The platonic ideal self driving system possible doesn’t prevent a tire blowout from poor maintenance etc. Similarly a test fleet isn’t going to replicate the publics actual origins, destinations, and time of day. Something as simple as people going to bars more because the self driving system can get them home would mean a different risk profile.
Re:Tesla FSD Beta Lunges Toward Bicyclist by ModernMech on Tuesday February 08, 2022 @07:22PM (#30266830)
The thing that really grinds my gears about all of this as a roboticist, is that as a community we had a pretty good culture of taking safety seriously. In 2014, the idea of unleashing onto the public admittedly beta-quality autonomous car software, on a platform that eschews industry best practices was unfathomable.

Then came Autopilot and later FSD, and Tesla threw the concept of safety was thrown out the window. An autonomous Tesla decapitated a man in 2016, and Tesla continued unabated! What actionable steps did Tesla take as a result of that incident to make sure it never happens again. Even today in 2022 you can find videos of Teslas on public roads just completely failing to detect and colliding with stationary objects. The culture at Tesla seems to not care this is happening, as it continues to happen.

It used to be that when your robot did a single thing wrong or caused the most minor of injuries, let alone it killed someone, then you engineered the hell out of it and implemented safety protocols to make sure that failure mode would never happen again. Not at Tesla, apparently.

I get the utilitarian argument that maybe self driving cars could reduce traffic accidents in the future by being better than humans on average. But safety doesn’t happen unless you really work at it, with intention. Using your customers to beta test your 2 ton robots on public roads is not a safety-focused mindset. Tesla is not a company that values safety first when it comes to their autonomous car project.

Re:Tesla FSD Beta Lunges Toward Bicyclist by kodah on Tuesday February 08, 2022 @07:33PM (#30266951)
I haven't worked in robotics, but I've worked in automation for quite some time (digital and real-world). Two examples I can think of:

- SCADA always had hot, hardware backups and failure detection. To the extent that I thought this was dogma.

- Physical automation (like car construction equipment and robotics, pick and place machines, etc) have safety zones that humans aren't allowed in or near. Same thing for Amazon warehouse robotics.

I'm not sure how we leapt to, "beta test cars on the street" from there.

Re:Tesla FSD Beta Lunges Toward Bicyclist by TOMDM on Tuesday February 08, 2022 @07:54PM (#30267157)
I think the issue is partly that people don't see cars as large industrial robots because we're just so used to them.

Everyone who has ever written code for a robot knows you should treat every pinch point as a finger blender, but the cars look nothing like them.

Tesla's branding may make that excusable for the layman, but for the employees at Tesla, that branding is incredibly irresponsible

Re:Tesla FSD Beta Lunges Toward Bicyclist by heavyset_go on Tuesday February 08, 2022 @07:44PM (#30267043)
It seems to me like the lives of countless people are seen as edge-cases that don't matter to Tesla's big picture of profits and growth.
Re:Tesla FSD Beta Lunges Toward Bicyclist by belter on Tuesday February 08, 2022 @07:25PM (#30266877)
Why all the euphemisms and diplomatic language? There is one word for it: Criminal.
Re:Tesla FSD Beta Lunges Toward Bicyclist by randoglando on Tuesday February 08, 2022 @08:16PM (#30267331)
> I get the utilitarian argument that maybe self driving cars could reduce traffic accidents in the future by being better than humans on average.

This keeps being touted (by Elon and others), but is a long way away: https://twitter.com/Tweetermeyer/status/1488673180403191808

Tesla uses misleading stats (like not excluding highway miles, which are inherently safer) to try and make it seem like autopilot is any good.

Re:Tesla FSD Beta Lunges Toward Bicyclist by ModernMech on Tuesday February 08, 2022 @10:13PM (#30268292)
Yeah, and the reason Elon is reaching for aggregate statistics is because he can't argue that his platform is fundamentally sound. I mean, the primary directive of any driverless car is: don't run into anything. That's it, that's all it has to do. Yet Teslas routinely run into stationary objects, and not because those objects are somehow particularly pathological and would generally fool most anyone. No, they are specifically confounding to the way Tesla does things, in a way that practitioners in the field aware of and know how to solve, but which Elon Musk stubbornly refuses to recognize.

I keep harping on it but the decapitation incident in 2016 is just so illustrative of what kind of culture Tesla is fostering. Here's a situation where reckless engineering choices by Tesla literally caused a customer to lose his head. The solution which would fix this problem would be to add more orthogonal sensor modalities, so that any blind spot in one sensor can be compensated for by another (e.g. LIDAR will not see a glass wall, but SONOR will).

But what did Tesla do? They actually doubled down! They removed existing orthogonal sensors and they made everything worse! Now basically the entire thing is driven by vision, and it's still predictably exhibiting the same failure mode of running into broad and stationary objects as it did 5 years ago (which by the way was approximately the amount of time Elon Musk predicted it would take for them to get to level 5 autonomous driving. Instead they've bumbled around for half a decade and failed to make any significant progress).

Re:Tesla FSD Beta Lunges Toward Bicyclist by lhorie on Tuesday February 08, 2022 @07:58PM (#30267194)
For Uber at least, self driving was effectively a money-losing pipe dream, so it kinda did itself a favor by divesting via the sale of the division to Aurora.

For Tesla, though, FSD is still such a front and center thing that I'm having trouble seeing how it ever plans on saving face as it gets more and more bad press from incidents like this.

Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @09:53PM (#30268124)
The feature sells cars.

Remember that guy in southern California who got arrested for sleeping in the back of his Tesla while it drove him home, and he said he did it many times and would do it again? The system works well enough that he did it many times before he got caught.

That guy is an idiot, but think about that story from another angle: You can fall asleep while driving any car. The difference is, if that car is a Tesla, you might not die.

As a driver aid for non-crazy people FSD is a good system and Tesla owners like it. It's far from being vaporware.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @10:11PM (#30268272)
dang is going to ban me if I share how this take makes me feel. so let me just say that the proliferation of evidence-resistant memes such as this one concerns me greatly, and I feel even more unsafe as a pedestrian and cyclist on the street than I did before knowing that there are people who think that this is reasonable.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lhorie on Tuesday February 08, 2022 @11:35PM (#30268868)
> The feature sells cars

Right. Similarly, the fast Prime delivery guarantees from Amazon are backed by warehouse workers working their asses off, and I'm sure we've all heard about the bad rep Amazon gets for worker treatment and the subsequent attrition challenges they've been facing.

It feels like Tesla is setting itself up to be stuck between a rock and a hard place, being reliant on their FSD marketing to make money but simultaneously tainting their brand beyond salvation by this very same reliance.

Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @11:39PM (#30268897)
I think you vastly overestimate the effect this has on the brand. At this point everyone who buys a Tesla has heard stories similar to this, in addition to stories about quality and body panel fitment etc., and they buy them anyway.

Amazon doesn't seem to be hurting either, despite the bad press they get about their warehouses.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jquery on Tuesday February 08, 2022 @10:38PM (#30268472)
> he said he did it many times and would do it again?

Based on the videos I’m seeing of FSD in action, I have my doubts. Wouldn’t be surprised if this was a publicity stunt. Elon Musk has a very loose relationship with ethics and the truth. They’re just obstacles for him.

Re:Tesla FSD Beta Lunges Toward Bicyclist by rhizome on Tuesday February 08, 2022 @08:35PM (#30267501)
It's not money-losing if you take the program's effect on stock prices into account, and maybe you'll even accept that it's always been a stock manipulation tool.
Re:Tesla FSD Beta Lunges Toward Bicyclist by belter on Tuesday February 08, 2022 @07:23PM (#30266854)
Re:Tesla FSD Beta Lunges Toward Bicyclist by ape4 on Tuesday February 08, 2022 @07:58PM (#30267195)
Going out of its way to hit the bollard - wow
Re:Tesla FSD Beta Lunges Toward Bicyclist by belter on Wednesday February 09, 2022 @10:36AM (#30273840)
Did you notice the most likely reason? Slightly to the right, of the line of bollards, there is a small patch of road and another strong white line.

Kind of almost 1 meter, ( 3 feet) wide.

So it thinks the tiny patch between the bollard, and the right most white line, is the right driving side of the road.

Re:Tesla FSD Beta Lunges Toward Bicyclist by AtlasBarfed on Tuesday February 08, 2022 @10:01PM (#30268195)
Not that it justified overhyping or undercaution by Tesla, but lets be real:

everyday driving comes down to that same acceptance of risk

Let's not be perfect be the enemy of the good: a self-driving highway system can probably be achieved with current technology that beats human drivers for long distances. I wish that was the priority rather than the robotaxi obsession.

Self-driving highway systems would produce immediate profit and economic savings that could fund the drive-grandma-to-Taco-Bell systems, as well as the convergent infrastructure, common signaling systems, embedded sensors, better signage and standards, improved and predictable construction signals and routing, etc.

Following the usual hype cycle, it will be highway logistics that smooths over the "despair" portion and does the practical incremental improvement.

Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @08:17PM (#30267339)
Self-driving cars will never be a reality if the standard for success is zero deaths during the early stages of development. It just won't happen. The technology won't ever be good enough if it's not tested in the real world.

Furthermore, no self-driving system will be perfect even in a mature stage of development. People will still die, and they may die because of mistakes a human driver would not have made.

If society isn't willing to accept that sacrifice, then let's just ban self-driving cars.

But let's not try to have it both ways -- let's not allow self-driving while also holding the view that risk of death is unacceptable.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Veserv on Tuesday February 08, 2022 @08:54PM (#30267664)
The standard for success is not zero deaths, but it should at least be a system no more dangerous than human drivers.

Generally speaking, the average human driver causes a “ding” every 100k miles, a insurance worthy event every 250k miles, a police worthy event every 500k miles, and a fatality every 60M miles. Assuming an average driving speed of 60 mph, which is obviously an overestimation, those are 1.6k, 4k, 8k, and 1M hours respectively.

Evaluating a L2 autonomy system is somewhat challenging since in truth you are evaluating a human+autonomous system, so you should expect the overall safety to increase unless the autonomy system is actively making things more dangerous. However, for a L4/L5 autonomy system, which is Tesla’s goal, we can reasonably approximate the quality by miles per intervention as an intervention is a failure of the autonomy.

As a reasonable baseline based on video evidence of FSD, we can assume that each intervention prevents at least a “ding”. Therefore, we can evaluate the quality of FSD relative to a minimal L4 system as the ratio of time per disengagement versus 1.6k hours. Using those same videos as evidence, we see the FSD system requiring intervention every few minutes, i.e. <10 minutes, on average. That is 1/10,000 of the minimal quality expected from a fully functional L4 system.

So, for Tesla to create a minimal acceptable L4 autonomy solution that would actually usher in a age of safe self driving systems, they need to improve the core functionality of their beta product by 10,000x. It is that gap between what they are delivering and what they still need to achieve that is outrageous.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jimmydorry on Tuesday February 08, 2022 @11:43PM (#30268930)
In this stage of the product development the rate of intervention is not, and likely won't be for a long time, a good measure of failure. We likely won't see full L4 systems for a very long time.

In the mean time, we could start to get a better handle on the safety profile of these systems by better classifying the interventions.

Something like these:

* Intervention due to unreadable conditions (e.g. unpainted lines, a new area with no training data, failure of LIDAR / camera, w/e)

* Human intervention due to not feeling safe

* Intervention due to unsafe condition (e.g. imminent collision, or just hit something)

* Human intervention for other reason (e.g. human is bored, or human changing destination, or human wanting to take another route)

---

#1 could certainly lead to #2 and #3, but is more of an indicator that the car is in novel conditions not trained for, or has hardware failure. #1 is the low hanging fruit (relatively speaking), and #2 is where the majority of the work lies.

#3 is where the system has actually failed.

And #4 need to just be discarded.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Smoosh on Tuesday February 08, 2022 @11:43PM (#30268935)
I agree with you overall, but would question two parts of your post.

> we can assume that each intervention prevents at least a “ding”.

I don't think we can be sure that the vehicle wouldn't have corrected itself in time, nor how many would have been much worse than a "ding". This is where some closed course testing with simulated pedestrians and bicycles etc may give more evidence. In evaluating self driving software, knowing what the consequences of a failure are is important. As you point out, safety drivers prevent this assessment.

> based on video evidence of FSD

I think that there is selection bias in the readily available footage. Firstly, the short clips are likely to be where there is an incident. The longer ones are usually beta testers deliberately choosing tricky routes to test the FSD. I don't see anyone posting videos of a 3 hour freeway drive where nothing happens.

But my point is just that this is complex, and we should be much more careful than we are being.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jquery on Tuesday February 08, 2022 @10:41PM (#30268493)
Very well said. You’ve put into words what my intuition has been screaming at me but has been unable to properly formulate. Thank you.
Re:Tesla FSD Beta Lunges Toward Bicyclist by marricks on Tuesday February 08, 2022 @08:35PM (#30267506)
You are introducing a ridiculous binary. There are innumerable ways to test this software, even on public roads, without unleashing it on the thousands of Tesla owners.

It's not like Tesla has to release new features every year, they just feel they need to to continue to pump up and justify their stock price.

EDIT:

I misread the parent comment, I’m not opposed to just banning self driving cars as self driving cars likely won't make everyday folks' life better.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jacquesm on Tuesday February 08, 2022 @08:51PM (#30267631)
I'm fine with them unleashing it on Tesla owners, they at least have a choice in the matter. I'm not fine with unleashing it on everybody else too.
Re:Tesla FSD Beta Lunges Toward Bicyclist by judge2020 on Tuesday February 08, 2022 @09:04PM (#30267726)
Driving on public streets is an exercise in choreography, so they're the same thing.
Re:Tesla FSD Beta Lunges Toward Bicyclist by jacquesm on Wednesday February 09, 2022 @08:22AM (#30272290)
No they are not. Low quality software in control of a two ton chunk of iron moving at 35 mph through traffic including pedestrian and bycicles has nothing to do with choreography, that bike was about to be hit from behind because of a vehicle steering into it.
Re:Tesla FSD Beta Lunges Toward Bicyclist by judge2020 on Wednesday February 09, 2022 @04:11PM (#30278523)
Choreography in terms of doing things in concert with other road users without classing, including vulnerable road users (pedestrians, bicyclists). My point is that unleashing it on Tesla owners is obviously going to involve interacting with other road users.

Just because this instance was regarding a bicyclist doesn't mean it's only a danger to bicyclists, there are still ways for people to die if the car were only interacting with other Teslas.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @08:41PM (#30267543)
the other companies seem to have no problem following the rules and not killing people.

I'm more of the mind that cars should become the second-class citizens they ought to be in cities and that I should be able to bike around the city without constant threat of death, that dream remains far off in american cities.

Why is that fire codes and aviation regulations are written in blood, but traffic violence is treated as a normal, necessary cost of modern life? When a biker is killed by a driver who wasn't signaling and cut them off on a right turn (as happens to me on a daily basis in SF), that should trigger immediate redesigns of intersections and streets across the city, for that was an entirely preventable death.

But nope. Go ahead and test your fundamentally flawed, unproven death machine on public roads.

I gotta say, I am really not that keen on being killed by a white tesla.

Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @09:54PM (#30268135)
> the other companies seem to have no problem following the rules and not killing people.

What rules did Tesla break?

Also, remember that time Waymo killed a pedestrian?

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @09:59PM (#30268180)
that this is not explicitly illegal is the problem. everyone else has safety drivers and is subject to reporting requirements.

waymo never killed a pedestrian

Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @10:16PM (#30268319)
> waymo never killed a pedestrian

Yeah, it was Uber, my mistake.

But that's an example another self-driving company that killed people. It could have easily been any of them -- they have all had accidents that could have resulted in death, and just got lucky. Tesla is not special here.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @10:59PM (#30268621)
I think it is of questionable rationality to accept the null hypothesis between uber (0.4 miles/disengagement in 2018) and waymo/cruise (~700k miles, ~30k miles/disengagement in 2020; ~11k and 5k miles/disengagement in 2018, respectively), but reject the null hypothesis for tesla which reported....... 12 miles of self-driving in 2020.
Re:Tesla FSD Beta Lunges Toward Bicyclist by serioussecurity on Tuesday February 08, 2022 @08:48PM (#30267605)
But there are competent folks in the field... ? Waymo's easily five years ahead of Tesla.

Previously: https://news.ycombinator.com/item?id=30182141

Re:Tesla FSD Beta Lunges Toward Bicyclist by elihu on Tuesday February 08, 2022 @09:56PM (#30268161)
I think a reasonable standard is: if someone dies, is seriously injured, or likely would have died or been seriously injured if the driver hadn't intervened in a situation that a normally competent driver wouldn't have had a problem then the self-driving system in question should be disabled globally until the vendor of the system can reasonably convince the NTSB or other relevant government agency that they've taken adequate precautions that it's very unlikely to happen again.

It's to be expected that people will occasionally die in car accidents. Some things are hard to avoid. If someone on a bicycle comes shooting out into a busy street when they don't have the right away and no one could see them coming, they're probably going to get run over. My general expectation for self-driving vehicles is: don't create unsafe situations that weren't there before, don't behave in unpredictable ways, and if you can't avoid running someone over at least do it in a way that the consequences fall on the person doing risky things. In the above example, swerving to miss the biker is fine if it can be done safely, but swerving to miss the biker and instead running over someone on the sidewalk instead is not. (Or, in other words: if you can't avoid an accident, at least be predictable and try to obey the general principles of right-of-way.)

Swerving at a bike for no reason as in the video above should result in suspension of self-driving features (assuming the video is real and wasn't staged in some way).

Re:Tesla FSD Beta Lunges Toward Bicyclist by josephcsible on Wednesday February 09, 2022 @12:18AM (#30269156)
> or likely would have died or been seriously injured if the driver hadn't intervened

I can see this being a reason to ban a system from operating at SAE level 3 or above, but isn't the entire difference between level 2 and level 3 that things like that are expected to happen at level 2 and below, hence the reason for drivers having to always be ready to immediately intervene at those levels?

Re:Tesla FSD Beta Lunges Toward Bicyclist by elihu on Wednesday February 09, 2022 @03:15AM (#30270230)
I think one could reasonably say that a car shouldn't be expected to save the driver from all situations when the self-driving features are just a backup system and the driver is expected to be in control. However, those features shouldn't cause unsafe situations all by itself, like the example video of the car trying to swerve into a bicyclist.
Re:Tesla FSD Beta Lunges Toward Bicyclist by heavyset_go on Tuesday February 08, 2022 @08:58PM (#30267688)
Somehow, I don't think the only way to get self-driving cars is if we first crack a few skulls testing them out on the public without their consent.
Re:Tesla FSD Beta Lunges Toward Bicyclist by root_axis on Tuesday February 08, 2022 @09:40PM (#30268027)
Your framing assumes as a given that Tesla's self-driving tech will eventually succeed given a suitable buffer for human collateral damage, but there is no guarantee that this is the case and Elon's decade of falsehoods regarding the timeline and capabilities of FSD technology doesn't inspire confidence.
Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @09:44PM (#30268075)
Right, there is no guarantee it will ever work.

However, self driving is definitely guaranteed to fail if it can't be tested on public roads. And that's really the challenge here -- it can only succeed if society is willing to take the risk.

Re:Tesla FSD Beta Lunges Toward Bicyclist by admax88qqq on Tuesday February 08, 2022 @08:21PM (#30267381)
We don't have to ban self driving cars. We just set the success criteria at zero deaths. If companies want to spend money pursuing it believing they can hit that goal that's on them.
Re:Tesla FSD Beta Lunges Toward Bicyclist by standyro on Tuesday February 08, 2022 @08:45PM (#30267577)
We have around 38,000 deaths a year on US roads. We already accept significant risk to maintain the status quo.

Sensible legislation is needed to balance innovation and safety for self driving cars on public roads, but not zero. We don’t even accept zero pedestrian hit and run deaths yet…

California, Texas, and Michigan legislators have already bought in to the benefits that these companies will bring.

Re:Tesla FSD Beta Lunges Toward Bicyclist by josephcsible on Wednesday February 09, 2022 @12:22AM (#30269181)
Zero deaths is a completely unreasonable standard. I literally can't think of a single thing at all that's never contributed to anyone's death.
Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @08:23PM (#30267402)
> We don't have to ban self driving cars. We just set the success criteria at zero deaths.

That's equivalent to a ban.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Karrot_Kream on Tuesday February 08, 2022 @08:40PM (#30267531)
There's multiple alternatives to driver-driven cars that result in many fewer excess deaths. They've been trialed and deployed in many countries very successfully. You may know of them by common names such as "buses", "streetcars", "trains", "metros", or even "people movers". There's nothing wrong with innovation but we do not need to put self-driving technology on a pedestal when there are alternatives that exist today that move people around that have none of these externalities. If entities want to innovate, let them innovate within safety parameters.
Re:Tesla FSD Beta Lunges Toward Bicyclist by thereisnospork on Tuesday February 08, 2022 @08:58PM (#30267691)
We could also set the speed limit to 5mph and limit cars to 10hp. That would save a lot of lives. The reason we don't is because some deaths are worth the cost.

>If entities want to innovate, let them innovate within safety parameters.

Sure, but the safety parameters have already been established[0] at 40,000 deaths a year, or less, for transportation equivalently convenient and functional as compared to a manually-driven car.

[0]By the crowd-sourced wisdom of democracy.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Karrot_Kream on Tuesday February 08, 2022 @09:04PM (#30267723)
> We could also set the speed limit to 5mph and limit cars to 10hp. That would save a lot of lives. The reason we don't is because some deaths are worth the cost.

Are you saying that, despite transit alternatives that do not lead to excess deaths, that deaths due to self-driving cars is worth the cost? We have existing solutions that don't result in these excess deaths, but because of some reason, we don't want those solutions _and_ we want to kill more people just to birth this technology? _Why_?

> [0]By the crowd-sourced wisdom of democracy.

... Which bill are you talking about? I don't remember my Rep or Senator voting on allowing me to be a casualty of the self-driving industry. The fact that automobiles in the US result in 40k deaths is itself a travesty. Even Canada is doing better than the US here. Pointing to the worst driving safety record in the G8 and one of the worst in the G20 isn't exactly proof positive that the American automobile system is safe, it's just proof that we have grandfathered an extremely unsafe system here.

Re:Tesla FSD Beta Lunges Toward Bicyclist by thereisnospork on Wednesday February 09, 2022 @12:31AM (#30269234)
>We have existing solutions that don't result in these excess deaths

The existing solutions <As chosen by the collective will of the American people> cause 40,000 dead Americans every year. Other 'Solutions' are not. Don't ask me why they are not, ask your neighbor, and your congressman -- but they are not. Also ask yourself how many collective minutes spent waiting for a bus is a traffic fatality worth? This isn't rhetorical, the answer is a number.

>Which bill are you talking about?

Lets start with the United States Department of Transportation, followed shortly thereafter by your state's department of transportation.

>it's just proof that we have grandfathered an extremely unsafe system here.

All the reason why a potentially new system should have to meet the safety standard of 'less unsafe' and not 'perfect'. Literally every day the adoption of self driving is delayed kills 109.6 people[0] because that's one more day of the status quo. To save lives we should be damn near throwing people in front of Teslas to help them train instead of wringing our hands over the matter.

[0]As much as, divided by the relative eventually safety of a fully developed self driving. As Americans, more globally of course.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Karrot_Kream on Wednesday February 09, 2022 @01:39AM (#30269672)
I'm confused. Is the only way forward private automobiles? Did the creation of the Department of Transportation ban the creation of transit?

Americans choose automobiles because of zoning laws mandating massive setbacks and minimum parking requirements. There's nothing in the DoT or my state's DoT that mandates use of a car. It's all due to American city planning, which is driven by auto friendly city planning policy. So again, why is transit out of the question here?

Self-driving cars aren't an incremental improvement away. We have no idea how many more deaths are needed to mature the technology. So why are we bending over backwards for it when there are proven solutions to move people without casualty? If self driving can innovate without casualty, then be my guest.

Re:Tesla FSD Beta Lunges Toward Bicyclist by thereisnospork on Wednesday February 09, 2022 @03:02AM (#30270152)
>If self driving can innovate without casualty, then be my guest.

You would kill tens of thousands of people a year with that policy decision.

Re:Tesla FSD Beta Lunges Toward Bicyclist by admax88qqq on Friday February 11, 2022 @07:17PM (#30308678)
> To save lives we should be damn near throwing people in front of Teslas to help them train instead of wringing our hands over the matter.

The unstated assumption in this is that self-driving is feasible with current technology and without enough training will be better than human drivers.

Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @09:46PM (#30268085)
It seems like what you really want is to ban cars and force everyone to use public transit.

That's just not realistic, not even in Europe.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Karrot_Kream on Wednesday February 09, 2022 @01:44AM (#30269697)
That's a strawman. You can make private automobile ownership much safer and more convenient by building transit. What you're implying is that "forcing everyone to use public transit" is bad, so we need to sacrifice a couple thousand people for self-driving cars? My argument is that we can put much more stringent safety requirements on automobile users. If self driving cars can meet those requirements, then be my guest. Why are you willing to bend over backwards, to the point of endangering others, just to avoid public transit or other proven safe technologies?
Re:Tesla FSD Beta Lunges Toward Bicyclist by 6510 on Tuesday February 08, 2022 @09:56PM (#30268155)
That seems like a much to fun thought experiment to just do away with.

Why wouldn't it be realistic?

Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @10:19PM (#30268337)
Riots in the streets? That happened in France when the government increased the price of diesel. Imagine what would have happened if the government had tried to ban cars entirely!

If a state government or the US Federal government tried to ban cars, they would be out of power very quickly, even in the most liberal parts of the country.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Karrot_Kream on Wednesday February 09, 2022 @01:37AM (#30269662)
Yes and I'm pretty sure if you let everyone know they're going to be enrolled into a massive experiment to test beta self driving software upon themselves with or without their consent, then they're going to be rioting also.
Re:Tesla FSD Beta Lunges Toward Bicyclist by 6510 on Wednesday February 09, 2022 @04:08AM (#30270586)
We fix that by doing it really really slowly.
Re:Tesla FSD Beta Lunges Toward Bicyclist by rhizome on Tuesday February 08, 2022 @08:32PM (#30267483)
Because the technology is a non-starter and will never work unless accepted terms of public safety are redefined in its favor. "Just draw a bigger bullseye!"
Re:Tesla FSD Beta Lunges Toward Bicyclist by kyleee on Tuesday February 08, 2022 @08:45PM (#30267579)
of course it's not, it just increases expense, but that should be offset by the potential reward of a true breakthrough. it will change the innovation path yes but it's not a ban
Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @09:56PM (#30268160)
Impossible standards are equivalent to bans, and zero deaths is an impossible standard.

All of the companies that are testing self-driving cars have had accidents with other cars and pedestrians. Some of them resulted in death. Others did not, but easily could have, and eventually their luck will run out and they will also cause deaths.

Who would invest millions of dollars into developing a technology when a single mistake could flush all that money down the drain?

Re:Tesla FSD Beta Lunges Toward Bicyclist by lvs on Tuesday February 08, 2022 @07:20PM (#30266810)
This is normally when regulators step in.
Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Tuesday February 08, 2022 @08:07PM (#30267260)
I also think there is a certain fear or outrage around this stuff which is fueled by "technology" or the unknown.

People are some of the worst drivers around, they cause all kinds of problems with cluelessness and inattention and they crash and die and kill and injure in all sorts of stupid ways. They get drunk, high, check their phone, fall asleep, speed, show off

I think it's great that there are still companies out there throwing research into moonshot types of research projects like this. Automobile deaths are perhaps the biggest and most persistent pandemic we've faced, we've been facing for a hundred years, and it kills and maims young and old alike. Millions of people dead over the years.

Many were willing to relax some of the protocols around vaccine testing to bring the covid vaccines in to use earlier, put mandates and coercion around them, and yes some suffered adverse reactions and even died from them. Still, it was thought to be a reasonable compromise by many.

I hope we don't go the other way on other technology that can advance society and potentially save lives just because not everything goes perfectly from the start, or we get stuck in the pharmaceutical corporations = bad mindset.

Not to say there perhaps shouldn't be more regulation around it, but a serious and careful study of risks and benefits I think is appropriate rather than handwringing and outrage.

Re:Tesla FSD Beta Lunges Toward Bicyclist by heavyset_go on Tuesday February 08, 2022 @09:08PM (#30267764)
> People are some of the worst drivers around

1 fatality per 100 million miles driven is relatively good, to be honest.

This seems to me like a good argument for the public funding of electric rail lines instead of self-driving cars that perpetuate all of the problems personal vehicles are responsible for.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Tuesday February 08, 2022 @10:00PM (#30268190)
Sure and covid only kills a miniscule proportion of the people who contract it. Over a million people die on the roads every year around the world. It's been a 100 year covid.

Handwringing about someone carefully testing a car and not hitting a cyclist in the process is really pretty rich. I'll happily take actual data and statistics but for every one of these I can also post a video of a driver doing something stupid that a computer would not.

Re:Tesla FSD Beta Lunges Toward Bicyclist by heavyset_go on Tuesday February 08, 2022 @10:08PM (#30268251)
> Sure and covid only kills a miniscule proportion of the people who contract it.

A 1 out of 100 to 1 out of 1,000 fatality rate for COVID depending on demographics is quite literally several orders of magnitude higher than a 1 out of 100,000,000 fatality rate for driving. You're comparing apples to atoms.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Tuesday February 08, 2022 @10:16PM (#30268320)
No I'm not because not everyone goes out and gets covid most days for their whole lives. It's also much much less than 1 in 1,000 for young people in the range of 0-30 where auto wrecks are the number one killer in a lot of places.

So no, it's more like apples to watermelons. The watermelons being bigger, the ones which have killed far more people and will continue to kill far more people.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jquery on Wednesday February 09, 2022 @05:29AM (#30271085)
Friendly reminder that yesterday, COVID-19 killed over 2000 people in a single day. It’s been keeping that grim pace for weeks. For every person who dies, at least a dozen will suffer from long Covid. Even still, no dangerous shortcuts were taken trying to get the vaccines out (in the West), other than doing steps in parallel rather than in sequence (at great $cost).

So even COVID-19 wasn’t enough to “move fast and break things” (though I remember hearing many such calls to “move fast and break things” from the same contrarian-sphere community that is now Very Concerned about vaccine injuries). If COVID-19 wasn’t bad enough to completely remove our safety guardrails, certainly the never ending promise of FSD (watch any Musk video compilation where he promises FSD is just around the corner, going on five years now) isn’t enough.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Wednesday February 09, 2022 @06:42AM (#30271537)
Yesterday auto deaths killed 4000 people and horrifically maimed many more. As has been the case for the past century and as will continue to happen long after covid is background noise.
Re:Tesla FSD Beta Lunges Toward Bicyclist by jquery on Wednesday February 09, 2022 @11:00PM (#30282310)
4000 in the USA? No it did not. Apples and oranges.

Edit: I just looked up the numbers and it’s 102 deaths/day average in the USA. I think it’s a horrific problem and support many initiatives that will take cars off the road and calm traffic.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Wednesday February 09, 2022 @11:48PM (#30282551)
4000 people died, what I said is true.

102 deaths every day in the USA alone is staggering, and many children and young people! Are you trying to it's not? How many people has self driving cars and their research and development killed? Vanishingly few by comparison.

The situation is very analogous to covid and vaccines.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jquery on Friday February 11, 2022 @10:33AM (#30302577)
What vaccine guardrails are you under the impression were removed? AFAIK none were removed, it's just steps were done in parallel at great $expense. It appears you are trying to imply that it's fine if Tesla skips safety testing and pops a few skulls like watermelons in pursuit of $FSD. I'm not saying perfection is possible, but certainly Tesla can do better than it's doing. If anything, Tesla threatens to set everything back with its sloppiness. One bad accident could create enough bad PR to set self-driving cars back for years.
Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Friday February 11, 2022 @04:59PM (#30307520)
> What vaccine guardrails are you under the impression were removed?

The guardrails that the typical trial process has, see e.g.,:

https://coronavirus.jhu.edu/vaccines/timeline

https://www.ncirs.org.au/phases-clinical-trials

> AFAIK none were removed, it's just steps were done in parallel at great $expense.

No, the far greater expense is the typical 5-10 years that clinical trials require.

> It appears you are trying to imply that it's fine if Tesla skips safety testing and pops a few skulls like watermelons in pursuit of $FSD. I'm not saying perfection is possible, but certainly Tesla can do better than it's doing. If anything, Tesla threatens to set everything back with its sloppiness. One bad accident could create enough bad PR to set self-driving cars back for years.

It doesn't appear that I'm trying to imply that at all, it appears you're just making things up.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jquery on Saturday February 12, 2022 @02:04PM (#30315310)
That timeline you linked matched up with the COVID-19 mRNA vaccine timelines. mRNA pre-clinical data had been being researched for over a decade. I don’t see anything that conflicts with what I said. Are you under the mistaken impression that mRNA vaccine research began in 2019?

Again, you’re claiming vaccine guardrails were removed but posting no evidence. Do they do 5-10 year trials on the annual flu vaccine? Please show me an authoritative medical source concerned about major shortcuts taken bringing the mRNA vaccine to market. Should be a piece of cake.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Sunday February 13, 2022 @03:40AM (#30320288)
I don't know what your first paragraph means, what matched up?

I don't know what you mean by guardrail either. Vaccine trials were significantly accelerated from typical vaccines, long term data was foregone and emergency use authorizations were used to deploy them. I don't know what you're trying to argue or whether you're actually trying to deny that reality.

Re:Tesla FSD Beta Lunges Toward Bicyclist by josephcsible on Wednesday February 09, 2022 @12:25AM (#30269202)
The number of times most people will catch COVID is way, way fewer than the number of miles that they'll drive.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lolinder on Tuesday February 08, 2022 @09:35PM (#30267991)
> I also think there is a certain fear or outrage around this stuff which is fueled by "technology" or the unknown.

From other communities I could buy the "fear of the unknown" bit. But here, most of us are involved in the production of software in some form. It's not the unknown that we fear, it's the known. We fully understand what modern software is actually capable of, and we know that it's not ready for prime time in these kinds of environments.

Further, many of us have been in a chaotic public beta before, and seeing those patterns play out during a beta test of lethal machinery is really scary. Rapid chaotic iteration is fine when it's a simple SaaS product. Not so much with Tesla.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Tuesday February 08, 2022 @10:03PM (#30268216)
Most here have no idea what's involved in automotive control systems or these autonomous driving systems, let's be honest.
Re:Tesla FSD Beta Lunges Toward Bicyclist by doodpants on Tuesday February 08, 2022 @08:35PM (#30267504)
> People are some of the worst drivers around

Compared to which other species?

Re:Tesla FSD Beta Lunges Toward Bicyclist by couchand on Tuesday February 08, 2022 @08:19PM (#30267363)
We don't need moonshots to solve the car pandemic. Strong Towns and others have shown that we already have plenty of common-sense, effective tools that we've simply chosen not to roll out on a wider basis.

We don't need new technology, we need new leaders.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwawaylinux on Tuesday February 08, 2022 @09:36PM (#30268001)
Of course we do. If you can get "Strong Towns and others", whatever exactly that is, to end the car pandemic, that would be a a moonshot wouldn't it? Maybe not technologically but politically and socially.

You're not the first one to have thought it's a good idea or that we should try to do something about it. It's not like it's easy and people have just decided not to.

Re:Tesla FSD Beta Lunges Toward Bicyclist by davej on Tuesday February 08, 2022 @08:18PM (#30267350)
> "Some of you may die, but it's a sacrifice I am willing to make."

Honest question: If beta testing speeds up the transition to FSD by x months/years and causes y deaths during the intervening period but FSD ultimately reduces the number of road deaths by z per day. For what values of x, y and z is it an acceptable trade off?

Zeroism is often overly simplistic. y being non-zero might be hugely net-positive in the long run.

Re:Tesla FSD Beta Lunges Toward Bicyclist by stubish on Tuesday February 08, 2022 @08:46PM (#30267589)
Ethically, it is not an acceptable trade off. Your question is set in the future, after the action has been shown to be a success. A choice made today cannot be made ethical retroactively because it turned out to be the right decision. And it is unlikely we can prove the action caused the success in any case, or that not performing the action might have been better (maybe a success tomorrow sets back a better approach by 50 years, causing many more deaths). The better question to ask is 'if beta testing might speed up the transition to FSD and it might reduce the number of road deaths, is it an acceptable trade off?'. At which point you are doing risk analysis and algebra. But given this is the mathematics of human life, you are still in a very dubious ethical area, and the usual answer is still no.
Re:Tesla FSD Beta Lunges Toward Bicyclist by davej on Tuesday February 08, 2022 @09:10PM (#30267778)
Of course, I don't know the future, it was just a hypothetical question, not a mathematical definition. My point was just the answer is not zero because the alternative is human driving and human driving is also not zero deaths. So, at some point we will have to make some sort of trade off that will involve some number of deaths. Unless you are suggesting that the likelihood of deaths should literally be zero before we start rolling out in public?
Re:Tesla FSD Beta Lunges Toward Bicyclist by stubish on Wednesday February 09, 2022 @12:23AM (#30269183)
To indemnify manufacturers and drivers from the harm, it is going to require extraordinary proof and regulation. Similar to medicine, medical equipment, aircraft. Until that point, it is individual choice to turn it on, and their responsibility for any harm. Same situation as a driver choosing between wearing their eyeglasses or not. What is unclear is which individuals are taking responsibility with driverless trials, or if any indemnification by the state for driverless trials was done ethically.
Re:Tesla FSD Beta Lunges Toward Bicyclist by tptacek on Tuesday February 08, 2022 @08:20PM (#30267374)
No, of course it isn't; think, for instance, of applying that same logic to other circumstances. You can't knowingly or recklessly endanger people simply because your long-term intentions are benign.
Re:Tesla FSD Beta Lunges Toward Bicyclist by davej on Tuesday February 08, 2022 @08:52PM (#30267642)
There needs to be some testing of FSD solutions in real world scenarios and there will inevitably be deaths. There are thousands of deaths on the road every day right now.

Even if FSD is mature and 1000x safer than human driving then there will still be deaths. Are you suggesting that if FSD is 1000x safer then it still shouldn't be allowed on the road because there is the possibility of deaths?

I'm not claiming that FSD should or shouldn't be allowed on the road right now. My point is that we shouldn't wait for the chances of death to be zero.

Re:Tesla FSD Beta Lunges Toward Bicyclist by heavyset_go on Tuesday February 08, 2022 @09:13PM (#30267799)
> There needs to be some testing of FSD solutions in real world scenarios and there will inevitably be deaths. There are thousands of deaths on the road every day right now.

This is a solved problem with experimental design. Experiments are designed and reviewed by ethics boards, and participants are gathered after getting their informed consent and giving them just compensation for the risks involved.

"Testing of FSD solutions in the real world" can follow the same path in their experimental designs, but they don't, because executives and shareholders don't want to pay for expensive ethical experimentation. They'd rather move fast and break bodies.

Most modern life saving devices and treatments have gone through exactly this type of ethical experimentation. There's no reason Tesla's products couldn't, as well.

Re:Tesla FSD Beta Lunges Toward Bicyclist by standyro on Tuesday February 08, 2022 @08:48PM (#30267602)
Reminds me of that moment in Fight Club.

“Take the number of vehicles in the field, A, multiply by the probable rate of failure, B, multiply by the average out-of-court settlement, C. A times B times C equals X. If X is less than the cost of a recall, we don't do one.“

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @08:43PM (#30267561)
the other companies have no problems following the rules
Re:Tesla FSD Beta Lunges Toward Bicyclist by twblalock on Tuesday February 08, 2022 @09:47PM (#30268092)
What rules did Tesla break here?
Re:Tesla FSD Beta Lunges Toward Bicyclist by colinmhayes on Tuesday February 08, 2022 @07:57PM (#30267181)
40,000 people die in car crashes every year in the US alone. If the lord farquad approach brings widespread autonomous car adoption which decreases that number substantially even a month sooner it's the right thing to do. Many of us are already dying.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lolinder on Tuesday February 08, 2022 @09:45PM (#30268077)
The ethical problem with Lord Farquad's line isn't that "some of you will die". It's where he says "but that is a sacrifice that I am willing to make".

Tesla's self-driving beta is unethical because most of the participants in this "experiment" did not opt in. Most of the people killed by Tesla won't be their customers. It will be the cyclist or the pedestrian that gets killed because the driver thought "full self driving" meant the car was fully driving itself. They didn't even know they were part of an experiment that day, yet they were the sacrifice that Tesla was willing to make.

Re:Tesla FSD Beta Lunges Toward Bicyclist by colinmhayes on Tuesday February 08, 2022 @09:46PM (#30268088)
I'm sympathetic to that, but in the end don't trust people to make decisions that are in everyone's best interest. Americans especially have proven again and again that they are too blinded by the false ideals of rugged individualism to see what's right. What's unethical is allowing tens of thousands of people to die every year because some people have a (understandably)misguided view of right and wrong.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lolinder on Tuesday February 08, 2022 @09:56PM (#30268152)
Can you clarify how those of us calling for the government to prevent Tesla from involuntarily enlisting drivers into their beta test are "blinded by the false ideals of rugged individualism"?

Just so we're talking about the same term:

> The belief that all individuals, or nearly all individuals, can succeed on their own and that government help for people should be minimal.

https://www.dictionary.com/browse/rugged-individualism

Typically, the rugged individualists are the ones who say that the government should stay out of all this and people can take care of themselves. Basically the opposite of what I'm saying.

Re:Tesla FSD Beta Lunges Toward Bicyclist by colinmhayes on Tuesday February 08, 2022 @10:03PM (#30268215)
Sometimes sacrifices need to be made so that we can all prosper. The American mythos is unfortunately allergic to this truism. The idea that society needs permission to better itself is misguided. Same reason America is lagging in vaccination rate even though we are the society with most access. I'd be extremely happy if people could come to the correct conclusion themselves. I don't want to allow their failure to harm the rest of us.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lolinder on Tuesday February 08, 2022 @10:14PM (#30268302)
What you're arguing against, then, isn't "rugged individualism", it's "the sanctity of human life". The difference is that the one says "individual human freedom is paramount" while the other says "each individual human life is paramount".

Neither ethic would approve of systematically killing people for the greater good, but they're two very different ethics in most other respects. For example, I could arrive at "vaccination should be mandated" from a sanctity-of-life perspective, but I never could from a rugged individualism perspective.

Re:Tesla FSD Beta Lunges Toward Bicyclist by colinmhayes on Tuesday February 08, 2022 @10:22PM (#30268360)
Not quite. My thesis is "The idea that society needs permission to better itself is misguided." It's not limited to human life at all. It's about rejecting your thesis of "Tesla's self-driving beta is unethical because most of the participants in this "experiment" did not opt in." We don't need permission to save lives.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lolinder on Tuesday February 08, 2022 @10:41PM (#30268494)
And your calculus isn't altered at all by the fact that Tesla isn't "society", it's a single for-profit corporation?
Re:Tesla FSD Beta Lunges Toward Bicyclist by colinmhayes on Tuesday February 08, 2022 @11:35PM (#30268862)
Of course, but that doesn't change the fact that the software would help everyone, even if Tesla profited.
Re:Tesla FSD Beta Lunges Toward Bicyclist by ModernMech on Tuesday February 08, 2022 @08:15PM (#30267327)
Sorry, but I don't see how a company that...

- Beta tests critical software in the public which has lead to actual customer deaths;

- Refuses to follow industry best practices when it comes to safety sensors;

- Refuses to seriously investigate safety incidents and implement technological and cultural fixes to prevent them from happening in the future;

...will lead us into a utopia of automotive safety. At best what they're liable to do is create a climate where mega corporations feel free to use public spaces as their own personal laboratories, because the ends justify the means after all (don't pay attention to the decapitations, we're doing it for the safety of us all). We will all pay the price for that.

Re:Tesla FSD Beta Lunges Toward Bicyclist by randoglando on Tuesday February 08, 2022 @08:28PM (#30267450)
Don't forget to add

- willfully misrepresents data to imply a better safety record than they actually do have

https://twitter.com/Tweetermeyer/status/1488673180403191808 (I've posted this elsewhere on this thread too)

Re:Tesla FSD Beta Lunges Toward Bicyclist by colinmhayes on Tuesday February 08, 2022 @08:21PM (#30267382)
I agree it would require an incredible amount of evidence to convince me that this actually would speed up the development of self driving. Just saying that I'm not opposed to the lord farquad method if it helps.
Re:Tesla FSD Beta Lunges Toward Bicyclist by 46756e on Tuesday February 08, 2022 @08:12PM (#30267298)
Many people die of HIV, it’s a plague on society. If we just killed everyone who has it, it would be gone.

Many of “us” are already dying, and it saves lives in the future.

/s