News for hackers. Stuff that matters.
Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @07:12PM (#30266725)
It's quite literally a public beta, just that the other traffic participants didn't get a say in the opt-in. Given the stakes for them I agree that it begs the question.

In the end it's a regulation problem, not a Tesla problem (even though yes, the specific decision to exercise their options is theirs) - do you allow unlicensed drivers to perform this on-road testing of unfinshed vehicles or not?

It's not quite a deliberate information hiding campaign as with MCAS (as far as we know). But it is pre-production testing of experimental engineering on safety-critical equipment. Experiments not guaranteed to pan out, and engineering lacking a mature certification process.

Re:Tesla FSD Beta Lunges Toward Bicyclist by Barrin92 on Tuesday February 08, 2022 @07:48PM (#30267089)
the fact that there is such a thing as a 'public beta' for moving two tons of steel through pedestrian areas at lethal speeds seriously makes me question our collective sanity. Imagine if gun vendors did public betas where random police officers just get a beta testing gun.

"It might fire in random directions at arbitrary intervals 5% of the time, but that's just how innovation goes folks. You don't like that, do you hate progress?"

Re:Tesla FSD Beta Lunges Toward Bicyclist by FireBeyond on Tuesday February 08, 2022 @08:41PM (#30267534)
Someone said in another thread earlier today that there is a worry that we are making the path towards FSD too erratic, and that if we screw it up, the next shot might be in generations.

People are arguing, with a straight face, that we are ruining (aspects of) humanity by not letting Tesla be laisez-faire with such things (and lets be real, it's predominantly Tesla who is just in full Cowboy/YOLO mode... other players in this field certainly aren't perfect, but they are at least trying to be conservative and cautious).

Re:Tesla FSD Beta Lunges Toward Bicyclist by jimmydorry on Tuesday February 08, 2022 @11:01PM (#30268646)
It's still a regulatory failure in the end. If the government does not want to lay down exactly what path should be taken in getting to FSD, then we should not complain when we don't agree with the path that the manufacturers choose.

As long as Tesla can demonstrate a similar or better rate of serious harm than human drivers, why should we stop them? It's up to government to do their job and outline exactly what price society should bear in the pursuit of this paradigm shift (because let's not kid ourselves, FSD is a complete shift in paradigm for society).

Re:Tesla FSD Beta Lunges Toward Bicyclist by FireBeyond on Wednesday February 09, 2022 @12:20AM (#30269169)
> As long as Tesla can demonstrate a similar or better rate of serious harm than human drivers, why should we stop them?

Because it can't, or won't. Instead they release statistics that _imply_ that it is better, that they have to know are absolutely misleading, because anyone who did high school statistics would be aware thereof.

Everything else, they refuse to release.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jimmydorry on Wednesday February 09, 2022 @09:35AM (#30273067)
I'm not aware of _anyone_ releasing such data in a way. Not that I have been looking that closely for it (so I certainly could have missed this!).

This is another major regulatory failure. Government should lay out the minimum data that the companies must publish, so we can get a better idea of their performance. (It's still a chicken and egg scenario though. You can't get that kind of data anywhere but on public roads in uncontrolled environments.)

Re:Tesla FSD Beta Lunges Toward Bicyclist by dkjaudyeqooe on Tuesday February 08, 2022 @08:00PM (#30267213)
That reminds me of the ED-209 prototype in Robocop: "You have 20 seconds to comply!"
Re:Tesla FSD Beta Lunges Toward Bicyclist by pmoriarty on Tuesday February 08, 2022 @08:31PM (#30267474)
Here's the "20 seconds to comply" scene from Robocop:

https://www.youtube.com/watch?v=Hzlt7IbTp6M

Re:Tesla FSD Beta Lunges Toward Bicyclist by renewiltord on Tuesday February 08, 2022 @08:08PM (#30267269)
This is a fair point. It's pretty bad that we have learner drivers on the road. Can't think of anything more public beta-y than that. Maybe trainee doctors?
Re:Tesla FSD Beta Lunges Toward Bicyclist by gvb on Tuesday February 08, 2022 @08:17PM (#30267348)
I've had three "learner drivers" in my family and I spent quite a few hours as the "safety person" during their apprenticeship. During all those hours I never touched the wheel, brake, or gas. I gave advice occasionally, but never felt that the "learner driver" was driving unsafely.

I assure you that 15 year old young adults drive much better than a Tesla "self driving" computer with millions of miles and millions of hours of training.

Re:Tesla FSD Beta Lunges Toward Bicyclist by renewiltord on Wednesday February 09, 2022 @12:50AM (#30269381)
Oh I’m sure you were convinced but you never asked me if I consented to you randomly putting underaged kids behind the wheel of a two ton vehicle on a road which I share with you.

You’re a regular Yaroslav Kudrinsky, just with better luck. But I suppose one can go around swinging swords in a crowd, hit no one, and convince oneself of one’s good judgment.

Re:Tesla FSD Beta Lunges Toward Bicyclist by rhizome on Tuesday February 08, 2022 @08:26PM (#30267424)
Category error: people have brains.
Re:Tesla FSD Beta Lunges Toward Bicyclist by HarryHirsch on Tuesday February 08, 2022 @08:36PM (#30267510)
That's the important one - a Tesla has no concept of the real world. Remember that clip where a Tesla was slowing down because it mistook the full moon in the sky for a traffic light? Likewise, no one would aim at a cyclist, except when they are a homicidal criminal.
Re:Tesla FSD Beta Lunges Toward Bicyclist by ehvatum on Wednesday February 09, 2022 @07:14AM (#30271753)
> no one would aim at a cyclist, except when they are a homicidal criminal.

The process of not wanting to impact something and attempting to avoid it can occupy so much attention that hitting that thing becomes inevitable. People tend to go where they are looking.

https://www.google.com/search?q=target+fixation

Re:Tesla FSD Beta Lunges Toward Bicyclist by noizejoy on Tuesday February 08, 2022 @08:45PM (#30267576)
… or under the influence of some substance, or a health event, or voluntary or involuntary distraction, or …
Re:Tesla FSD Beta Lunges Toward Bicyclist by HarryHirsch on Tuesday February 08, 2022 @08:50PM (#30267623)
In other words - not living in shared reality.
Re:Tesla FSD Beta Lunges Toward Bicyclist by noizejoy on Tuesday February 08, 2022 @09:04PM (#30267722)
A seatbelt also doesn’t have a concept of the real world and doesn’t live in a shared reality either.
Re:Tesla FSD Beta Lunges Toward Bicyclist by lolinder on Tuesday February 08, 2022 @09:08PM (#30267759)
A seatbelt isn't given control of 2 tons of steel moving at 70 mph.
Re:Tesla FSD Beta Lunges Toward Bicyclist by throwaway0a5e on Tuesday February 08, 2022 @07:51PM (#30267125)
>Imagine if gun vendors did public betas where random police officers just get a beta testing gun.

This is a thing. They give marketing samples to organizations they want to sell to on a "try 'em out and let us know if you want to buy more" basis.

Re:Tesla FSD Beta Lunges Toward Bicyclist by bbarnett on Tuesday February 08, 2022 @07:56PM (#30267177)
Marketing samples are not public betas. They are marketing samples of tested product.
Re:Tesla FSD Beta Lunges Toward Bicyclist by throwaway0a5e on Tuesday February 08, 2022 @08:28PM (#30267449)
If your complaint is that a very conservative manufacturing industry doesn't have 1:1 analogues with software development then I guess it's valid.

Giving organizations stuff you haven't 100% nailed down yet expecting them to come back with stuff they want changed in order to buy is pretty par for the course in the firearms industry. That's as close to a public beta as you're gonna get.

Re:Tesla FSD Beta Lunges Toward Bicyclist by everforward on Wednesday February 09, 2022 @12:39AM (#30269299)
The big difference is that marketing firearms are still safe, or as safe as firearms tend to get. It's a fully functional firearm; they want feedback on whether the ergonomics are good, whether the weight is good, how it handles recoil, etc.

It would be more akin to handing out prototype weapons to police departments, which doesn't happen specifically because they might fire themselves or blow up or fail in some annoying but not spectacular way like failing to feed new rounds.

Re:Tesla FSD Beta Lunges Toward Bicyclist by throwaway0a5e on Wednesday February 09, 2022 @06:48AM (#30271579)
The key mechanical features always "work" but little stuff like "gun fails to cycle 500% more often with the particular spec of ammo a particular force uses". A rifle spec'd out for sale to Cambodia probably is going to have a lot of teething issues if you try and sell it to the Swedes unchanged. Are these things "safe"? IDK. But no force is going to put in an order for tens of thousands of guns unless correctable issues like those are proven fixed. Infantry arms are a battle of margins. Everything "works" but a marginally more finicky gun to use is going to mean the people using it are marginally less effective which extrapolates pretty directly to "safety".

At the end of the day the analogy isn't great and we're building a castle in a swamp here.

Re:Tesla FSD Beta Lunges Toward Bicyclist by bcrl on Tuesday February 08, 2022 @08:54PM (#30267660)
A public "beta" of a self driving car should lean towards failing safe. I would expect it to have sudden braking issues and be overly conservative. The kind of bugs we're seeing where obstacles are blatantly ignored make it feel more like an "alpha" release. But hey, we're not designing airplanes here, just thousand pound chunks of metal flying around roads capable of killing people.
Re:Tesla FSD Beta Lunges Toward Bicyclist by salawat on Tuesday February 08, 2022 @08:02PM (#30267222)
...I am aware of zero other manufacturers brazen enough in terms of blatant disregard for Engineering Ethics to have embarked on this type of testing before Silicon Valley did.

In fact, there were licensure processes for this sort of thing already in place in California iirc, so this is less gray area, more "lets outsource testing to the end user".

Frankly, it's downright disturbing.

Re:Tesla FSD Beta Lunges Toward Bicyclist by paulcole on Tuesday February 08, 2022 @07:59PM (#30267205)
> In the end it's a regulation problem, not a Tesla problem

Are you joking? If you’re the one causing the problem, you’re the problem.

No regulation can prevent me from kicking someone in the shins. This isn’t a regulation problem, it’s a me problem.

Re:Tesla FSD Beta Lunges Toward Bicyclist by nrb on Tuesday February 08, 2022 @08:18PM (#30267352)
The <Insert State Here> Code certainly applies penalties for assault and battery, and you can rest assured knowing shin-kicking would happen regularly without it.

The car problem presented here is quite a bit more shades of gray and we absolutely need to set acceptable parameters for the technology.

Re:Tesla FSD Beta Lunges Toward Bicyclist by paulcole on Tuesday February 08, 2022 @11:49PM (#30268969)
Yes, but my point is that if you’re being a jerk, then you’re the problem, not the person who is not saying, “please don’t be a jerk.”

You don’t need a regulation telling you not to be a jerk — unless of course you are a jerk. And even then, you’d probably still be a jerk, regulation or not.

Re:Tesla FSD Beta Lunges Toward Bicyclist by XorNot on Tuesday February 08, 2022 @08:22PM (#30267386)
Except it is: literally none of this is illegal. And it's not clear how it could be illegal: what's the distinction between cruise control and lane keeping and these systems? Very little - nothing you can codify.

It's also very likely that this system can pass a standard driving test: AIs are really good at handling fixed test cases. So any regulation you do pass has a complicated assurance problem: how does it prove the system is safe?

Pretend Tesla just knocked "beta" off the name and said "this is a limited self driving system, Tesla exclusive" - then you wind up in the same bucket with the same "it's the drivers responsibility problem".

People see this footage and assume Tesla self drive does this all the time - but it wouldn't. It probably passes this scenario in testing 100% of the time: but the issue of course is the test is not quite whatever this circumstance is, and the system has a dramatic failure.

There is absolutely a regulation problem.

Re:Tesla FSD Beta Lunges Toward Bicyclist by joeblubaugh on Tuesday February 08, 2022 @08:36PM (#30267507)
There is an extremely bright line.

Can the software automatically make lane changes? Can it initiate turns? Can it decide to make non-emergency stops at lights and signs? Can it accelerate from a stop? What is the expected level of human intervention?

Re:Tesla FSD Beta Lunges Toward Bicyclist by XorNot on Tuesday February 08, 2022 @08:42PM (#30267546)
That determines what the system is.

The question I'm posing is, how do you prove it works to an independent authority?

It would be extremely reasonable for us to regulate along these lines, but I'm also absolutely willing to bet that Tesla and every other system would get through an approval process just fine.

Which sort of loops around too a wider issue: if self driving is a priority, then it needs to be a government, collective priority for public safety and development.

I.e. independent reading institutes, a suite of diverse randomised tests and yes: because this is no longer "on the driver" for accidents then both the government and company will be taking responsibility for failures.

The issue is that the law of the land is: these systems aren't illegal, and the driver is responsible for how the car handles including any automation they engage.

To make any progress you have to break driver responsibility - or use that bright line and just outlaw the whole lot.

Re:Tesla FSD Beta Lunges Toward Bicyclist by jowsie on Wednesday February 09, 2022 @08:31AM (#30272385)
>but I'm also absolutely willing to bet that Tesla and every other system would get through an approval process just fine.

It would be Diesel Gate all over again. The testing would have to be documented somewhere and the car could just be trained for the test scenarios. Considering how often Tesla like to massage their numbers (nurburgring data, sales figures in basically every country, most recently Australia, the big asterisk next to their 1.9s 0-60 run, etc etc) I can't trust they wouldn't train directly for the test and neglect everything else just so they can have the best headlines once again.

Re:Tesla FSD Beta Lunges Toward Bicyclist by oogabooga13 on Tuesday February 08, 2022 @08:52PM (#30267646)
I've wondered if it would be a good idea to have some sort of external indicator on cars that indicates to others that are driving, cycling, on foot that the vehicle is in autonomous mode. At least then maybe one can understand the potential risk driving around them. (Noted that an indicator doesn't really help if the vehicle is behind you in a lot of instances!)
Re:Tesla FSD Beta Lunges Toward Bicyclist by heavyset_go on Tuesday February 08, 2022 @09:04PM (#30267725)
One thing I've noticed the past couple of years is that it isn't that hard to determine whether or not a car is autonomously driving. If they're driving like they're drunk and they're in a Tesla, 9 out of 10 times, you'll see that that the driver isn't paying attention to the road at all because they're using Autopilot or FSD. I just treat the Tesla drivers around me on the road as if they're drunk and keep my distance.
Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @09:21PM (#30267873)
Elsewhere in the thread a FSD Beta participant is imploring other drivers to keep their distance to Teslas because the software "gets easily spooked".

This makes it even harder to assess the safety of the system - other drivers are helping it along as well.

Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @09:19PM (#30267864)
Several manufacturers have experimented with such systems in concept cars, e.g. animated grilles that signal in green when an oncoming car has recognized a pedestrian and is slowing in response.
Re:Tesla FSD Beta Lunges Toward Bicyclist by jrib on Tuesday February 08, 2022 @09:50PM (#30268108)
Re:Tesla FSD Beta Lunges Toward Bicyclist by cwkoss on Tuesday February 08, 2022 @08:02PM (#30267223)
What does MCAS mean here?
Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @08:06PM (#30267258)
It's a software system overriding pilot input on Boeing 737 MAX airplanes, designed to make up for cost reductions in adequate hardware design. Pilots were deliberately not well-informed and the system caused two crashes. It was brought up elsewhere in the discussion. In general cars are headed into an aviation-like situation with automation, so case comparisons are becoming more frequent.

It's very apples to oranges here, but loosely relevant wrt/ information/documentation and in the cameras-vs-LIDAR/sensor fusion debate.

Re:Tesla FSD Beta Lunges Toward Bicyclist by rhizome on Tuesday February 08, 2022 @08:30PM (#30267466)
I'm sure the policy and regulatory systems will be able to fend off the lobbyists of the richest person in the world working to get the word "liability" redefined in the law. \s
Re:Tesla FSD Beta Lunges Toward Bicyclist by ofcrpls on Tuesday February 08, 2022 @08:04PM (#30267244)
Re:Tesla FSD Beta Lunges Toward Bicyclist by wavefunction on Tuesday February 08, 2022 @08:02PM (#30267230)
lol @ public beta
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @07:51PM (#30267119)
I was expecting autopilot to be seriously dangerous, but the data doesn’t back that up. Out of 234 deaths from accidents involving Tesla’s 12 people have died while Tesla autopilot was known to be in use or had recently been in use. http://www.tesladeaths.com Autopilot might be slightly worse than human drivers depending on how you slice the data but that’s about it.

I don’t think it’s a regulation problem as much as it is an acceptance by regulators that driving is inherently dangerous and autopilot isn’t dramatically worse. It’s not even obvious if on net more people would have died if Tesla had never released autopilot.

Re:Tesla FSD Beta Lunges Toward Bicyclist by sho_hn on Tuesday February 08, 2022 @07:57PM (#30267189)
Note that FSD beta participants are selected/limited by Tesla based on proprietary "safe driver" scoring, so FSD data doesn't say much about how the gen pop might fare at managing the system. (I know you were writing about Autopilot -- discussion is on FSD Beta though.)

Note also that other drivers are learning behaviors such as keeping their distance from Tesla's, etc., making it harder to assess the system functionally.

Edit: Actually, there are docs for the scoring, sans changelog though: https://news.ycombinator.com/item?id=30267858

Re:Tesla FSD Beta Lunges Toward Bicyclist by FireBeyond on Tuesday February 08, 2022 @08:43PM (#30267562)
Or social media clout (maybe not so much any more) where several prominent "influencers" got access regardless of scoring.
Re:Tesla FSD Beta Lunges Toward Bicyclist by bryanlarsen on Tuesday February 08, 2022 @08:25PM (#30267414)
Autopilot and FSD are two different things. Elon claimed 0 accidents for FSD late last year, but this year there is video of a Tesla running into a post.
Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @07:54PM (#30267156)
the data is extremely questionable
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @07:57PM (#30267190)
In what way?
Re:Tesla FSD Beta Lunges Toward Bicyclist by tom-_- on Tuesday February 08, 2022 @08:25PM (#30267418)
1. Dangerous means causing injury, not just death.

2. How many times has autopilot disengaged and would've caused injury without human intervention?

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @08:06PM (#30267257)
Sampling bias, confirmation bias.

Did you delete your link to tesladeaths.com because you realized the fine print about sketchy autopilot data contradicted your point? Oops!

Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @08:11PM (#30267285)
No, I was trying to keep the link without a http://, https://www.tesladeaths.com/ or https://www.tesladeaths.com/ works www.tesladeaths.com doesn’t nore does www.tesladeaths.com/

I am sure I have seen comment links without the http:// but might have just gotten so used to it than I stopped seeing it.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @08:22PM (#30267390)
uh huh. why do you think it's reasonable to conclude that this system is safe given that the reported data is based on faulty analysis [0] and inexplicably exempt from reporting requirements for testing self-driving cars?

[0] https://jalopnik.com/feds-tesla-autosteer-safety-investigati...

Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @08:58PM (#30267690)
I don’t think it is safe.

I just don’t have data showing it’s terrible.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @09:05PM (#30267732)
ok but you think it's reasonable to let them test their unproven software (which has already killed people) on public roads anyway?
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Tuesday February 08, 2022 @10:08PM (#30268250)
Yes, as there is no other way to prove it’s safe. Aka your suggesting an impossible standard for any company to meet.

Further the only reasonable standard is roughly average human competency. As soon as a tired driver can turn on self driving and be safer on the road then banning that technology has a real cost.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Tuesday February 08, 2022 @10:44PM (#30268517)
of course there is, it's what every other company is doing: safety drivers with reporting requirements
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Wednesday February 09, 2022 @09:11AM (#30272785)
Testing hardware and software via safety drivers on public roads doesn’t actually prove safety in the hands of the general public. Just as FSD being released to the safest drivers first doesn’t prove safety in the hands of the general public.

The general public doesn’t use products like you might assume. For example toilet plungers have killed or seriously injured people and not because they where used as a weapon.

Re:Tesla FSD Beta Lunges Toward Bicyclist by andbberger on Wednesday February 09, 2022 @11:26PM (#30282450)
what??? they're not subject user error. that's the whole point, and how many times fallible humans had to take over is exactly what the disengagement report tracks
Re:Tesla FSD Beta Lunges Toward Bicyclist by Retric on Thursday February 10, 2022 @11:53AM (#30288959)
The platonic ideal self driving system possible doesn’t prevent a tire blowout from poor maintenance etc. Similarly a test fleet isn’t going to replicate the publics actual origins, destinations, and time of day. Something as simple as people going to bars more because the self driving system can get them home would mean a different risk profile.