News for hackers. Stuff that matters.
Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @12:57PM (#22300671)
> This is really scary.

No, it's not even remotely "really scary". No one is putting an actual self-driving car on the market using this specific data set. Disingenuous to pretend this is any indication of the data using by serious companies in the space or is represented of the impact a few mislabelled samples have on the ability of these systems & algorithms to generalize.

Re:A popular self-driving car dataset is missing labels for ... by TeMPOraL on Tuesday February 11, 2020 @04:31PM (#22303095)
> No one is putting an actual self-driving car on the market using this specific data set. Disingenuous to pretend this is any indication of the data using by serious companies in the space

Are you sure about that? What about "non-serious" companies? Various fly-by-night self-driving startups?

I mean, this sounds like the machine learning equivalent of "no serious business is pulling random bits of code from StackOverflow or whatever tutorial popped up first in the search results", and yet I think everyone who worked with software for more than few years can confirm that companies absolutely do it, and a lot.

(Tangentially, PHP got a bad rap in large part because of this - people not knowing how to do things correctly copying code from tutorials written by people who didn't know it either; these days, JS ecosystem is getting a bad rap for having such bad code wrapped in neat and easy-to-install NPM packages.)

Re:A popular self-driving car dataset is missing labels for ... by rlayton2 on Tuesday February 11, 2020 @06:46PM (#22304224)
I've mentioned to a few people now that the first generation of self-driving cars don't scare me that much. It will be weird, but I assume that special care will be taken and the cars themselves will be quite risk-averse. I'm scared about the next generation of self-driving cars when we have "solved it" and the race is on to get cars out quickly and at low cost (and things like in-depth testing are out of budget). Hopefully regulations and testing frameworks catch up by then, but who knows.
Re:A popular self-driving car dataset is missing labels for ... by pavel_lishin on Tuesday February 11, 2020 @09:26PM (#22305179)
> I assume that special care will be taken and the cars themselves will be quite risk-averse.

Bold assumption that's already got a counterpoint: https://en.wikipedia.org/wiki/Death_of_Elaine_Herzberg

Re:A popular self-driving car dataset is missing labels for ... by a_bonobo on Tuesday February 11, 2020 @10:25PM (#22305458)
Wikipedia already has a list: https://en.wikipedia.org/wiki/List_of_self-driving_car_fatal...

Along with your pedestrian death there were five (!!!) driver deaths.

There's a reason why places like Germany don't want Tesla to use the term 'autopilot' because it's reckless endangerment.

Re:A popular self-driving car dataset is missing labels for ... by carlmr on Wednesday February 12, 2020 @08:28AM (#22308596)
>There's a reason why places like Germany don't want Tesla to use the term 'autopilot' because it's reckless endangerment.

If Tesla weren't a US company I'm sure they'd have already been sued for billions for labeling their assisted driving system autopilot.

The US is the country where you can pay millions for not having a sticker on the microwave showing that you shouldn't dry your cat in there.

Re:A popular self-driving car dataset is missing labels for ... by paxys on Tuesday February 11, 2020 @07:42PM (#22304605)
IMO to be "scared" of self driving cars they need to be more dangerous than any other random car on the street today, and the bar for that is pretty low.
Re:A popular self-driving car dataset is missing labels for ... by ClumsyPilot on Tuesday February 11, 2020 @08:21PM (#22304813)
Nope, with other cars you know the factors that increase your risks (fog, drunk driving, distractions). You can make decisions, like not getting into a car with a drunk friend.

With machine learning you never know when it might mistake the back of a semi for an overpass or soemthing.

Re:A popular self-driving car dataset is missing labels for ... by gibspaulding on Tuesday February 11, 2020 @08:35PM (#22304910)
Also, not to fear monger too much, but if this ends up happening there will inevitably be a period where people still assume that self driving cars are foolproof, and as a result, a lot of pedestrians/other drivers will get blamed for incidents that weren't in fact their fault.
Re:A popular self-driving car dataset is missing labels for ... by pcwelder on Wednesday February 12, 2020 @12:40AM (#22306133)
Thank you for pointing this out. Every time they show road accident statistics as an argument for the safety of self-driving cars or airlines, I wonder how is the risk conditional on me in the vehicle. Surely the risk substantially decreases than the population statistics in case of road accidents, since I am much more prudent than the average. However, the risk remains the same in the case of airlines or self-driving cars since I am not in control.
Re:A popular self-driving car dataset is missing labels for ... by SifJar on Wednesday February 12, 2020 @08:46AM (#22308742)
No pedestrian makes the decision to get hit by a drunk driver, which is the more relevant situation in the context of this post I think
Re:A popular self-driving car dataset is missing labels for ... by TomVDB on Tuesday February 11, 2020 @05:58PM (#22303877)
Are you sure about that? What about "non-serious" companies? Various fly-by-night self-driving startups?

Fly-by-night self-driving startups will at some point run into issues with the NHTSA. George Hotz self-driving car project was shut down as soon as he announced that he'd start selling some prototype.

States require permits just to be allowed to test self-driving prototypes on the open road. I don't know what the requirements are, but they're probably subject to some kind of review that's more than just filling in a form.

Re:A popular self-driving car dataset is missing labels for ... by wpietri on Tuesday February 11, 2020 @11:24PM (#22305766)
Given HN's general suspicion of government regulation, especially its quality and accuracy, I'm surprised to see people argue here that it's sufficient to counter the "move fast and break things" mentality. Especially given that regulatory arbitrage (moving from CA to AZ) was involved in Uber's vehicular manslaughter.
Re:A popular self-driving car dataset is missing labels for ... by saturnV on Tuesday February 11, 2020 @08:39PM (#22304939)
They haven't shut down, they are selling their prototype and I think they have recently put out a new model.
Re:A popular self-driving car dataset is missing labels for ... by garaetjjte on Tuesday February 11, 2020 @07:00PM (#22304325)
It doesn't look like it was shut down? http://comma.ai
Re:A popular self-driving car dataset is missing labels for ... by Mathnerd314 on Monday February 17, 2020 @12:13AM (#22345759)
> In the days that followed, Hotz abandoned his plans to sell Comma One directly. Instead, he embarked on a regulatory workaround: this current path of selling just the hardware and open-sourcing the code behind it, meaning it is available for free. He says often, “We are not selling a consumer product.”
Re:A popular self-driving car dataset is missing labels for ... by serioussecurity on Tuesday February 11, 2020 @07:34PM (#22304559)
No one stopped Uber, no one has stopped Tesla (Tesla hasn't been able deal with regression testing on a lane finding system...)
Re:A popular self-driving car dataset is missing labels for ... by Karishma1234fff on Tuesday February 11, 2020 @11:44PM (#22305872)
> Various fly-by-night self-driving startups?

What is the alternative other than holding these companies responsible for the deaths they might cause ? The only solution I see is mandating very high insurance requirement than a human driver. For example 25M per death they might cause.

Re:A popular self-driving car dataset is missing labels for ... by msds on Wednesday February 12, 2020 @12:29AM (#22306071)
Perhaps reasonable regulations involving extensive pre-street testing and solid public documentation of ML design decisions and training data sources before allowing use in uncontrolled environments? Also, criminal liability during initial deployment?

Of course, real responsibility is probably unfashionable...

(edit: I'm personally in high-stakes time-sensitive diagnostic ML development, so...)

Re:A popular self-driving car dataset is missing labels for ... by BigJono on Tuesday February 11, 2020 @07:17PM (#22304449)
> these days, JS ecosystem is getting a bad rap for having such bad code wrapped in neat and easy-to-install NPM packages.)

Is it? IME nobody seems to give a flying fuck outside of HN. Much like the PHP days. Or maybe I've never been in the right workplaces to notice.

Re:A popular self-driving car dataset is missing labels for ... by drusepth on Tuesday February 11, 2020 @09:57PM (#22305316)
I work in Ruby on Rails (currently with a React frontend, but previous jobs used Angular) in the Midwest. IME almost everything around the "recent" JS ecosystem (npm, npx, node, yarn, grunt, react, jsx, etc) are used (begrudgingly) when necessary, but are just the butt of jokes 99% of the time.
Re:A popular self-driving car dataset is missing labels for ... by mumblemumble on Tuesday February 11, 2020 @01:14PM (#22300912)
It's scary when you consider two other factors:

First, the AI hype train. People think that calling something "Artificial Intelligence" implies that it is artificial, yes, but also, critically, that it is intelligent. Many enthusiastic people, and also many policymakers, don't fully realize the extent to which machine learning is constrained by both the quality and nature of its training data, and the capabilities of the larger, non-intelligent, software framework that it's being plugged into.

Second, that we have one case study - the post-mortem analysis of the fatal pedestrian collision in Arizona - that strongly indicates that commercial products are not free of the sorts problems being highlighted here, and that, unlike what others have suggested, misclassification problems aren't necessarily an issue that's isolated to individual frames and that will come out in the wash when the software is dealing with a stream of frames.

Me, I think that self-driving cars are probably a lot like nuclear power. In theory, yes, it is a great idea. In practice, there are a lot of little details that one must get right, and there seem to be a whole lot of opportunities for flaky engineering decisions and incompetent public policy, both enabled by insufficiently-tempered optimism, to scuttle the whole thing.

Re:A popular self-driving car dataset is missing labels for ... by runarberg on Tuesday February 11, 2020 @05:30PM (#22303667)
> First, the AI hype train.

Yes! I really wished we would call this something more descriptive of the boring statistics involved. Artificial Intelligence is just too cool sounding name not to get excited about it. And what people don’t realize is that this is really just a statistical inference model, nothing intelligence. Machine Learning is better, but it is still not descriptive enough.

I think if we called it something like Computational Reinforcement Modelling or Iterative Weight Inference people might stop having the idea that there are machines making “smart” choices involved and finally seeing that really we are just inferring based some computations on provided data.

Really, “Machine Learning” deserves no more hype than the boring sounding Kalman Filter.

Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Tuesday February 11, 2020 @08:08PM (#22304746)
...I like the Kalman Filter even if I might not be quite up to programming one. Every time I drive a modern car with a shitty automatic transmission that glitches and stutters and fails to shift right, I think "Is this thing using a Kalman filter, or what fundamentally wrong thing was done with the programming here?" I wish someone would reveal to me whether the algorithm is not the panacea I wish it were, or else what a lousy programmer does when they don't know about it.
Re:A popular self-driving car dataset is missing labels for ... by ummonk on Tuesday February 11, 2020 @01:28PM (#22301063)
Given that nuclear power is significantly safer than other forms of power, are you asserting that the risks of self-driving cars are more about PR and perception than actual risk?
Re:A popular self-driving car dataset is missing labels for ... by mumblemumble on Tuesday February 11, 2020 @01:37PM (#22301189)
I'm saying that nuclear power could have been a safer energy option, but, in practice, the whole enterprise has been scuttled by a bunch of regrettably bad decisions that have pretty much destroyed everyone's trust. So now it doesn't really matter if it's safer, because it can no longer realistically be considered an option.
Re:A popular self-driving car dataset is missing labels for ... by keenmaster on Tuesday February 11, 2020 @03:40PM (#22302582)
If everyone believes that everyone else will be irrational, then they themselves will not throw their support behind nuclear power, rendering their stance on nuclear de facto irrational. As Baby Boomers age, and Millennials/GenZ form a greater percentage of the voting population, we have an opportunity to press the reset button on nuclear. The younger generations don’t really have a solid opinion on the matter, and probably don’t think about it much.

Scientists are in the best position to influence the public and push for change. It is astonishing that scientific organizations have been timid about nuclear energy, or outright against it, because of a few people with the most extreme, empirically unjustified stance.

Re:A popular self-driving car dataset is missing labels for ... by kozd on Tuesday February 11, 2020 @04:36PM (#22303149)
Is it a tautology or just an unfortunate nash equilibrium?
Re:A popular self-driving car dataset is missing labels for ... by keenmaster on Wednesday February 12, 2020 @03:42PM (#22312590)
As you know, a nash equilibrium is the point at which no player can benefit from a move away from the equilibrium. However, that's a concept from game theory. What is the game here? Who are the players?

Part of my point is that you might think that the game is "scientists vs. politicians, ignoramuses, and fear-mongers," but that's not the case. Sometimes they're all on the same side. Imagine a 4 player split-screen Star Fox, where the scientist leaves their controller and helps the others shoot down their plane because they don't think they can win. If that sounds baffling, it is.

Re:A popular self-driving car dataset is missing labels for ... by MrQuincle on Wednesday February 12, 2020 @01:42AM (#22306465)
Check this concept car from 1957: https://en.m.wikipedia.org/wiki/Ford_Nucleon

We could have had your safe nuclear power involved in every road accident. Yeah!

Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Tuesday February 11, 2020 @01:45PM (#22301275)
I think the point is rather that it's an unpredictable-stakes game. That is, if you make few enough mistakes, you'll be fine for a long time until you make the wrong mistake at the wrong time and it kills somebody.

Maybe a better analogy is driving a car, that is, nuclear power and self-driving cars are both vaguely like driving a car.

However, my intuition is that nuclear power has less variables than driving a car. I say intuition because I don't know much about neither.

I think the point is that self-driving cars trained on poor data are no better than poorly trained superhumans at driving.

Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Tuesday February 11, 2020 @08:12PM (#22304770)
"However, my intuition is that nuclear power has less variables than driving a car."

During the cold war they launched fission reactors into orbit. That probably had more variables. Then again, since the nuclear airplane project was unsuccessful, maybe that had the most variables of all.

Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Thursday February 13, 2020 @02:58PM (#22320907)
Well, nuclear power isn't harder because you put it in a car, but it's a great way to add to the complexity of the system as a whole.

Putting a nuclear reactor in space (as we still do, I think the most recent Mars rover had one) greatly reduces the risk of it directly causing deaths, since it's really far away from humans for most of its service life.

Re:A popular self-driving car dataset is missing labels for ... by xiphias2 on Tuesday February 11, 2020 @02:05PM (#22301505)
As long as self driving vehicles are small passanger vehicles, they are not able to kill more than a few people.

If you look at the Uber accident, killing 1 person severly harmed the company.

The only extremely harmful scenario that I can imagine in self driving is a bad remote mass software update (which is sadly possible even in an otherwise great company) causing lots of accidents at the same time in different vehicles.

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @01:22PM (#22300993)
I'm not sure what point you're trying to make, but it has nothing to do with some mislabeled examples. Every system using supervised training assets has labeling issues, and the world hasn't ended yet. Take a look at Google Translate. This is only "scary" if you're ignorant of the problem.

The OP is selling something, and it's in their best interest to spread FUD to sell it.

Re:A popular self-driving car dataset is missing labels for ... by gugagore on Tuesday February 11, 2020 @03:36PM (#22302550)
That's probably the least charitable interpretation possible. No idea who the OP is, in any case.

It's scary that the only way we know how to build something that detects pedestrians in an image with any kind of reliability is to use training data.

You: All training data has labeling issues. Me: Training data is the only way we know how to build some aspects of systems. Other people here: Some of these systems are safety-critical.

I doesn't feel like FUD to be concerned that we need to have strategies for mitigating quality issues in training data. That if you don't have anything like that, then you cannot be in the market of building a safety-critical system. As you have identified, labeling issues are always there. Kind of how human error is always there. Okay, so now that you believe that, you have to find ways to mitigate it.

But when I hang around people who do self-driving cars, they don't have a good answer to how to mitigate this risk. Some of them don't even really believe in it (which is different than being ignorant of the problem), because they argue with enough data things will get good enough. It's all really sloppy.

Instead of just saying "This is FUD", why not tell us why you feel so reassured that this is not a problem? So far, you said "this always has been a problem and always will be a problem", "the world hasn't ended yet" and "Google translate". What?

re: The world hasn't ended yet: okay, but we also haven't been building self-driving cars

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @08:44PM (#22304967)
> No idea who the OP is, in any case.

The person that originally posted this thread that works for the company that's selling this FUD. At the bottom of the blog post:

"Roboflow accelerates your computer vision workflow through automated annotation quality assurance"

This is a non-issue exasperated by a for-profit corporation that's creating an "issue" they conveniently have a service to help you fix.

Re:A popular self-driving car dataset is missing labels for ... by wpietri on Tuesday February 11, 2020 @11:35PM (#22305829)
I think you missed the key part of the post you're replying to:

> tell us why you feel so reassured that this is not a problem

Because to me you're coming across as the old-school "you don't need QA if your code is perfect" type.

Re:A popular self-driving car dataset is missing labels for ... by semi-extrinsic on Tuesday February 11, 2020 @02:10PM (#22301556)
Nobody gets killed by Google Translate etc. messing up, so no sweat, throw together something that works 99% or the time.

But for safety critical systems it's six nines reliability or GTFO.

Re:A popular self-driving car dataset is missing labels for ... by thaumasiotes on Tuesday February 11, 2020 @02:24PM (#22301694)
> Nobody gets killed by Google Translate etc. messing up, so no sweat

It's not so much that "nobody gets killed by Google translate messing up" as "when people get killed by Google Translate messing up, I can't tell".

Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Tuesday February 11, 2020 @08:19PM (#22304795)
I think Google Maps is more relevant to self driving. Google Maps has become, in my opinion, the best way to navigate, far superior to any other GPS-enabled option I know of. But the better it gets, the more obvious it is that you can't rely on it totally. If self-driving was feasible tomorrow or in the next decade, navigation would be much better. And if anyone could do it, Google would.

Think of the trope about idiots driving into lakes or off the road or whatever because they were following navigation. And now think about unconditionally trusting Google Maps or anything else, for say, a year. You know it's not up to that standard.

I think you can debate whether it needs to be an order of magnitude better, or multiple orders of magnitude better.

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @03:21PM (#22302381)
Again, how does that have anything to do with a public data set? The amount of pure BS FUD in this topic is astounding.
Re:A popular self-driving car dataset is missing labels for ... by Florin_Andrei on Tuesday February 11, 2020 @01:23PM (#22301004)
> People think that calling something "Artificial Intelligence" implies that it is artificial, yes, but also, critically that it is intelligent.

I mean, the exact same argument could be made about people. Just because you belong to Homo Sapiens doesn't imply you're an intelligent being at all times - e.g. drink a bottle of vodka and the sapiens part is gone.

Re:A popular self-driving car dataset is missing labels for ... by TeMPOraL on Tuesday February 11, 2020 @04:59PM (#22303366)
The thing with people is that we all share the same brain architecture - we mostly think alike. As a species, we have a hundred thousand plus years of experience dealing with each other; as a civilization, a couple thousand. We've explored most corner cases, designed our infrastructure around those, and built systems protecting us from outliers. For instance, people deemed too unpredictable will not be given driving licenses (and extremely unpredictable people tend to get locked up). And DUI is severely punished; while the execution isn't perfect, the threat of consequences goes a long way towards reducing it.

That's the bar an AI system has to meet today. And one big hurdle is that, viewed as minds, AI systems are completely unlike our own. They're extremely unpredictable. On top of that, they lack self-preservation instinct (this may be indirectly a side effect of how we structure companies - the level of effort put into an AI system is a reflection of how much people working on it care about getting it right vs. getting it to market).

Re:A popular self-driving car dataset is missing labels for ... by wpietri on Tuesday February 11, 2020 @11:32PM (#22305813)
I agree entirely with your point, and wanted to follow a small tangent:

> they lack self-preservation instinct

I suspect that a self-preservation instinct, even in relatively dumb animals, is enormously complex. It might seem simple to us because it's so evolved, so hardwired. If I had to bet, I'd bet that a mouse's self-preservation instinct is more complex than the first-to-market Level 5 self-driving car will be.

And that's good, because I definitely don't want automated vehicles to have more than a hint of self-preservation wiring.

Re:A popular self-driving car dataset is missing labels for ... by TeMPOraL on Wednesday February 12, 2020 @04:26AM (#22307302)
That's a good point, and yes, I definitely don't want an automated vehicle to have self-preservation instinct. What we're all after is people-preservation instinct, which is not entirely unrelated to the former.

But the broader reason I brought up self-preservation is that in humans, it's not just about not getting killed in a crash. It's also about not having your life ruined by causing it, even if you walk away physically unscathed. A person has personal, deeply visceral stake in driving safely. A self-driving car AI currently doesn't, because it's not a mind; what it has is the reflection of priorities in the company that made it. And as it turns out, companies can kill people and get away with it, so I don't feel confident about how safety is prioritized (see also: this article).

Re:A popular self-driving car dataset is missing labels for ... by mumblemumble on Wednesday February 12, 2020 @10:21AM (#22309469)
> what it has is the reflection of priorities in the company that made it

I think it might even be more like Platonic shadows on a firelit cave wall of the priorities of the company that made it.

At the current level that self-driving is at, the cars' control software is only able to perceive and respond to situations that its programmers anticipated and specifically coded for. That could be heuristics and rules in the hard-coded bits, but, also, even the most sophisticated deep neural net out there isn't even particularly capable of perceiving, let alone understanding, things that weren't coded into its training set. Meaning that, even if the company's intention was that the car should not plow into a pedestrian holding an enormous cellophane-wrapped Edible Arrangements™ fruit basket, that intention doesn't have any bearing on the vehicle's behavior if the software instead classified that object as a plastic bag blowing in the wind.

Re:A popular self-driving car dataset is missing labels for ... by wpietri on Wednesday February 12, 2020 @10:48AM (#22309761)
Great points. And I'd add that the other implementation issue here is the human system any company's intentions get filtered through. So the interests modeled are not the entire corporation, but C-suite intentions passed through executive intentions, manager intentions, and then worker intentions.

E.g., it might be in the long-term interest of the company to not run over pedestrians. If nothing else, the PR cost is very high. But when an exec wants to be first in the field to demonstrate personal success, then hitting a made-up date becomes the priority. Which implicitly puts "not kill people" lower. Middle managers don't want to get blamed, so they'll favor a more complex, muddled organization structure. Per Conway's law, that means muddled code. So instead of the car's software reflecting "don't run over pedestrians" as a key goal, its true priorities are things like "gives a good demo", "was delivered 'on time'", and "reflects an architecture clever enough to get that architect promoted that quarter".

It's not impossible that good software comes out of this system, but the deck is certainly stacked against it.

Re:A popular self-driving car dataset is missing labels for ... by smabie on Tuesday February 11, 2020 @06:30PM (#22304118)
It’s because we are intelligent that we want the bottle of vodka in the first place.
Re:A popular self-driving car dataset is missing labels for ... by graedus on Tuesday February 11, 2020 @01:15PM (#22300924)
It's scary not because this specific dataset was used to train Teslas that are on the road today. Rather, because it makes us aware of an entire class of errors that most of us probably hadn't thought about before. I guess you are absolutely certain that training data used in production cars will be free of these issues, but it's not clear why.
Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @01:20PM (#22300964)
It does not make use aware of a new class of errors. Labeling issues is nothing new, but plenty of systems trained on them continue to work just fine. This is FUD.
Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Tuesday February 11, 2020 @02:04PM (#22301488)
Is there any statistical/mathematical tool to completely eradicate or greatly diminish the effects of bad labeling? Is there any reason - other than the combination of pure circumstance and gut feeling of the Data Scientist in charge of saying that it's good enough to deploy - that ~33% insanity in training doesn't become ~33% insanity in the system?
Re:A popular self-driving car dataset is missing labels for ... by neurobro on Tuesday February 11, 2020 @09:54PM (#22305300)
Not sure about bad labels, but semi-supervised learning is the term for training on data with a lot of missing labels. Essentially the algorithm makes predictions on the unlabeled data and uses its highest confidence predictions as additional training data. Generative models can also "dream up" entirely new training examples. There is a risk of amplifying the confidence in bad predictions, but it works well overall (better than using only the labeled portion of the data).
Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @03:21PM (#22302379)
> Is there any statistical/mathematical tool to completely eradicate or greatly diminish the effects of bad labeling

Yes, it's called statistics and probability theory.

Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Tuesday February 11, 2020 @03:36PM (#22302560)
> Yes it's called statistics and probability theory.

My understanding of statistics is:

- I can halve the % insanity by adding another 100% of good labels.

- If I want to reduce the insanity of labels to 1/33th of ~33% I need to add another 3200% of good labels.

- If I want to reduce the insanity to 0% I need to balance the bad labels with an infinite amount of good labels.

Is there anything I'm missing entirely except probability theory? Is probability theory the answer or is there something else?

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @04:09PM (#22302882)
You don't reach 0%, that's a straw man. The goal is better than human, and the 35,000+ vehicle-related fatalities that happen in the U.S. each year.
Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Tuesday February 11, 2020 @08:24PM (#22304833)
There's a disconnect here.

People who talk about the danger of humans driving cars always seem to talk about the raw numbers, because humans drive cars a lot and the raw numbers are rather large.

But when we talk about automated driving, it's in percentages, because it's not being done on the same scale.

So to compare apples to apples, you'd have to convert the number of fatalities to an accuracy percentage. Have you considered trying? There is certainly more than one way to do it, but it would greatly contribute to the discussion if you made some attempt.

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @08:39PM (#22304938)
> you'd have to convert the number of fatalities to an accuracy percentage

Telsa's early results for their very limited "self-driving" technology has shown a huge reduction in accidents for any given period of time the vehicles are on the road.

Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Tuesday February 11, 2020 @09:04PM (#22305086)
That seems like it incorporates a lot of assumptions. I think it's best to slow down and realize that comparisons don't mean much if you're comparing the wrong things. The first step is to determine the first thing that you are comparing and exactly what it is. Then you can move on to the other half and determine whether it is appropriate.

Humans are much safer than people on average, when driving in conditions suitable for Autopilot.

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @09:22PM (#22305168)
> Humans are much safer than people on average

This makes zero sense and isn't how "average" works. For the same 1000 hours on the road, a Tesla car with Autopilot will have fewer accidents than a car driven for 1000 hours by humans. This changes as driving conditions get worse, and humans outperform Autopilot.

Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Tuesday February 11, 2020 @11:01PM (#22305618)
Deleting half a sentence and saying it doesn't make sense?

The way "average" works is that you average over something - a population or set. It is very important to be clear about what that something is and whether it's appropriate.

Why do you believe that Autopilot outperforms humans in comparable conditions? If this is based on Tesla marketing, I'm extremely prejudiced against them, and assume out of hand that they simply aren't making the right comparison and don't care. However, if you think that is incorrect, you could elaborate on why you have the opinion you do.

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @11:08PM (#22305669)
The average of something cannot be more than the average of... itself. Thus, "Humans are much safer than people on average" is nonsensical.

> Why do you believe that Autopilot outperforms humans in comparable conditions?

Because they have the data that proves it?

> I'm extremely prejudiced against them

And I've chosen to take them at face value with a grain of salt, and to believe that for the data they've collected from the hundreds of thousands of Tesla's with millions of hours of data using Autopilot, it's fair to say they have a large enough sample to draw conclusions about the safety of their cars vs. any incident rates from pretty much any other distribution.

Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Wednesday February 12, 2020 @12:07AM (#22305973)
"Thus, "Humans are much safer than people on average" is nonsensical."

Does it make more sense as "Humans, when driving in conditions suitable for Autopilot, are much safer than people on average"?

"I've chosen to take them at face value with a grain of salt, and to believe that for the data they've collected from the hundreds of thousands of Tesla's with millions of hours of data using Autopilot, it's fair to say they have a large enough sample to draw conclusions about the safety of their cars vs. any incident rates from pretty much any other distribution"

You seem to be saying that if you have a lot of data it doesn't matter what you compare it to. That seems wrong to me. Also, I don't have this data, and you are not bothering to help me find it.

Re:A popular self-driving car dataset is missing labels for ... by MauranKilom on Friday February 14, 2020 @09:23PM (#22332689)
> Humans, when driving in conditions suitable for Autopilot, are much safer than people on average

The immaterial distinction between "humans" and "people" still makes that sentence confusing. I take it that you mean "driving a mile (either as human or autopilot) is safer in conditions that are good for autopilot than driving a mile in average conditions"? Or more directly, isn't your question really "are the conditions the same for the averaged human drivers and the averaged autopilots"?.

Re:A popular self-driving car dataset is missing labels for ... by perl4ever on Saturday February 15, 2020 @01:15AM (#22333631)
"isn't your question really "are the conditions the same for the averaged human drivers and the averaged autopilots"?"

My implication is that I severely doubt the conditions are the same, when somebody touts a comparison, and I would need clear and convincing evidence otherwise to change my mind. As well as strong evidence of good intent and trustworthiness by the source of the information.

It's not just about being intentionally deceitful, but about the fact that it's hard to do the right comparison, so people feel justified in giving up on it.

Re:A popular self-driving car dataset is missing labels for ... by FAKEDETECTOR on Wednesday February 12, 2020 @05:56AM (#22307778)
"Our secret telemetry dataset gives us reason to believe that the cars produced by us are not safe."

Would a statement like this be a surprise for you?

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Wednesday February 12, 2020 @01:09PM (#22311109)
Only because you made it up to spread FUD. Good job.
Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Thursday February 13, 2020 @02:51PM (#22320835)
It's hard to reach 0% bad labels because:

1. You can't have an infinite amount of good labels 2. Humans are in charge of labeling too.

The question is if you can reliably overcome the number of bad labels in your training set, so that 33% of bad labels equates to <33% "insanity" in the system.

Re:A popular self-driving car dataset is missing labels for ... by diffeomorphism on Wednesday February 12, 2020 @06:41AM (#22308006)
Your understanding is wrong for anything nonlinear. The whole reason machine learning is useful is because it is nonlinear.
Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Thursday February 13, 2020 @02:55PM (#22320876)
How nonlinear are we talking? My understanding is probably closer to the truth than to the opposite of the truth. I'm looking for an estimate of how far from the truth I am.

How would a system reliably discredit missing labels while still learning from good labels? The simplest solution would be that system is able to spot the bad/missing labels itself with some certainty, but that seems like a catch 22.

Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Tuesday February 11, 2020 @03:25PM (#22302428)
That's correct. I know what goes in and what comes out, not what happens in the middle. How does ~33% insanity in become < ~33% insanity out?

Edit: Parent was edited, was previously (paraphrased)

> I'm guessing you have no technical understanding of how this works

Re:A popular self-driving car dataset is missing labels for ... by tomnipotent on Tuesday February 11, 2020 @04:06PM (#22302853)
How does making up something ridiculous like "33% insanity" give you anything that's resembles a subject that we can discuss? Hyperbole in, hyperbole out.
Re:A popular self-driving car dataset is missing labels for ... by jwandborg on Thursday February 13, 2020 @02:06PM (#22320399)
I'm 33% insane myself. I believe that's part of what makes me human.
Re:A popular self-driving car dataset is missing labels for ... by jasonwatkinspdx on Tuesday February 11, 2020 @04:55PM (#22303330)
We have a lot more than the gut feeling you're assuming: https://arxiv.org/abs/1611.03530
Re:A popular self-driving car dataset is missing labels for ... by GordonS on Tuesday February 11, 2020 @02:12PM (#22301576)
Maybe we could use deep learning? Oh, wait...
Re:A popular self-driving car dataset is missing labels for ... by rocauc on Wednesday February 12, 2020 @12:10AM (#22305988)
The scary part isn't necessarily this dataset, but that unlabeled data causes a silent decrease in model performance -- which can be esp important for underrepresented classes.
Re:A popular self-driving car dataset is missing labels for ... by drcross on Tuesday February 11, 2020 @03:54PM (#22302730)
Thank you. I can't believe the grandstand here.