Re:Andrej Karpathy leaves Tesla
by camjohnson26 on Wednesday July 13, 2022 @05:45PM
(#32089146)
Tesla has bet the company on robotaxis, but their vision only tech stack doesn’t seem capable of solving it, which is a problem because Tesla has repeatedly promised FSD is right around the corner, or less than a year away. It’s hard to believe Karpathy would step down if he felt they were close to solving the problem anytime soon.
This announcement comes after a 4 month sabbatical where Karpathy said he wanted to take some time off to “sharpen my technical edge,” which makes it sound like this is the result of frustration with the technical approach instead of burnout.
Re:Andrej Karpathy leaves Tesla
by elif on Wednesday July 13, 2022 @10:59PM
(#32091500)
FSD beta tester here. I think they are minimum 3 years away from anything exciting beta.. but the localization, mapping, and visualization are not the reason. I don't think LIDAR would contribute substantially to improvement.
The fundamental flaws are in the decision-making being based upon 10-30 second feature memory, ignoring features outright, and only depending on visible road features instead of persisted map data.
For instance, near my house there's an intersection where it will try to use a turn-only lane with a red arrow when it's trying to go straight thru a light. 100% of the time. Even if I'm in the correct lane with no traffic around.
That's because the turn arrow on the ground is worn off. It is not a perception problem, it is
a) ignoring the obvious red turn arrow signal's significance for lane selection deliberately
b) makes no attempt to persist or consult map data for 'which lanes go where'
c) it completely disregards painted lines on the ground in the "no drive here" striping.
Also one block from my house, FSD will stay still indefinitely waiting for trash cans (displayed as trash cans) to clear the leftmost lane so that it will turn left.
None of the failures I encounter are due to lack of perception.
Re:Andrej Karpathy leaves Tesla
by FireBeyond on Thursday July 14, 2022 @12:25AM
(#32091993)
> I think they are minimum 3 years away from anything exciting beta
I think that's optimistic. Ten plus years.
There's too many exceptions. In my home town, an intersection. Imagine, if you will:
Traveling westbound there's four straight ahead lanes. There's a traffic light for each straight lane. The traffic lights will alternate "left two straight, green; right two straight red" and then "left two straight, red; right two, green". It does this because there's a tunnel and a roundabout right there. I guarantee that FSD will choke on this.
Re:Andrej Karpathy leaves Tesla
by elif on Thursday July 14, 2022 @08:06AM
(#32094832)
If the pavement is clearly marked i would give it a good chance. We have a 6-way intersection with similar lighting that it succeeds at... Other than completely and recklessly disregarding the clearly visible "no turn on red" sign.
We also have a road with a reversible lane in the middle. Thankfully it recognizes the red X sign for this. Unfortunately, if it's driving for 11 seconds without seeing anothee, it will suddenly decide to merge into the incoming lane to make an upcoming left...
Re:Andrej Karpathy leaves Tesla
by elif on Thursday July 14, 2022 @11:29AM
(#32097289)
Completely agree. I think this is part of the hazard of the fsd training ethos that 'san francisco is the hardest case.' It completely dodges the issue that California actually maintains safe road markings compared to most other states.
I think in Japan or China this approach could actually work, but there is zero hope for it to work generally in the US.
Re:Andrej Karpathy leaves Tesla
by ncmncm on Wednesday July 13, 2022 @11:43PM
(#32091751)
The elephant in the room is fraud.
Tesla has been collecting thousands of dollars, each, from car buyers and utterly failing to deliver what it represented, and keeping the money year after year. Would be let GM, Toyota, or Audi do this? Where is the criminal prosecution? Where are the refunds?
Re:Andrej Karpathy leaves Tesla
by asdajksah2123 on Thursday July 14, 2022 @08:24AM
(#32095067)
Elon Musk has literally said in a public conference keynote that robotaxis would be running in 2019, and earning Tesla owners 30k/yr since 3 years ago, and that it would be financially foolish to buy anything but a Tesla.
Re:Andrej Karpathy leaves Tesla
by ncmncm on Thursday July 14, 2022 @02:57PM
(#32100092)
Juries have in the past often not been swayed by fine print, where consumers are involved. It seems to be there mainly to dissuade angry consumers from suing, rather than to win cases based on it.
Re:Andrej Karpathy leaves Tesla
by DebtDeflation on Thursday July 14, 2022 @07:18AM
(#32094457)
>I think they are minimum 3 years away
I vividly remember a conversation I had with an acquaintance who had recently taken an engineering position with an AV company that occurred circa late 2018. He claimed that they were at most 1 year away. In fact, his exact words were something along the lines of "They're already here. It's just a few edge cases to work out and some regulatory hurdles to overcome."
The reality is that the first 80% of the problem had been solved quickly and significant progress had been made at the time on the next 10%. The end was in sight. Unfortunately, that next 10% ended up taking as long as the first 80% to solve, and the final 10% will likely take decades if it's even possible.
Re:Andrej Karpathy leaves Tesla
by justapassenger on Thursday July 14, 2022 @12:50AM
(#32092148)
It’s naive to call yourself beta tester. People who have access to beta are basically just a part of PR exercise by Tesla, that tries to hide lack of meaningful progress towards multiple missed deadlines.
You aren’t beta testing complex automation system that’s operating on public roads. To do any meaningful testing you should have defined operation domain, specific behaviors to test, direct line to the engineering team to report issues, etc, etc.
Re:Andrej Karpathy leaves Tesla
by zarzavat on Thursday July 14, 2022 @01:52AM
(#32092500)
You're thinking of QA testing. Beta testing is the final stage of testing before release and aims to test the system in as close as realistic environment as possible - that's why betas are often seeded to the general public, you want to find out if your system doesn't work on some configuration or circumstances that you didn't anticipate in internal testing. Better to have it fail for a limited number of users who signed up for that possibility than to have to do a Cyberpunk style recall.
Re:Andrej Karpathy leaves Tesla
by formerkrogemp on Thursday July 14, 2022 @02:03AM
(#32092562)
> You're thinking of QA testing. Beta testing is the final stage of testing before release and aims to test the system in as close as realistic environment as possible - that's why betas are often seeded to the general public, you want to find out if your system doesn't work on some configuration or circumstances that you didn't anticipate in internal testing.
I'm thinking of being an unwitting test crash dummy on public roads and sidewalks for "Full Self Driving". They just slap the binding legal agreements and waivers on their drivers, but it is tantamount to fraud. I'd rather this didn't exist on public roads in such numbers, and that people don't have to pay to be free Tesla drivers, beta testers, and data points instead of being considered people.
Re:Andrej Karpathy leaves Tesla
by justapassenger on Thursday July 14, 2022 @12:37PM
(#32098296)
QA testing doesn't exist for FSD. And you're applying standards used to test apps to share dickpics to a software that's moving killing machines in shared environment with other people.
It's not acceptable to have it fail for limited number of users. As my kid who may get killed by the failure didn't sign up for it.
How would you feel if this was a standard for aircrafts? "Let's just push this change to a small portion of the fleet, and boy, if that plane crashes, it's soooo much better if all our planes would crash. High five, where's my bonus?!".
Re:Andrej Karpathy leaves Tesla
by kaba0 on Thursday July 14, 2022 @02:33AM
(#32092717)
That’s not 3 years away, it’s lacking fundamental knowledge of the world, which might require GAI to begin with. It is just shitty drive assist features sold as much more.
Re:Andrej Karpathy leaves Tesla
by pas on Thursday July 14, 2022 @03:49AM
(#32093209)
it definitely needs a broad knowledge base about all things road/traffic/sign related, but that's definitely not G nor fundamental.
still a very hard problem.
but what it requires is a consistent world model. and if it detects that the current stretch of road is incomprehensible for its model it should safely disengage.
of course Tesla opted for the cowboy version of this, and turned the confidence of the model up .. without having a good model :|
Re:Andrej Karpathy leaves Tesla
by elif on Thursday July 14, 2022 @08:12AM
(#32094906)
Agree I think 5-6 is more likely
3 years was my minimum, assuming they scrap their current model and begin working on one with real geo-spatial awareness now.
They have the data for it already.
To over-essentialize the problem with their approach, you simply cannot safely drive in Atlanta as a person who has never seen the streets. Humans are no exception. You have to know how each road works, and remember that for next time.
Re:Andrej Karpathy leaves Tesla
by 01100011 on Wednesday July 13, 2022 @06:18PM
(#32089435)
Isn't Tesla supposed to be producing Optimus, their human-like android, next year?
Elon has been over-promising(i.e. flat out lying) about self-driving every year since.. 2014(there's a youtube video compilation of it)?
It seems like his strategy is to just come up with increasingly grandiose promises every year when he fails to deliver on his past promises. He's trapped in his swirling vortex of bullshit. Very worrying to see Karpathy leaving...
Re:Andrej Karpathy leaves Tesla
by mikeyouse on Wednesday July 13, 2022 @11:14PM
(#32091571)
And Jobs' "reality distortion field" was primarily used to motivate / burn-out his team by demanding things that were technically very difficult but feasible (one of the original anecdotes was about reducing the boot-time for the original Macintosh), not something like solving AGI which FSD would ~apparently require.
Re:Andrej Karpathy leaves Tesla
by 01100011 on Thursday July 14, 2022 @01:10AM
(#32092248)
I fully believe Elon and Jim Keller truly thought the deep learning HW delivered by Tesla was capable of self-driving in the early 201x time frame because, frankly, a lot of us did. More than likely, like the rest of us, they slowly came to see that the problem was much more difficult, and deep learning much less capable, than we had originally envisioned. Most of us didn't make a bunch of stupid promises to shareholders based on the original, incorrect assumptions though. Unlike Elon, we're able to admit we were wrong.
Re:Andrej Karpathy leaves Tesla
by mrmlz on Thursday July 14, 2022 @03:57AM
(#32093271)
As someone who has worked for almost a decade with safety critical software, system design and functional safety analyses (both aerospace and automotive) etc. I don't think I ever met anyone who believed they would be anywhere near FSD/Level-5 what-have-you in the timeframe they presented.
The only ones I met who thought so was managers and software developers and ML-people, i.e. people who has never in their life seen the level of effort it actually takes to get something qualified for RTCA or other safety standards.
Re:Andrej Karpathy leaves Tesla
by 01100011 on Thursday July 14, 2022 @04:10AM
(#32093354)
> As someone who has worked for almost a decade with safety critical software, system design and functional safety analyses
And you were right, but most people aren't like you, and people like you don't drive the discussion on what trends are coming. The world needs more folks with your background. Generally no one wants to listen to folks like you because you come off as a Debbie Downer despite being correct most of the time.
Re:Andrej Karpathy leaves Tesla
by mrmlz on Thursday July 14, 2022 @07:28AM
(#32094518)
Hah, to be fair I am somewhat of a Negative Nancy from time to time ;)
I think Mercedes has a reasonably sensible game-plan as far as I know. They currently have Level-3 on some highways in Germany which is still freaking hard to achieve, but still a narrow enough scope that you might be able to pull it off.
Time will tell, my bet is its still 10+ years off.
Re:Andrej Karpathy leaves Tesla
by bsaul on Thursday July 14, 2022 @05:03AM
(#32093687)
ML approach for FSD was critized right from the start by mobileeye CEO who gave a very thorough talk on why that couldn't possibly work. I think the talk is still on youtube.
The guy was critized for being old school and not having adapted to the latest tech (including by elon musk when he dumped mobileeye), but in fact he was just plain right.
Re:Andrej Karpathy leaves Tesla
by jimmydorry on Thursday July 14, 2022 @05:23AM
(#32093792)
Until any FSD solution delivers, it's far too early to vindicate the mobileye CEO. As it stands, even with additional (expensive) sensors, it seems very likely that ML will be required regardless. Running purely off sensors is not going to be feasible when braking distances alone are greater than the sensors will be able to accurately measure.
Re:Andrej Karpathy leaves Tesla
by bsaul on Thursday July 14, 2022 @09:19AM
(#32095723)
He did give a second talk a few years later explaining how the purely cognitive aspect may be handled by ML, and the total system probably going to end up being a mix.
But his fundamental opposition to ML for things related to safety was, IMHO absolutely correct.
Re:Andrej Karpathy leaves Tesla
by rlt on Thursday July 14, 2022 @01:03PM
(#32098677)
You don’t think SpaceX and Tesla have delivered quite a lot? FSD is really the only big project I can think of this far behind, and maybe Cybertruck. I don’t think it’s fair to ignore all his other accomplishments.
Re:Andrej Karpathy leaves Tesla
by barrysteve on Thursday July 14, 2022 @08:22PM
(#32103018)
Solar rooftops hasn't gone anywhere. Boring company and Hyperloop didn't go anywhere.
Let's face it Neuralink isn't going anywhere too.
Tesla wasn't started by Musk and relies heavily on Panasonic battery developments and SpaceX and Starlink is good old fashioned ex-NASA and MIT talent.
What does Musk actually do? Annoy the SEC, go on Joe Rogan to smoke weed and have more girlfriends per hour than Gengis Khan?
Re:Andrej Karpathy leaves Tesla
by rlt on Friday July 15, 2022 @01:48AM
(#32104989)
I made my point. Pointing to additional examples of grandiosity (some might call ambition) doesn't invalidate it. Neither do attacks on his character or lame arguments like "Tesla wasn't started by Musk" ignoring that he grew the company from 4 people to 100,000 people. Or that somehow recruiting large amounts of NASA and MIT talent is a bad thing? That's good leadership.
Seriously? Either you're trolling or you have some irrational hatred of the guy.
Re:Andrej Karpathy leaves Tesla
by barrysteve on Friday July 15, 2022 @06:42AM
(#32106747)
Oh you don't get what I mean. Yeah those things are good and I'm grateful for the progress SpaceX is making. What I want to know is how much is really attributable to Musk and what his Ego is really worth at the end of the day.
Lets remember the only reason he's around today is because some very rich people and NASA bailed him out. SpaceX left to just Musk's ability, ego and resources died in 2008.
He relies so much on mysticism for parting people from their money, eventually some people get fed up with the 'mysterious future and repeated failure' business model.
Expectations around his personal abilities should be lowered. His track record is not that great and it's a fact people call trolling. Sorry, not sorry.
The abilities that made spacex and tesla were hundreds of highly skilled engineers. Elon just raised money and is the face brand for japanese battery tech.
He's not worth worshipping and his incompetence is covered by idolatry.
Re:Andrej Karpathy leaves Tesla
by 93po on Thursday July 14, 2022 @07:33PM
(#32102639)
HN safely ignores anything positive about Elon because they prefer to think the richest man on the planet is both an idiot and also a failure in everything he does
Re:Andrej Karpathy leaves Tesla
by BluSyn on Wednesday July 13, 2022 @08:52PM
(#32090656)
I don't recall Tesla ever saying they were producing Optimus as a product any time soon. He's said prototype demo later this year. A prototype is very far from a finished product. As a product businesses/consumers can buy, at least 5+ years from now.
Re:Andrej Karpathy leaves Tesla
by gruturo on Wednesday July 13, 2022 @06:44PM
(#32089663)
> Elon in 2028: “time machine!”
Well, to be fair, he only has to hit _that_ goal - at which point he can go back in time at his leisure and fix all the others. And he could hit even the time machine goal as late as he wants, and it won't matter.
Re:Andrej Karpathy leaves Tesla
by sdenton4 on Thursday July 14, 2022 @11:27AM
(#32097253)
Something something 'light cone.' If the machine was turned on a million years ago in another star system and then brought to Earth, the Primer model would put you in the other star system when you climb out of the machine. And then you'd need to make your way back to Earth. (It's unclear to me whether you would continue aging while sitting in the box and waiting for a million years to go by in reverse... But I assume you would.)
So I think the 'other civilization' thing only works if they're already approximately here with a running machine.
Re:Andrej Karpathy leaves Tesla
by andsoitis on Wednesday July 13, 2022 @08:03PM
(#32090303)
I think we can tell for certain that time travel will never be invented because if it were to happen, then logically we’d already be experiencing people visiting us from the future.
Re:Andrej Karpathy leaves Tesla
by impulser_ on Wednesday July 13, 2022 @06:05PM
(#32089332)
Yeah, but Google's vision + lidar tech also doesn't seem any better at solving it either. They have been working on this problem the longest and they aren't even confident enough to produce a product with it. Google is probably the leader in AI and AI research. They are also the leader in data and mapping. They have billions of cash to play with. Yet it seem like they haven't gotten any closer at solving this problem as well.
They are just going about it better but not trying to selling it.
Any reason why everyone seems to be stuck on this problem?
Re:Andrej Karpathy leaves Tesla
by Animats on Wednesday July 13, 2022 @08:41PM
(#32090563)
Waymo and Cruise routinely have driverless cars on city streets. In California, all collisions, however minor, have to be reported, and DMV posts them on their web site.[1] Most are very minor. Here's a more serious one from last month:
"A Cruise autonomous vehicle ("Cruise AV") operating in driverless autonomous mode, was traveling eastbound on Geary Boulevard toward the intersection with Spruce Street. As it approached the intersection, the Cruise AV entered the left hand turn lane, turned the left
turn signal on, and initiated a left turn on a green light onto Spruce Street. At the same time, a Toyota Prius traveling westbound in the
rightmost bus and turn lane of Geary Boulevard approached the intersection in the right turn lane. The Toyota Prius was traveling
approximately 40 mph in a 25 mph speed zone. The Cruise AV came to a stop before fully completing its turn onto Spruce Street due to the
oncoming Toyota Prius, and the Toyota Prius entered the intersection traveling straight from the turn lane instead of turning. Shortly
thereafter, the Toyota Prius made contact with the rear passenger side of the Cruise AV. The impact caused damage to the right rear door,
panel, and wheel of the Cruise AV. Police and Emergency Medical Services were called to the scene, and a police report was filed. The
Cruise AV was towed from the scene. Occupants of both vehicles received medical treatment for allegedly minor injuries."
Now, this shows the strengths and weaknesses of the system. The Cruise vehicle was making a left turn from Geary onto Spruce. Eastbound Geary at this point has a dedicated left turn lane cut out of a grass median, two through lanes, a right turn bus/taxi lane, and a bus stop lane. It detected cross traffic that shouldn't have been in that lane and was going too fast. So it stopped, and was hit.
It did not take evasive action, which might have worked. Or it might have made the situation worse. By not doing so, it did the legally correct thing. The other driver will be blamed for this. But it may not have done the thing most likely to avoid an accident. This is the real version of the trolley problem.
Re:Andrej Karpathy leaves Tesla
by dekhn on Wednesday July 13, 2022 @09:55PM
(#32091081)
I think the way I would say it is, after a few tens to hundreds of thousands of such events, we'll be able to estimate the parameters of the human preference functions associated with a non-fatal trolley problem (the real trolley problem is irrelevant to the car ML folks, they are not aiming to maximize global utility) and that will help guide our confidence in rolling out more.
For all the woe and gloom in the news reporting, Google (and Cruise)'s rollouts have been more or less what I expected: no enormous accidents that were clearly caused by a computer, but instead, a small number of small accidents usually due to the human driver of another vehicle doing something wrong. That seems to lead towards greater acceptance of self-driving cars and confidence that they are roughly as good as an attentive newbie.
The next big situation, I think, will be some really large-scale pileup with massive damages and deaths, and a press cycle where the self-driving car gets blamed. But the self-driving car collected a forensic quality audit log, which of course will aid the police in determining which human caused the accident.
Re:Andrej Karpathy leaves Tesla
by Animats on Wednesday July 13, 2022 @10:06PM
(#32091162)
I've been reading those DMV reports for years, and there are clear patterns which repeat. One is where an autonomous vehicle started to enter an intersection with poor sight lines to the cross street. Sensing cross traffic, it stopped, and was then rear-ended by a human-driven vehicle that was following too closely. Waymo has that happen twice at the same intersection in Mountain View. There's a tree in the median strip there which blocks the view from their roof sensor until the vehicle starts to enter the intersection. So the Waymo system advances cautiously until it has good sensor coverage, then accelerates or stops as required.
Humans tend not to do that, and, as a result, some fraction of the time they get T-boned.
Re:Andrej Karpathy leaves Tesla
by bambax on Wednesday July 13, 2022 @10:57PM
(#32091482)
> Humans tend not to do that
AI should absolutely mimic the behavior of real (good) drivers.
Although that's not what you're describing here, another problem for AI could result from it knowing more than an average driver; for example, if a high-mounted LIDAR were able to see around corners and let the car decide it's "safe" to do a turn that no human would attempt for lack of visibility, that could cause problems.
(Also, it's surprising that an autonomous car doesn't detect that another car is following it too closely, and slows down appropriately in anticipation. How is this not taken into account.)
Re:Andrej Karpathy leaves Tesla
by bambax on Wednesday July 13, 2022 @10:48PM
(#32091426)
> This is the real version of the trolley problem
An autonomous vehicle has to protect its occupants at the expense of everything else (or, at the very least, appear to do so in a convincing manner), because otherwise no one will step inside.
(At the very least, if a machine is going to sacrifice me or my family to save a third party, I need to know what hierarchy it is following, and how it was decided and by whom.)
But what this incident seems to illustrate is that it's difficult for a self-driving car to share the road with human drivers, and behave like a human -- meaning, allowing human drivers anticipate what it will do.
I drive a motorcycle and a bike in Paris; the reason I'm still alive is because after so many years of this I can tell what all the other cars will do at all times, before they know it themselves.
But an autonomous vehicle that would behave so differently from a human driver as to be unpredictable, would be terrifying.
Re:Andrej Karpathy leaves Tesla
by theluketaylor on Thursday July 14, 2022 @02:18AM
(#32092652)
Totally agree; beginner and truly dangerous drivers share a quality: unpredictability. Even the most aggressive, fast drivers can easily be accounted for when defensive driving. Unpredictable drivers are how collisions happen when speed and weather are not factors.
Even the simple automatic emergency braking features in my model 3 result in some dangerously unpredictable behaviour at times. I have them set as off and insensitive as possible and they still do some awful stuff from time to time. I was on a road trip in northern Ontario this week passing a service vehicle moving very slowly along the shoulder on the right. I was doing 105 km/hr in the right lane of a 3 lane road: 2 lanes in my direction and 1 opposing. The 2nd lane switches directions every 5-10 km to serve as a passing zone. Posted speed limit is 80 km/hr, but prevailing speeds on this road are 90-110 and you’d never be ticketed for anything under 110 in this region. There was a truck gaining on me coming up on the left, so I signalled left and partially moved over to give the service vehicle some room, but didn’t fully take the left lane to let the faster truck know I would let them through as they came past. Very common pattern on this type of road and circumstance. The AEB slammed on the brakes as I came level with the service vehicle despite the fact there was plenty of space to complete the pass. I wasn’t expecting my car to slow down let alone apply emergency braking force, so in my surprise I nearly collided with the service vehicle. I have no idea what the other drivers thought, but neither of them could have possibly been predicting or expecting me to slam on the brakes. I was really upset with the car since it took a highly dangerous action in an otherwise perfectly safe and common situation. And that was the automatic stuff that can’t be turned off; I don’t let autopilot drive ever because it is the worst type of driver: unpredictable. The choices it made in the extremely short time I tested it about lane placement, follow distance, defensive driving (and the complete lack thereof), and general behavioural clues provided to other drivers were genuinely terrifying.
Re:Andrej Karpathy leaves Tesla
by antisthenes on Wednesday July 13, 2022 @11:39PM
(#32091727)
> By not doing so, it did the legally correct thing. The other driver will be blamed for this. But it may not have done the thing most likely to avoid an accident. This is the real version of the trolley problem.
It performed the only sane solution to the problem - stopping. You can't possibly predict what the most likely thing is to avoid an accident, because there is a multitude of factors beyond just 2 cars moving towards each other. Are there pedestrians present? Other parked cars? Storefronts with customers inside? How close to the sidewalk? Trees? Construction/Debris?
Once we get AI working better than 99.9% of humans on roads with speed limits of up to 30 mph - we can expand it to faster roads and introduce advanced behaviors. But for now, stopping in uncertainty is the best available option.
Re:Andrej Karpathy leaves Tesla
by tarsinge on Thursday July 14, 2022 @04:01AM
(#32093299)
> It performed the only sane solution to the problem - stopping. You can't possibly predict what the most likely thing is to avoid an accident, because there is a multitude of factors beyond just 2 cars moving towards each other. Are there pedestrians present? Other parked cars? Storefronts with customers inside? How close to the sidewalk? Trees? Construction/Debris?
Not only there are other factors, but you also need to predict what the other human driver will do. As stated in a sibling comment this is a huge part of safe driving.
> Once we get AI working better than 99.9% of humans on roads
But what you stated above require AGI, so what's the plan to get there? It's even more blurry than commercial fusion at that point.
Re:Andrej Karpathy leaves Tesla
by theluketaylor on Thursday July 14, 2022 @02:24AM
(#32092682)
Yes, this applies to autonomous vehicles being tested in the state. Tesla skirts this rule by reporting their system (including the supposedly ‘Full Self-Driving’ beta) as level 2 driver assistance features. That marks them out of scope for the regulation of reporting collisions (and crucially system disconnections).
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @06:25PM
(#32089499)
Because self-driving has a bunch of tricky edge cases and most of them will kill people. Problems with hundreds of important edge cases cannot be solved by simply throwing more training data at the problem; that's how you solve AI problems in a "dumb" manner, and it works for lots of problems (like recognizing dogs in images) -- but not for self-driving.
To solve the self-driving problem we need "smart" A.I., which means we have to approach it with systematic engineering, and the solution will probably involve some combination of better sensors, introspectable neural nets, symbolic A.I., and logical A.I.
Re:Andrej Karpathy leaves Tesla
by function_seven on Wednesday July 13, 2022 @06:46PM
(#32089688)
I remain convinced that "real" self driving (as in: go ahead and sleep in the backseat) will never happen without changes to road infrastructure and possibly some sort of segregation between robot-driven cars and people-driven cars.
Things like traffic signals that actively communicate their status to nearby robot cars (more than just a red lamp that can be occluded by weather, other vehicles, or mud on the camera lens). Or lane markings that are more than just reflective paint, but can be sensed via RF. Rules around temporary construction that dictate the manner of signage and cone placement that the robot cars can understand. The cones might have little transponders in them, I don't know.
But without a massive leap forward in AI capability, our current road system—optimized for human drivers over the past century—is not going to work.
If we can't make the cars just as smart as an alert and capable driver, then maybe we need to meet halfway and make the roads a littler "dumber" (simpler) to accommodate the robots.
Re:Andrej Karpathy leaves Tesla
by Twirrim on Wednesday July 13, 2022 @07:05PM
(#32089840)
> Things like traffic signals that actively communicate their status to nearby robot cars (more than just a red lamp that can be occluded by weather, other vehicles, or mud on the camera lens). Or lane markings that are more than just reflective paint, but can be sensed via RF. Rules around temporary construction that dictate the manner of signage and cone placement that the robot cars can understand. The cones might have little transponders in them, I don't know.
The problem you then face is that any of those could be forged / faked without some kind of way of securely validating the message in some way. You could cause absolute chaos by driving down the road broadcasting false messages. It's a little harder to hack and modify traffic light signals, for example. But we've also seen hackers screw up Tesla cars by sticking stuff on the back of their car to deliberate mislead it based on vision.
Re:Andrej Karpathy leaves Tesla
by TheDong on Wednesday July 13, 2022 @07:18PM
(#32089941)
> You could cause absolute chaos by driving down the road broadcasting false messages
Even without self-driving cars, an "attacker" can go into a theater and yell "fire" and cause a stampede.
They can get a high-viz vest and clipboard, and stand in intersections directing cars to take detours they don't need and holding up traffic.
My point here is that society has a lot of trust baked in. We trust people don't just yell "fire" without reason. Just because it's FSD cars doesn't mean people will start broadcasting the equivalent of "fire" constantly. It's already easy to cause accidents.
Re:Andrej Karpathy leaves Tesla
by eslaught on Wednesday July 13, 2022 @07:58PM
(#32090267)
Those attacks don't scale. They're also tied to a person or people who need to be physically present, making it possible to arrest them.
The consequences of potential attacks on centrally-orchestrated traffic are a lot more severe. Hack the control node, and you can stop traffic nation-wide. Or cause mass accidents that overwhelm first responders. And they can be executed by anyone, anywhere in the world, for a cost within range of many medium-size corporations (let alone nation states).
I won't comment on the challenges of the approach Tesla et al. are currently taking, but I don't think central control is the panacea commenters in this thread are making it out to be (and I'm personally glad this isn't the route we're pursuing).
Re:Andrej Karpathy leaves Tesla
by zaroth on Thursday July 14, 2022 @06:37PM
(#32102220)
An attacker can already do this, at scale. Whether it be overriding traffic lights to show green in all directions, or taking down critical air traffic control systems.
It’s like arguing that we can’t possibly build autonomous cars because then someone might turn it into an autonomous bomb.
Keep in mind that solving this is “worth” about 40,000 lives a year in the US - nearly $1 trillion in economic damages a year in life and property.
Bad things can always be done with good tools. As always, you provide layers of protection that make sense and in the end must rely on the underlying fabric of civilization to persevere.
Re:Andrej Karpathy leaves Tesla
by steveBK123 on Wednesday July 13, 2022 @10:38PM
(#32091379)
Bad bad things.
I've had my Tesla on a highway either lose GPS precision and believe I was on an adjacent local road..
It immediately reduced speed from 60mph to 25mph .. aggressively.
This falls into a pattern of Tesla autopilot/NoA where it just doesn't seem to have much memory or foresight.
For example the car is driving itself on the highway, it knows it's been on the highway, for 20 minutes. I am not even in the exit lane, it knows what lane I am in. How could it think I am suddenly on the local road below the highway based solely on the GPS pin movement in the span of a second, without having moved to the exit lane and gone down the exit ramp?
For an example of lack of foresight - the car will happily speed towards an obvious semi-distant slowdown right until it needs to aggressively break from 60mph down to 30mph as it approaches following distance of the nearest car. I also find it can get really weird in stop&go traffic, not easing into speed, down to a stop very well as if it has only GO or STOP.
Re:Andrej Karpathy leaves Tesla
by bambax on Wednesday July 13, 2022 @11:04PM
(#32091524)
> For example the car is driving itself on the highway, it knows it's been on the highway, for 20 minutes. I am not even in the exit lane, it knows what lane I am in. How could it think I am suddenly on the local road below the highway based solely on the GPS pin movement in the span of a second, without having moved to the exit lane and gone down the exit ramp?
Oh wow. This happens often with a car-mounted GPS (or on a phone) and it's pretty annoying. Sometimes the GPS instructs you to do a U-turn at the next available fork in the road, and it takes a moment to understand what's going on.
But in a self-driving car it's terrifying! And absurd.
Re:Andrej Karpathy leaves Tesla
by alasdair_ on Wednesday July 13, 2022 @08:26PM
(#32090448)
Who controls the signing keys and the whole signing process? What about key revocation if someone steals the key? Will a municipality in Texas really be willing to not be allowed to create a new stoplight without approval from the federal agency in charge of the keys? What’s to stop someone stealing a “real” stoplight from bumfuck nowhere and putting it in the middle of the 101 at rush hour? What about replay attacks? What about signal jamming? Etc. etc.
Re:Andrej Karpathy leaves Tesla
by zmmmmm on Thursday July 14, 2022 @01:48AM
(#32092473)
You raise some genuine possible concerns but generically I'd probably tend to just say, "laws will stop them" just like they already stop someone deliberately endangering lives by placing a real fake stop light in the middle of the 101 at rush hour.
The real concern would be whether someone can engineer a terrorist level mass scale attack but as long as it requires physical tampering that adds up to a tremendous amount of work. So if the signalling is largely burned into fixed infastructure it eliminates a lot of that or at least sets the bar high enough that its probably more work than various other types of attack that are likely to be just as impactful.
Re:Andrej Karpathy leaves Tesla
by sneak on Wednesday July 13, 2022 @10:29PM
(#32091322)
ADS Mode B (used everywhere for airplanes) already works this way, and there is no authentication or signing whatsoever. It's a single global broadcast frequency (1090MHz).
Re:Andrej Karpathy leaves Tesla
by jstarfish on Wednesday July 13, 2022 @07:56PM
(#32090248)
> The problem you then face is that any of those could be forged / faked without some kind of way of securely validating the message in some way. You could cause absolute chaos by driving down the road broadcasting false messages.
Re:Andrej Karpathy leaves Tesla
by throwaway123989 on Wednesday July 13, 2022 @08:03PM
(#32090301)
> I remain convinced that "real" self driving (as in: go ahead and sleep in the backseat) will never happen without changes to road infrastructure and possibly some sort of segregation between robot-driven cars and people-driven cars.
Yep, I talk to people working in traffic engineering, and their mindset is always building new road tech and road-side and cloud infra to support autonomous driving. They have no expectation of fully autonomous vehicle without road and infrastructure assistance.
And from historical perspective, the coming of automotive and the replacement of horse and other animal carts, are exactly facilitated by the road transformation; which has been the single largest scale infrastructure in human history.
It makes no sense that an even bigger transformation of the vehicle would require less drastic road transformation.
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @09:08PM
(#32090774)
Yes. You bring up a great point: With some infrastructure improvements we could have "virtual" trains. Vehicles would talk to each other on the highway and organize into closely-spaced convoys. Only the lead vehicle would need an active human driver; the rest could follow at extremely close distances--drafting off each other--and would not need a human driver (or their human drivers could go off-duty). The point of using asphalt rather than rails is that it makes it easy to switch between individual car mode and automated virtual train mode.
This idea is not new and it mostly applies to freight convoys but I think it also has merit for ad hoc passenger car convoys on long highway trips.
Re:Andrej Karpathy leaves Tesla
by throwaway81523 on Wednesday July 13, 2022 @09:33PM
(#32090955)
> With some infrastructure improvements we could have "virtual" trains. Vehicles would talk to each other on the highway
I think the idea is to get rid of the roads and have the robo vehicles travel instead on tracks. That increases fuel efficiency and bypasses a lot of AI challenges.
Re:Andrej Karpathy leaves Tesla
by RC_ITR on Thursday July 14, 2022 @04:20AM
(#32093429)
Not only that. Overhead electrical solves a lot of the mining/environmental impact of batteries.
It’s the low-key case that Elon will be remembered poorly (like Robert Moses’ rapidly degrading legacy) for
1) Having the wrong vision for EVs (but successfully executing non it anyway)
2) Making space travel cheap (thereby increasing the amount of carbon energy dedicated to it) without really improving an average human’s quality of life
Re:Andrej Karpathy leaves Tesla
by zmmmmm on Wednesday July 13, 2022 @07:18PM
(#32089939)
I wonder if all the "hype" from the Ubers and Googles about imminent self-driving is not actively harmful in that it is probably sucking out the oxygen from any perceived need to implement these things.
Re:Andrej Karpathy leaves Tesla
by 8jef on Wednesday July 13, 2022 @07:47PM
(#32090174)
But for people, in the same way as for parcels, power, cable, fiber-optic, there's the last mile problem. Europe has almost solved it with high speed trains and efficient city transit. Then, it solves nothing for all those folks living in rural areas and having to drive f-150s.
Re:Andrej Karpathy leaves Tesla
by pm90 on Wednesday July 13, 2022 @08:06PM
(#32090319)
> Then, it solves nothing for all those folks living in rural areas and having to drive f-150s.
Fortunately thats not a lot of people.
When electricity was being rolled out, Westinghouse and Edison didn’t bellyache about not being able to provide electricity to rural areas. They electrified all the cities.
Rural areas will just never be able to pay for modern infrastructure. And… thats ok, its not a lot of people.
Re:Andrej Karpathy leaves Tesla
by ok_dad on Wednesday July 13, 2022 @08:48PM
(#32090620)
I think the point was that in rural areas they'll still use cars or something, because it's way more efficient for the low density there. In cities, you would switch away from cars as much as possible. I don't think the commenter meant we'd "abandon the hicks" or something rude like that; the rural folks who farm and do other important jobs are a crucial part of our society for sure.
Re:Andrej Karpathy leaves Tesla
by FireBeyond on Thursday July 14, 2022 @12:42AM
(#32092096)
> Things like traffic signals that actively communicate their status
This is a thing in Europe, and even some US cities - my Audi has traffic sign recognition and when at a compatible intersection knows what the light is at (by radio, not by light), and how long until it changes (will show a countdown in seconds til the next light change).
Re:Andrej Karpathy leaves Tesla
by dogmatism on Wednesday July 13, 2022 @09:05PM
(#32090743)
> optimized for human drivers over the past century
Are our roads really? Most in cities over a certain age are just haphazard relics of times gone by, and don't get me started on "stroads" which are good for nobody
Re:Andrej Karpathy leaves Tesla
by ruh-roh on Thursday July 14, 2022 @03:20PM
(#32100401)
> If we can't make the cars just as smart as an alert and capable driver, then maybe we need to meet halfway and make the roads a littler "dumber" (simpler) to accommodate the robots.
This aspect of FSD has always fascinated me and I'm a little surprised it doesn't get more discussion. Meeting halfway. At what point could/would/should FSD influence the environment around it?
For example - a poorly painted road sign*. Tesla/Waymo could say "We cannot support L5 FSD on this road until you fix this sign." If it meant a step forward in autonomy, Tesla/Waymo could even offer to share the cost of that improvement!
There are a million reasons why implementation of that would be problematic. Costs and incentives would be all over the place. But I am more interested in the framing: The machines are the ones that need to adapt. Which is essentially hoping for continued hardware improvements or a spaghetti mess of if/else statements. ie "do this weird thing if you see this other weird thing in front of you". Can we get rid of the weird thing and avoid the engineering challenge altogether?
* Yes, this is an overly simple example. Some environment changes could be so large that they would require a full redesign of a city/buildings/traffic patterns. But surely there are classes of improvements where some are easier than others.
Re:Andrej Karpathy leaves Tesla
by pas on Thursday July 14, 2022 @04:18AM
(#32093413)
massive AI leap? but we can ask language models about how to drive through an intersection and it will list the steps correctly (and wildly incorrectly at other times)
what's missing is combining this kind of "human concept relations" model (language, rules, minimal reasoning, text encoded human preferences) with perception, and safety (which means that the model should know that if other cars are driving just fine in front then it's unlikely that the road is on fire, or that the low certainty crack in the road is okay if two other cars already went over it unimpeded, if the road marks and the signs are inconsistent, but other vehicles have formed a slow but consistent pattern of traffic then that's the local ruleset, and so on)
it's still a very hard problem. and the required amount of compute is still bonkers, the required amount of data and training is still absolutely huge, and the whole problem of safely disengaging, handling the asleep/drunk passengers (likely target audience after all)... are all hard problems too :)
Re:Andrej Karpathy leaves Tesla
by capitalsigma on Wednesday July 13, 2022 @10:38PM
(#32091380)
You can get a self driving car ride and sleep in the back in Arizona, from Waymo. If you're on a special list, it sounds like you can do it in SF today with Cruise. Your claim is manifestly false.
Re:Andrej Karpathy leaves Tesla
by killdozer on Wednesday July 13, 2022 @07:45PM
(#32090160)
`possibly some sort of segregation between robot-driven cars and people-driven cars.` just build out public transit at that point, what's the difference.
Re:Andrej Karpathy leaves Tesla
by actionablefiber on Wednesday July 13, 2022 @07:00PM
(#32089804)
The pattern of zoning and development that the U.S. has used for the past 70 years assumes that nobody wants to walk or cycle anywhere and that they feel so strongly about it that they want cities to be built such that people will die if they attempt to do so. I grew up in a neighborhood where the elementary school was about half a mile away... on the other side of a five lane highway with no crosswalk and no sidewalk on the other side. Zero chance to assert your independence as a kid. Zero chance to live responsibly as an adult.
A part of the reason people wish they had FSD so badly is because they want to be rescued from this fundamental failure of NA-style urban planning that necessities driving, all the time, across both short and long distances.
Re:Andrej Karpathy leaves Tesla
by pm90 on Wednesday July 13, 2022 @08:08PM
(#32090332)
This is changing though. Cities are getting bikes and bike lanes. They’re building dense developments close to transit. ebikes + protected bike lanes + TOD might be the solution.
Re:Andrej Karpathy leaves Tesla
by actionablefiber on Wednesday July 13, 2022 @10:20PM
(#32091263)
I certainly hope so, and I've since moved to a place that is much more friendly for cycling; however if you go back to where I'm from (which for the purposes of this topic really could be one of any untold hundreds of counties in the U.S.), there are no signs of improvement or change. It's just the largest urban cores that seem to slowly be getting it. There is a breathtakingly large amount of suburban sprawl where the conversation about this topic is completely broken, and for the people willing to admit there even is a problem, they believe that the solution is one more lane, or one more stop sign, or just educating drivers a little bit better and nobody wants to talk about things like traffic calming, or upzoning, or cycle paths or anything else that makes anything other than car trips safe and desirable.
Re:Andrej Karpathy leaves Tesla
by rsynnott on Wednesday July 13, 2022 @08:02PM
(#32090293)
This is a bit of an oddity of US urban planning. The US has maybe 10 big to very big cities, where people can get around on foot, and then a host of what are called cities in the US but are essentially just collections of shopping centres, office parks, industrial estates, vaguely near each other.
It doesn't work like that in most countries; small cities and towns are navigable on foot and public transport.
Re:Andrej Karpathy leaves Tesla
by iainmerrick on Wednesday July 13, 2022 @08:28PM
(#32090460)
Public transport often means buses, though, so self-driving AI is still very relevant there.
If you could replace double-decker buses that arrive every 15–30 minutes with self-driving minibuses that arrive every 3–5 minutes, that would be great! (for everyone except the bus drivers who lose their jobs)
Re:Andrej Karpathy leaves Tesla
by rsynnott on Wednesday July 13, 2022 @08:55PM
(#32090678)
Typically in cities the biggest constraint on bus frequency is bus congestion at bus stops (and to a lesser extent congestion in bus lanes), not number of buses. To the point where banning cash on buses can meaningfully increase system throughput, as it decreases lag time at bus stops. This can be alleviated with planning where people have to transfer to get anywhere (moving buses out of chokepoints) but in practice people don't like that.
Actually, I suspect this makes self-driving a particularly _bad_ solution for city buses; getting into the bus stops takes some manoeuvring, particularly when there are other buses there.
One place that self-driving buses could be interesting (and indeed there are already a couple of systems like this) is on fully/near-fully segregated lines, where they don't have to deal with human-operated traffic. Another would be small towns, but you're looking at full magic level 5 at that point.
Re:Andrej Karpathy leaves Tesla
by iainmerrick on Wednesday July 13, 2022 @10:08PM
(#32091172)
I think a lot of those problems are solvable in principle, although unfortunately it’s probably not practical and incremental enough to actually happen...
I’m envisaging a system of minibuses, either AI-driven or at least dynamically directed by a central control system. People would use a phone app to book journeys; the app would tell them where to get on and where to transfer, and the central control system would optimise the fleet to get everyone where they need to go.
With much smaller buses, and electronic tap-in rather than cash payments, stops should be fast enough that buses can just queue up in order at each stop, hopefully mitigating the parking difficulties you mentioned (modulo breakdowns, medical emergencies, etc). Likewise, if transfers are fast and easy, hopefully they’d be less objectionable to travellers.
Requiring a phone isn’t ideal as it limits accessibility and privacy. There could also be pre-printed tickets, with QR codes that you scan at the bus stop to see the route info.
Why minibuses and not just taxis? I suspect there’s a good balance to be made between efficient road usage (buses) and efficient routing for each traveller (cars).
I’m also envisaging that if this system were to take off, personal cars could be gradually removed from city centres! Again, that makes life easier for the AI vehicles.
This is all pie-in-the-sky stuff, I know; but I do feel like there are ways we could radically improve city transport mostly using existing roads, rather than building new rails or tunnels.
Re:Andrej Karpathy leaves Tesla
by MonkeyMalarky on Wednesday July 13, 2022 @07:03PM
(#32089822)
A social one where you use experience to make inferences about what is going to happen next. Who hasn't observed an aggressive driver coming up from behind, weaving around other cars and said to themselves something like "that guy is going to cut me off, better ease off the gas so there's a little extra room in front for when he does". That level of situational awareness isn't coded for is it?
Edit: I have a whole mental model for other drivers and different approaches for them. Someone driving like a grandma? Pass when available. Nervous/erratic/lost driver? Keep extra distance then pass as soon as possible. Aggressive driver? Relax, give some space and let them get ahead. And so on. I get that stereotyping is bad but ignoring the subtle signals other drivers give off seems like it would be myopic. An AI that doesn't anticipate what others will do on the road will always be reactive rather than proactive.
Re:Andrej Karpathy leaves Tesla
by aidenn0 on Wednesday July 13, 2022 @07:20PM
(#32089957)
Most self-driving vehicles aren't just coded; they incorporate some form of ML as well. Categorizing patterns of behaviors is well within the reach of ML algorithms, but my understanding is we have far more basic problems to solve first (Tesla's seems to struggle with object tracking over time, which would be a necessary first step to recognizing patterns).
Re:Andrej Karpathy leaves Tesla
by MonkeyMalarky on Wednesday July 13, 2022 @07:50PM
(#32090197)
Developing object tracking and a sense of object permanence would be a pretty big prerequisite.. And here I was thinking about the RL model needed to decide what to do in the presence of other agents.
Re:Andrej Karpathy leaves Tesla
by dekhn on Wednesday July 13, 2022 @09:57PM
(#32091095)
How many people have been killed by Cruise or Waymo cars for the number of miles they've driven?
I maintain the position that if self-driving cars handle the most common situations as well as average human beings, there won't be a strong drive to make cars that drive significantly better than humans. Cruise and Waymo are collecting a limited version of that dataset right now. It's unclear how many deaths because some details are being kept under wraps.
Re:Andrej Karpathy leaves Tesla
by elcomet on Wednesday July 13, 2022 @07:42PM
(#32090134)
I disagree with you. On the contrary, I think it can only be solved by throwing more data, but much more data that we have available now, to get first a smart AI that has common sense about the world (a world model). Then we can start trying to drive in it.
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @09:17PM
(#32090831)
The counterexample to your point is that brand new 16-year-old human drivers seem to do a pretty good job of driving with very little training data. Yes, they do kill people and they're much worse drivers than 40-year-olds who have much more training data, but the fact that 16YOs kill as few people as they do with so little training data means some other mechanism than raw data quantity is important.
Re:Andrej Karpathy leaves Tesla
by rsynnott on Wednesday July 13, 2022 @06:40PM
(#32089633)
> Any reason why everyone seems to be stuck on this problem?
Because it's really, really difficult. A lot of AI-ish stuff pretty rapidly gets to the point where it _looks_ quite impressive, but struggles to make the jump to actual feasibility. Like, there were convincing demos of voice recognition in the mid-90s. You could buy software to transcribe voice on your home computer, and people did. And, now, well, it's better than in the mid-90s certainly, but you wouldn't trust it to write a transcript, not of anything important. Maybe in 2040 we'll have voice recognition that can produce a perfect transcript, and human transcription will be a quaint old-fashioned concept. But I wouldn't like to bet on it, honestly.
And voice recognition is arguably a far, far easier problem.
Re:Andrej Karpathy leaves Tesla
by UncleOxidant on Wednesday July 13, 2022 @07:02PM
(#32089817)
I'm old enough to remember all the breathless pronouncements in 2015 about how self-driving cars would be everywhere within 5 years. I was skeptical then and I'm still skeptical that it will ever happen outside of some limited range of well known paths that have been pre-determined to be safe - ie we'll have (and we do have) some self driving cars but they'll essentially be on a closed course and will not leave the course. There are already some small bus lines like that - the bus just goes around a closed circuit picking up and dropping off people always taking the same route.
Re:Andrej Karpathy leaves Tesla
by toss1 on Thursday July 14, 2022 @10:24AM
(#32096448)
I'd argue that voice recognition is in a worse place now — It creates a FALSE sense that it can do a good transcription, when it is actually corrupted in the worst way.
I took part in a legal deposition where an "AI Transcription Software" was being used. When I received the transcript it had numerous errors, but they were all subtle. More common names were inserted in place of the name that I said, e.g., "Kennedy" instead of "Kemeny". "You have a [something]" was transcribed as "I have a [something]", completely reversing the meaning. And many more errors.
The common thread between the errors was that what was inserted into the transcript would have been the MOST EXPECTED word or phrase, instead of the ACTUAL MORE SURPRISING (surprising in an information-theory way) word or phrase. It's evident that on top of the phoneme recognition layer, this transcription software checked questionable items against tables/graphs of most likely words to occur near the other words it confidently identified in that context. Makes a transcription sound great, but it is WRONG.
The result was that the "AI Transcription" actively destroyed key information and hid that destruction under the guise of a smoothly edited transcription.
Although this surely was not the intent of the system's creators, I cannot think of a better way to make a more evil transcription system.
Re:Andrej Karpathy leaves Tesla
by aeturnum on Wednesday July 13, 2022 @07:38PM
(#32090105)
I also imagine it is a space where...you very quickly get to a product that seems magical...but you can see in the data the places where your magical product will regularly be unable to make clear decisions. Unlike a lot of traditional product development, that knowledge makes it very hard for you to release, because the liability and ethical problems are very real.
It's somewhat unfair because we used to simply collect less comprehensive data on performance and therefore know less about our corner cases - but you don't get to live in the future without dealing with the problems of the future.
Re:Andrej Karpathy leaves Tesla
by antisthenes on Wednesday July 13, 2022 @11:50PM
(#32091792)
> You could buy software to transcribe voice on your home computer, and people did. And, now, well, it's better than in the mid-90s certainly, but you wouldn't trust it to write a transcript, not of anything important.
Is this the fault of software or people generally frequently using bad sound equipment in poor and noisy conditions, such as talking on the phone while driving, on the street, poor connection, wind/rain, etc. ?
Personally, because English isn't my first language, I frequently "fail" to transcribe what is being said and have to ask the other person to repeat themselves. It seems like an AI voice transcriber in 2022 is going to work better than me.
Re:Andrej Karpathy leaves Tesla
by rsynnott on Thursday July 14, 2022 @07:20AM
(#32094462)
Even in ideal recording conditions, machines are quite bad at transcribing human speech. Look at subtitles on live TV shows, typically produced these days by machine transcription; they're typically barely usable.
Re:Andrej Karpathy leaves Tesla
by Barrin92 on Wednesday July 13, 2022 @06:09PM
(#32089359)
>Any reason why everyone seems to be stuck on this problem?
ML maximalism focused on the narrow problem of 'solving driving' while not recognizing that any task as complex as driving requires probably something closer to general intelligence, and theoretically the field has been impoverished in favor of "throw more graphics cards at everything".
Re:Andrej Karpathy leaves Tesla
by hn_throwaway_99 on Wednesday July 13, 2022 @06:22PM
(#32089466)
Couldn't agree more. Especially when it comes to city driving, which would obviously be necessary for robotaxis, when AI zealots promise "it'll be here in a year or two", I always wondered "Have these people ever driven in the city?" I mean, to drive in a city, you basically:
1. Need to understand all standard signage (seems possible with AI).
2. Need to understand all "unstandard" signage (not sure how possible).
3. Need to understand the cop with the thick NY accent yelling at you saying "Can't you see there's been an accident and the road is covered with glass you dufus? Turn the F around."
I can certainly see AI solving the problem of driving in specially designed limited access highways (which could also support normal human drivers), and that alone would be a huge benefit, but I never saw how so many were willing to make the leap to "robotaxis that can drive you anywhere in the city."
Re:Andrej Karpathy leaves Tesla
by naijaboiler on Wednesday July 13, 2022 @06:55PM
(#32089769)
6. Need to reasonably predict what that human that just made eye contact with you would likely do next, and how that's different from what he might do when he doesn’t make eye contact with you. And all of that differs if you're in NYC or SF or small town, Indiana
Re:Andrej Karpathy leaves Tesla
by matt-attack on Wednesday July 13, 2022 @08:28PM
(#32090462)
7. Need to constantly read other drivers' body language (or "car language"?) and infer what their intensions are. I can constantly tell what a driver is literally thinking, by picking up on their subtle motions. Drifting over slightly (they're looking to change lanes but haven't yet turned on their blinker), they're slow to respond to green lights, or acceleration of forward traffic (e.g. they're on the phone, texting, etc.) I even routinely look at the eyes of the driver in front of me by looking in their rear-view mirror (yes this entirely possible and actually helpful). Are they looking down at their phone in their lap?
8. Generally understand the true context of things you're seeing. E.g a 4x8 sheet of plywood in the road, a squashed piece of road kill, a large metal pipe, a stopped vehicle, a baby carriage, a dishwasher, a tumbling large slab of styrofoam (all things I've encountered in the last year).
9. Is there a stopped firetruck in front of me (I list this because of the ludicrous fact that a Tesla plowed full-speed into such an obstacle).
Re:Andrej Karpathy leaves Tesla
by dibujante on Wednesday July 13, 2022 @07:21PM
(#32089965)
7. Need to understand that drunk person staggering along the roadside has been repeatedly slipping off the sidewalk and there's a non-zero chance they trip and fall right in front of you.
Re:Andrej Karpathy leaves Tesla
by powerhour on Wednesday July 13, 2022 @08:33PM
(#32090499)
8. Need to understand that sometimes the stripes you see aren't the real stripes, you're driving near sunset and are seeing the sun reflected off of old stripes that were painted over with glossy black (wtf WSDOT).
Re:Andrej Karpathy leaves Tesla
by ryantgtg on Wednesday July 13, 2022 @08:50PM
(#32090637)
7.5. Need to understand that the drink person staggering _inside_ the robotaxi has just thrown up in the backseat. After they are dropped off, the robotaxi cannot pick up any new customers.
Re:Andrej Karpathy leaves Tesla
by dekhn on Wednesday July 13, 2022 @07:59PM
(#32090268)
This is a dance move known as the "tenderloin lurch". Well, not really, the Tenderloin Lurch is when a person staggers up to a crosswalk, waits until they have a NO WALK sign and proceeds to cross, while ignoring all the drivers who about to run them over.
Re:Andrej Karpathy leaves Tesla
by uoaei on Friday July 15, 2022 @03:25PM
(#32111847)
I've been in situations like this. In SF. I grew up here.
What you describe is the classic west coast non-confrontationalism. You're probably annoying enough that it's simply not worth it to counter anything you say because you just dive into a petty and self-aggrandizing argumentative mode.
Brash and confused conservatives think everyone agrees with them, but in reality people don't want to get caught up in absolute bullshit by joining any kind of interaction with them. This is a common pattern by now. You would do well to recognize it.
Re:Andrej Karpathy leaves Tesla
by highwaylights on Wednesday July 13, 2022 @06:59PM
(#32089798)
Even then, even if you can solve every case involving actual roads with perfect markings and intact signs and functioning signals, I’ve found myself just this week:
- driving across an unmarked grassy mound to park a car at a store in their designated area.
- paying a fee with coins to enter and exit a toll road.
- stopping to move around roadworks based solely on hand signals from one of the workers.
These aren’t even scratching the surface in terms of edge cases that could be encountered regularly.
Re:Andrej Karpathy leaves Tesla
by steveBK123 on Wednesday July 13, 2022 @10:48PM
(#32091429)
Agreed.
People point at statements like "it just needs to drive better than the average driver" and "well lots of idiots drive".
On the flip side, lots of intelligent people with other skills do not have the confidence & comfort to drive outside of their towns local roads, or at all.
There are problem sets for ML like quant trading or phone album image tagging where you just need to be right 51% of the time to make money / be novel & useful.
We've seen plenty of examples showing ML is not appropriate for life&death problems like being the primary reviewer of diagnostic imaging for cancer screening.
The bar for ML to drive a car is much much higher, and I'm not even sure we have the right sensor suites feeding into the models, not to mention the compute capacity to operate at low enough latency.
Re:Andrej Karpathy leaves Tesla
by sonofhans on Wednesday July 13, 2022 @06:36PM
(#32089592)
Driving is a social problem, not a technical one. It's functionally the same as walking down a crowded sidewalk. The car is just a tool, just an extension of our bodies.
We can't build a robot which can walk down a sidewalk without running into people either. The sensor tech and mapping fidelity are red herrings. People drive well because only people are good at predicting human behavior.
Re:Andrej Karpathy leaves Tesla
by euske on Wednesday July 13, 2022 @07:17PM
(#32089926)
This. I'm always amazed by a skilled taxi driver maneuvering their car at a busy street in Tokyo with bustling pedestrians and bikes, some of them are old and slow and others ignoring traffic lights, just passing them by centimeters. It's like as if the car is a part of their body and they're threading though a crowd. They have to anticipate everyone else's move. The cars really look like people here and others treat them as ones.
Re:Andrej Karpathy leaves Tesla
by raydiatian on Wednesday July 13, 2022 @06:56PM
(#32089773)
Sort of. Your wording actually assumes down to its core that driving is inherently social, when in fact I think it may be only provisionally social. Driving currently “is social” in a few senses, But of course the important (and obvious) one is that it currently involves accounting for human-operated vehicles.
Alternatively, an autonomous vehicle operator in a homogenous network full of other autonomous operators has capabilities and characteristics that greatly simplify failure modes. Maybe even majority autonomous, partially heterogeneous? You can literally slow or stop the whole show to deal with a catastrophic event. It’s still “social” but probably much reduced from the scenario where you’ve got the full scope of human expressivity behind the wheel.
The REAL problem is how do we take our roads to the crossover point where those simplified network features become accessible.
Re:Andrej Karpathy leaves Tesla
by raydiatian on Wednesday July 13, 2022 @08:31PM
(#32090486)
> “This assumes our roads are used exclusively by autonomous vehicles”
I not only assume it, I say it out loud: “[fully autonomous, …] maybe even majority homogenous, partly heterogenous?”
> “When our roads are not used exclusively by motor vehicles to begin with.”
I’m not following what you’re saying here in the context of the earlier clause. If you mean not used exclusively by autonomous vehicles, yes, and that’s why I’m pointing out the provisional aspect.
Re:Andrej Karpathy leaves Tesla
by sonofhans on Wednesday July 13, 2022 @11:38PM
(#32091722)
You know, I could be snide, and say, “We’ve already invented that — it’s called a train.” :D
But I’ve thought the same, too. If every car on the road is robot-controlled then it changes the problem. Modulo failures, discrete algorithms should behave predictably towards each other, like the unix API philosophy.
It seems hard to get there, though. Even today it’s a PITA to maintain API boundaries in simple libraries, never mind make sure that the new Tesla v12.4 Full Self Driving For Real This Time doesn’t trigger edge cases in Volvo v7.7a Actually Real Self-Driving We Promise.
Can we make software that allows cars to behave as predictably as rail cars, but without the rails? Maybe, but I expect only on limited-access freeways. I’m sure these robot-driven cars will remain incompatible with common road uses cases like pedestrians, cyclists, and children chasing balls.
Re:Andrej Karpathy leaves Tesla
by cco on Wednesday July 13, 2022 @06:23PM
(#32089485)
I paid ~$10 for two rides after signing up as a regular ole user in Mesa AZ. It was great, the first ride was a bit nerve wracking, but the second felt very nice.
I certainly wouldn't argue with you that it isn't ready for prime time and wide distribution, but it is interesting to see their progress in San Francisco, a much different driving problem.
If it takes them 10 years to get to prod in Mesa, two (maybe three?) in SF, maybe they start shrinking that a lot in metros without winters. ¯\_(ツ)_/¯
Re:Andrej Karpathy leaves Tesla
by espadrine on Wednesday July 13, 2022 @06:38PM
(#32089617)
Waymo has superior performance based on their historical statistics. It makes sense, since their lidar sensors capture more of the environment, and directly in 3D. Their AI also seems better QA’ed.
The Tesla AI Day[0] surprised me as it showed they only had a simple architecture for a very long time, simply feeding barely processed camera pixels to a DNN and hoping for the best with little more than supervised learning off human feeds. Their big claim to glory was that they rearchitectured it to produce a 2D map of the environment… which I thought they had years ago, and is still a far cry from the 3D modeling that is needed.
After all, sure, we humans only take two video feeds as input… But we can appreciate from it the position, intent, and trajectory of a wealth of elements around us, with reasonable probability estimates for multiple possibilities, sometimes pertaining to things that are invisible, such as kids crossing from nowhere when near a school.
Cruise also seems to have better tech; they had a barely-watched 2h30 description of their systems[1] which shows they do create a richer environment, evaluate the routing of many objects, and train their systems on a very realistic simulation, not just supervised training, which means it can learn from very low-probability events. They have a whole segment on including the probability that unseen cars may travel from perpendicular roads; Tesla’s creeping hit-or-miss are well-documented on Youtube.
Re:Andrej Karpathy leaves Tesla
by giantrobot on Wednesday July 13, 2022 @08:21PM
(#32090421)
> After all, sure, we humans only take two video feeds as input…
No, we use both our perception and proprioception when we drive or walk for that matter. We have two accute visual sensors mounted in a housing with six degrees of freedom and a sensor feedback mechanism.
We also have fairly sensitive motion and momentum sensors all throughout our bodies. Additionally we have audio sensors feeding into our positional model.
All this data is fed into an advanced computing system that can trivially separate out sensor noise from useful signal. The computing system controls the vehicle, navigates, and even performs low priority background tasks like wondering if the front door of the house was locked.
We have dozens of integrated sensor inputs. It's just silly to assume we only use our eyes when driving. They're certainly an important sensor for driving but definitely not the only one.
Re:Andrej Karpathy leaves Tesla
by steveBK123 on Wednesday July 13, 2022 @10:57PM
(#32091484)
All the vision-only maximalists also ignore how insufficient Tesla cameras are compared to your human eyes in terms of resolution, dynamic range and refresh rates.
If you ever review your Tesla Dashcam footage you'll see that you can rarely even make out a license plate. The cameras are not even HD, let alone UHD.
Further the refresh rate is a paltry 36fps.
Drive the car at high noon or night and you realize how poor the dynamic range is with highlights and/or shadows get lost.
Re:Andrej Karpathy leaves Tesla
by kadoban on Thursday July 14, 2022 @12:31AM
(#32092033)
> Yeah, but I am sure Tesla's software can do the same.
They absolutely cannot. They won't even try, they require a driver to be there to be ready to take over with no notice. Their software also makes so many basic mistakes that even what they're allowing it to do is dangerously reckless.
Re:Andrej Karpathy leaves Tesla
by alphabetting on Wednesday July 13, 2022 @06:12PM
(#32089386)
There's been a lot of progress despite AVs not meeting intitial hyped predictions. Waymo and Cruise are operating driverless robotaxis in SF. We're probably a couple years from many major cities having them.
Re:Andrej Karpathy leaves Tesla
by turzmo on Wednesday July 13, 2022 @07:35PM
(#32090087)
We often can figure out how to take a product that works 90% and bring it to 99%, and then to 99.9%. The engineering challenges involved in each nine are often vastly more than the percentages indicate, but they're conceivable. With AI we have absolutely no idea how much effort might be required to get to that next level of reliability. We hope that bigger models, or better AI technology might get us there, but there's also a chance that they won't.
Re:Andrej Karpathy leaves Tesla
by tootie on Wednesday July 13, 2022 @06:21PM
(#32089461)
Probably because it's really, really, really hard to solve the thousands of edge cases that occur in real-world driving situations. I don't think FSD happens until government gets behind it and starts putting infrastructure behind it. If we start building roads (and cars) to be highly visible to AI one way or another, it all becomes much easier.
Re:Andrej Karpathy leaves Tesla
by aaaaaaaaaaab on Thursday July 14, 2022 @06:38PM
(#32102231)
>If we start building roads (and cars) to be highly visible to AI one way or another, it all becomes much easier.
Or we could build 1-dimensional roads, which would make the AI's jobs much easier. Like, we could put down two parallel piece of metal, which vehicles could "hook" onto somehow...
Re:Andrej Karpathy leaves Tesla
by uoaei on Wednesday July 13, 2022 @09:28PM
(#32090911)
> Any reason why everyone seems to be stuck on this problem?
Because they're all trying visual- or line-of-sight methods only, I call this the "robo-human" fallacy in ML: trying to automate the processes that humans undergo so that you eventually have a drop-in replacement for a human. But that is a myopic and unimaginative approach because you could be re-assessing the system itself and eliminating inefficiencies that lead to poor performance.
In the autonomous vehicles space, there is massive potential for self-organizing swarm algorithms to control pelotons of cars, rather than individual cars with no intrinsic sense of the general flow of traffic. You wouldn't need a top-down "commander" style architecture, it could be designed so that cars only talk to their immediate neighbors and emergent patterns keep traffic flowing smooth and fast.
I have always been skeptical of the attempts to reduce the amount of information about the road that a car receives. (Moving from stereoscopic to monocular vision to save the cost of one camera seems just stupid.) But people who dream of "smart cities" really seem to see little more than The Jetsons in their mind, and it limits the scope of research to our detriment.
Re:Andrej Karpathy leaves Tesla
by dlkf on Thursday July 14, 2022 @07:04AM
(#32094363)
I’d like to hear an actual response from the people downvoting this comment. It’s an interesting perspective, and while I can imagine legit criticisims (SPOF, privacy concerns, coordination with vehicles outside the system, etc) actually articulating them would yield a more productive discussion than downvoting without comment.
Re:Andrej Karpathy leaves Tesla
by realitysballs on Thursday July 14, 2022 @10:48PM
(#32104088)
Answer me this;
How is AI supposed to confidently distinguish a real stop sign from someone/something holding up a picture of a stop sign?
Yes, this is a weird edge case, but I think it gets at the core issue being that it takes way more sophistication to release this tech into the wild then ppl would like to admit.
Re:Andrej Karpathy leaves Tesla
by AlotOfReading on Wednesday July 13, 2022 @10:43PM
(#32091402)
Has Zoox even gotten the permits to do fleet-scale driverless testing? Last I heard, they were still limited to 2 vehicles on specific streets in foster city. Doesn't seem very solved.
Re:Andrej Karpathy leaves Tesla
by toss1 on Wednesday July 13, 2022 @08:15PM
(#32090378)
Google/Alphabet is stuck and will make advances in specific territories but will never get there without a fundamental change in approach. Their approach relies on very detailed mapping/modeling of specific terrain, so they can make a usable case sooner, but outside of the map/model territory, they're literally lost. And maps/models change constantly and rapidly.
Tesla is taking a fundamentally more broad and deep approach - working with the fundamental fact that a pair of visual sensors and a compute engine (eyes & brain) can successfully figure out driving in strange areas in real time, ergo, it should be possible without a map/model or lidar. Once they get it solved, it will be solved once and for all. Bigger gamble, bigger payoff. Equipping the car with dozens of eyes is the easy part. The question is whether enough compute power can be brought to bear on solving the recognition problems, and the edge cases. They have obvious issues with failing to recognize large objects like trucks in unexpected orientations, left turns etc. Using millions of miles of live human driver data as a training set is great, except that the average driver is really bad, so it's entirely polluted with bad examples, ESPECIALLY around the edge cases that get people killed. There, examples from professionally trained drivers, who really understand the physics and limits of the car, adhesion, traffic dynamics, etc, are what you want to train on, but that isn't what they have. It is also possible that even if the set of training data would actually be sufficient, the big question will kill them - perhaps the solution requires orders of magnitude more compute power to approach human performance, and they just don't have the hardware to simulate human compute power. So, have they just hit the limits of what their compute power can do?
I think Tesla's approach is fundamentally the way to go, as it is a general solution, compared to everyone else's limited map/model approach.
But both may require either or both a more specifically programmed higher-level behaviors, and/or something much closer to AGI than exists, something that has actual understanding of the machine-learned objects and relationships, which does not yet exist (if one is known, pleas correct me - I'd love to know about it).
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @06:29PM
(#32089530)
Uber bet the company on robotaxis and lost. Tesla is still building very good cars that happen to not be able to drive themselves. Just like every other car. If they could lose their obsession with self-driving and just focus on their incredible cars, they'd still make money.
Re:Andrej Karpathy leaves Tesla
by aeturnum on Wednesday July 13, 2022 @07:46PM
(#32090165)
They are very much "default alive" BUT I get the sense that a lot of the company's plans and valuation are based on the idea that Tesla will not "just" produce competitive electric cars. They could make money just doing that - but they would never meet the expectations around their company's' trajectory that way and so they would be a "bad" investment (in ROI terms). So I think that everyone who is still working on the "more than a car maker" goal is going to insist the company will be more than that until they really can't.
Re:Andrej Karpathy leaves Tesla
by elliekelly on Wednesday July 13, 2022 @08:12PM
(#32090361)
Their leadership also doesn’t know when to STFU. There was a time when Tesla was _the_ luxury electric vehicle. But Musk is polarizing. He’s isolating formerly loyal customers and more and more compelling alternatives are coming to market every day.
Re:Andrej Karpathy leaves Tesla
by dirkg on Wednesday July 13, 2022 @08:19PM
(#32090406)
Tesla is so overvalued only because of their claims of self driving. Musk utters a lot of bs but he's right that without this Tesla is doomed.
They have a big head start, but other car companies are now investing much more in battery tech etc and will quickly catch up. Not to mention Tesla's have terrible build quality, they have a lot of shady business practices like overcounting sales, reusing sold parts etc which came out in the recent leak.
Thing like the 4860 battery which were so hyped turn out to be not that much better. FSD is years away. Stop selling vaporware.
What they need to focus on is things they innovated on like OTA updates, integrated systems, no dealerships etc.
Re:Andrej Karpathy leaves Tesla
by ifaxmycodetok8s on Wednesday July 13, 2022 @07:45PM
(#32090157)
> focus on their incredible cars
They have terrible manufacturing quality. The screens melt in Arizona heat. Maybe the ride is cool and feels good, but the car itself is not incredible.
Re:Andrej Karpathy leaves Tesla
by theluketaylor on Thursday July 14, 2022 @02:38AM
(#32092750)
How many other cars do you know that turn their A/C on while stationary for ‘cabin overheat protection’? My 2021 model 3 did that this week while sitting in the sun in northern Ontario and was helpful enough to send a push notification to let me know.
This is not to helpfully make sure the driver gets into a nice cool car when they finish their errand. It’s because the non-automotive grade screen isn’t rated or tested above 40C and were failing in heat. Rather than upgrade the part and do a recall Tesla opted to just use battery to keep the cabin below 40-45C.
I love EVs, but that’s some pretty dodgy behaviour.
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Friday July 15, 2022 @11:20AM
(#32109047)
I take your point but to me this seems like a feature rather than a bug. Many of the plastic parts in most cars (not just Teslas) are degraded by oxidation in the greenhouse heat of the car being parked in the sun for a long time. Some of that oxidation is caused by UV, but to the extent that it's caused by heat, keeping the interior of the car somewhat cooler should prolong the life of its interior plastics.
This is not really an option in an ICE car because it would require running the engine. In an EV, it's easy.
Re:Andrej Karpathy leaves Tesla
by theluketaylor on Friday July 15, 2022 @01:17PM
(#32110499)
vinyl and plastic degradation is a many years-long process before it has any real impact on the performance of the parts. Failure or yellowing of the non-automotive grade screen in a model 3 has been seen in just a few weeks or months.
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @08:57PM
(#32090691)
I've put a lot of miles on my ModelY in Phoenix in the summer. Phoenix in the summer is not my idea of fun, but the screen (and the rest of the car) worked fine.
Re:Andrej Karpathy leaves Tesla
by aetherson on Wednesday July 13, 2022 @10:29PM
(#32091319)
I think the whole "terrible manufacturing quality" thing is a talking point people seized on. They had problems with manufacturing quality as they brought up their whole factory/assembly process -- was their manufacturing quality ever "terrible"? Meh, I think it was kind of "we have kinks to work out." Nowadays, they seem fine.
Re:Andrej Karpathy leaves Tesla
by rootusrootus on Wednesday July 13, 2022 @07:21PM
(#32089976)
> If they could lose their obsession with self-driving and just focus on their incredible cars, they'd still make money.
They may want to think about that strategy soon. Model 3 is starting to seem dated (not to mention Model S, which is ten years old). There are very competitive alternatives on the market now that have strengths where Tesla is weak, and which are not especially weak in the areas Tesla is strong.
Re:Andrej Karpathy leaves Tesla
by dirkg on Wednesday July 13, 2022 @08:23PM
(#32090430)
Model 3 is still the best electric car for most people. Its just too expensive now but so are others. No one else has a battery thats as efficient, the charging network, convenience features like key card, integrated navigation (although CarPlay/Android Auto are good too), the handling is much sportier, they hold their resale value, and no dealerships.
Re:Andrej Karpathy leaves Tesla
by rootusrootus on Wednesday July 13, 2022 @10:26PM
(#32091303)
For a sedan, it's pretty compelling. But I expect my wife's next daily driver to be a crossover size, and more likely than not (at this point) a Mach-E. The range is there, the interior is good, CarPlay, and $15K less than a Model Y.
There are certainly some questions that are hard to answer. Maybe the Tesla will continue to hold value. But given that I see them everywhere now, they're feeling more like a commodity every day. I'm not sure how it will play out, the market is dynamic and recent events have been very disruptive. All EVs are selling out months ahead of production at this point.
Re:Andrej Karpathy leaves Tesla
by notJim on Wednesday July 13, 2022 @07:48PM
(#32090176)
In what sense is the Model 3 seeming dated? It's still one of the best electric cars on important measures like range and efficiency. It also has access to hands down the best charging network and is well loved by its owners, despite the well-documented problems.
Re:Andrej Karpathy leaves Tesla
by bhauer on Wednesday July 13, 2022 @08:00PM
(#32090276)
Bjørn Nyland's review of the 2022 Model 3 Performance [1] confirms your view that the Model 3 is absolutely not dated. He tests scores of EVs and still considers the Model 3 the best balance of comfort, features, technology, performance, etc. If anybody here is seriously concerned that the Model 3 may be "dated," I suggest watching the video below.
Re:Andrej Karpathy leaves Tesla
by rootusrootus on Wednesday July 13, 2022 @10:34PM
(#32091354)
Eh, looks dated to me. But I had an early one for a while. They're everywhere (at this point I lump 3 & Y together since for all practical purposes they're the same design).
Range is okay, but Tesla overestimates. Mine lost about 1.2 miles of range for every mile driven, and as a practical matter it was more of a 200 mile car than a 300 mile car, unless you really wrung it out. There are a bunch of 300+ mile EVs either on the roads now or releasing in the next few months. The only Tesla that has a range worth bragging about is the 400 mile version of the Model S. I do look forward (hopefully!) to regular cars having that kind of range, instead of just the top end ones.
I personally think Tesla is playing with fire leaving the quality so low. Well over half of all Model 3s have to return for repair within the first month. That's terrible. Recall how long it's taken other domestic manufacturers to regain any kind of reputation for quality, and even then many people will never believe they make good cars. For what a Tesla costs, people have high expectations. They're enjoying fad status right now, and that's great, but there is no shortage of Tesla owners already who've sworn off ever buying another one.
Re:Andrej Karpathy leaves Tesla
by duped on Wednesday July 13, 2022 @06:42PM
(#32089648)
> Tesla has bet the company on robotaxis,
How so? They're not selling robotaxis or building factories to build them
> Tesla has repeatedly promised FSD is right around the corner
Which means it's years away and/or "FSD" means "automatic cruise control and lane keep assist" or whatever standard feature from auto manufacturers they've renamed
Re:Andrej Karpathy leaves Tesla
by clouddrover on Wednesday July 13, 2022 @06:49PM
(#32089714)
> How so?
Because they chose to back themselves into that corner. Musk says that Tesla is worth nothing without full self-driving. Certainly it's the only thing left to justify the stock price:
The lies have been profitable so far. People have bought into the false promises. Perhaps they'll start demanding refunds for the full self-driving they paid for that has still not been delivered.
Re:Andrej Karpathy leaves Tesla
by electric_mayhem on Wednesday July 13, 2022 @07:00PM
(#32089806)
Consumer and grid-scale battery storage
Solar
And I also think they could do some clever stuff with home HVAC, possibly using waste heat from crypto miners as the H.
Lastly, afaik they went camera-only in their cheap cars (3/Y) and still use fancy stuff in the S/X.
They gave fsd customers new computers once. What’s to stop them from going back to vision+lidar or whatever once the parts are available and retrofitting as needed?
The whole ‘vision-only is better’ gag seemed like an obvious ploy to keep being able to ship cars from the beginning of supply chain problems.
And yeah, Elon does not appear to be a good person.
Re:Andrej Karpathy leaves Tesla
by rsynnott on Wednesday July 13, 2022 @08:08PM
(#32090331)
> And I also think they could do some clever stuff with home HVAC, possibly using waste heat from crypto miners as the H.
That doesn't sound... particularly clever. Crypto miners are essentially disposable, with a useful economic lifetime of a couple of years, typically. And they are 100% thermally efficient. Which sounds quite good, until you consider that an air source heat pump is typically around 300% thermally efficient, rising to up to 500% for ground source.
So, once your crypto miner is no longer really making anything (a couple of years), you're left with a really inefficient heating system.
> Tesla has just confirmed that it has removed radar from the Model S and Model X as of mid-February 2022, moving its entire lineup to what it calls ‘Tesla Vision,’ which is an array of cameras that Tesla says negates the need for radar. The manufacturer did the same for the Model 3 and Model Y in May of last year and even though this prompted some questions from the IIHS, the institute is now fine with it after testing.
Re:Andrej Karpathy leaves Tesla
by HWR_14 on Wednesday July 13, 2022 @11:29PM
(#32091654)
> This announcement comes after a 4 month sabbatical where Karpathy said he wanted to take some time off to “sharpen my technical edge,” which makes it sound like this is the result of frustration with the technical approach instead of burnout.
That's exactly what I would expect someone burning out to say. You feel the burnout so you need time to get over it and feel 100% (regain your technical edge). You're still burnt out after 4 months, so you don't come back.
Frustration with the technical approach can also cause burnout.
Re:Andrej Karpathy leaves Tesla
by osuairt on Thursday July 14, 2022 @04:11AM
(#32093364)
Yes, the vision only approach isn't something that you do in robotics.
There is usually a hierarchy of sensors, mainly for redundancy.
Example: Bumper sensory at the wheel base, sonar / Lidar at the mid, and a camera at the top for advanced sensing.
For the sake of cost cutting Tesla has done away with their radar sensors at the front of the vehicle. It would be a substantial cost overhead, but have very real repercussions when it comes to safety, while also providing a "ground truth" to what at least the front facing cameras are seeing.
I don't think Lidar is a practical sensor for them to adopt, because it is quite bulky and has limited viewing angles, but I would expect them to have adopted some novel, lower cost radar solution.
Apart from the lower cost of the camera, I think Elon's rationale for having a camera only FSD is not valid, has made the problem needlessly complex and unsafe. He believes since we have eyes, and we can drive a car, then it should be sufficient to drive the car, but we only use eyes because these are the sensors we were born with, it is the best we have. In my mind, Elon's approach is like looking at a horse, and saying to yourself, that you want to build a car based on a horse, where instead of wheels, you have four mechanical legs, and those mechanical legs are limited is so many ways, but they should still at least "work", but there is no reason to limit locomotion in that way. The same with the vision system on a FSD, the whole spectrum of light is available, with any number of configurations, providing data at rates and with precision far beyond what a camera system can do.
Re:Andrej Karpathy leaves Tesla
by agoose77 on Thursday July 14, 2022 @06:13AM
(#32094067)
IIRC there was a presentation from Karpathy talking about the challenges with sensor fusion, particular in resolving divergence between e.g. the vision and the radar stack: https://www.youtube.com/watch?v=NSDTZQdo6H8&t=1949s
My background is in physics, but I find myself having a growing appreciate for the vision-only stack. It's really challenging building a formal understanding of the world that is robust to outliers that are so numerous as navigating in an urban environment. With vision, you have multiple kinds of information that are highly correlated (colour, spatial distribution, depth, etc) that are self-consistent. Whereas, fusing radar with vision, where object responses to radar are highly geometry & material dependent, is a much harder task.
I'm really not an expert, so this reads more as an opinion than an experienced view, but I can see the merits in doubling down on vision.
Re:Andrej Karpathy leaves Tesla
by harles on Wednesday July 13, 2022 @09:08PM
(#32090777)
Monocular vision only seems pretty clearly not capable of solving the problem. Stereo/multi view systems have a shot (humans are proof), but Tesla bet against that long ago. I wonder what could’ve been in a proper multi view setup.
Re:Andrej Karpathy leaves Tesla
by pilaf on Wednesday July 13, 2022 @11:04PM
(#32091520)
Humans are perfectly capable of driving on racing simulators using a flat screen though, where binocular vision makes no difference.
And Tesla cars have more than one camera on them. The front-facing camera is actually an array of 3 cameras (the two farthest ones are at about human eyes distance), but they're also equipped with forward and rearward looking side cameras, and back cameras.
I think Tesla underestimated how hard vision-only FSD is, but having a single camera (they don't) is not the reason.
Re:Andrej Karpathy leaves Tesla
by harles on Thursday July 14, 2022 @03:12AM
(#32092944)
Driving simulators are a bad example. It’s too easy to learn priors. A better analogy is humans with one eye that still drive - most are taught to induce parallax.
Also, I never said they have one camera. Multi camera != multi view.
BTW, Andrej, if you're reading this, it is not just excellent it is beyond excellent. I do a lot of tinkering with transformers and other models lately, and base them all on minGPT. My fork is now growing into a kind of monorepo for deep learning experimentation, though lately it started looking like a repo of Theseus, and the boat is not as simple anymore :)
Re:Andrej Karpathy leaves Tesla
by rsynnott on Wednesday July 13, 2022 @06:38PM
(#32089607)
> but their vision only tech stack doesn’t seem capable of solving it
Well, I'm not sure that anyone's tech stack is capable of solving it; the live examples of robotaxis are, well, not something you'd bet your company on (and generally their creators are _not_ betting their companies on them). There was, I think, a decade ago the idea that fully self-driving cars were a near-term inevitability. That's fading, now.
Re:Andrej Karpathy leaves Tesla
by TheDarkestSoul on Wednesday July 13, 2022 @06:41PM
(#32089638)
I think a lot of that came from the Tesla hype machine creating a strong association between electric and self-driving as being the immediate future of cars in popular consciousness, so when people saw electric becoming a reality they assumed self-driving was right around the corner when in actuality their maturity levels aren't related much at all. Fallacious thinking that may doom a few companies between Lyft, Uber, and Tesla
Re:Andrej Karpathy leaves Tesla
by rootusrootus on Wednesday July 13, 2022 @07:23PM
(#32089987)
This is a good point. I think the market has to adjust to a reality where electric cars are just cars that happen to be electric, rather than a hyped up techno-dream. Electric propulsion all by itself is pretty great, we don't need to tie it to FSD dreams.
Re:Andrej Karpathy leaves Tesla
by thatswrong0 on Wednesday July 13, 2022 @08:45PM
(#32090600)
I don't see how smart roads would solve the issues of "the unexpected".. weird pedestrian behavior, getting cut off, parked trucks, construction, etc. It seems to me that smart roads would only solve the issue of general routing, and that already seems to be dealt with as far as I can tell.
Re:Andrej Karpathy leaves Tesla
by vanilla_nut on Wednesday July 13, 2022 @10:12PM
(#32091197)
It wouldn't. A real "smart road" implementation would require us to literally fence off those roads so pedestrians, deer, children, bicyclists, etc. cannot use them. And they would likely fail in any kind of inclement weather -- fog, snow, rain, etc.
Essentially an admission of failure for the self-driving car industry.
Re:Andrej Karpathy leaves Tesla
by dirkg on Wednesday July 13, 2022 @08:24PM
(#32090442)
how is that any different from geofencing. The goal of an AV should be a car that can drive in any country/road. Not just fancy smart roads in western countries
Re:Andrej Karpathy leaves Tesla
by macNchz on Wednesday July 13, 2022 @08:09PM
(#32090335)
I've long had this fantasy of a smart road pilot program wherein manufacturers would partner with governments (or toll road owners in some places?) to make self-driving-only smart lanes, where you have to surrender control but the car goes 120+mph. I imagine getting even a handful of popular longer routes enabled for that would be quite popular.
Re:Andrej Karpathy leaves Tesla
by glintik on Wednesday July 13, 2022 @06:23PM
(#32089472)
> if he felt they were close to solving the problem anytime soon
He felt? It's evident enough, that approach they used doesn't allow them to prepare FSD for real life and real streets. I think he just understood, that approach to be changed/improved significantly to reach the goal.
Re:Andrej Karpathy leaves Tesla
by lazyjones on Wednesday July 13, 2022 @07:24PM
(#32089992)
> doesn’t seem capable of solving it,
How so?
If humans can master driving with 2 eyes looking forward, why would a car with plenty of cameras in all directions not have sufficient sensory input to master it?
Re:Andrej Karpathy leaves Tesla
by ra7 on Wednesday July 13, 2022 @07:28PM
(#32090026)
Same reason airplanes don't fly by just flapping their wings like birds. There's not always a biological equivalent for solving a problem, especially when you take into account human brain's evolution over millions of years. Sometimes computers need more help.
Re:Andrej Karpathy leaves Tesla
by dekhn on Wednesday July 13, 2022 @08:00PM
(#32090281)
It does seem reasonable, though, that if humans can solve safe driving with a brain mass (3 lbs) that computers wouldn't need that much more help. Put another way: every machine learning "expert" who has a kid is amazed to learn how simple unsupervised learning is and how few training examples are required.
Re:Andrej Karpathy leaves Tesla
by ra7 on Wednesday July 13, 2022 @07:14PM
(#32089908)
> This announcement comes after a 4 month sabbatical where Karpathy said he wanted to take some time off to “sharpen my technical edge,” which makes it sound like this is the result of frustration with the technical approach instead of burnout.
I think Karpathy realized (probably way back) that cheap sensors + no HD maps + their (reckless) public testing feedback loop doesn't advance towards L5 self driving and is bailing out. Karpathy has always backed Elon Musk whenever he talks about their technical approach, so it can't be frustration with the approach all of a sudden.
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @06:32PM
(#32089558)
If Musk actually said this he's an even bigger idiot than I gave him credit for. He makes the best cars in the world (obviously IMHO) and that's worth a lot more than 0. I couldn't give less of a damn if they can't drive themselves.
Re:Andrej Karpathy leaves Tesla
by moomoo11 on Wednesday July 13, 2022 @07:04PM
(#32089832)
I ended up selling mine because the build quality started getting on my nerves. Misaligned panels that are "within spec" or interior rattles that make the ride completely unpleasant (at only 10k miles).
The tech is all right, and I got to try auto pilot at a discount. Unfortunately the phantom braking made AP completely useless with passengers who would freak out and complain. However, when it worked it was quite nice but I ended up using it way less than I'd hoped. Glad I didn't pay 12k for it!
The best part of owning the car was the insane acceleration and supercharger network at the beginning. But, that got annoying as more people started getting Teslas. Going on longer trips meant a ton of anxiety especially since some superchargers in cities would be packed. Worse, some would be out of order or slow charging. After the gimmick wore off, wasting 45 minutes to go another 2-3 hours started becoming annoying. And before someone asks why 2-3 hours, its called hills. California is full of them, and especially where I live I lose so much efficiency climbing hills.
Anyway overall I'd rate the car 5/10. Fastest car I've ever owned. Beyond that it was pretty much exactly as they described - a beta product. I'll probably try a Tesla again in 5-10 years.
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @08:38PM
(#32090537)
This is mostly not my experience after 18 months but I appreciate your report. My car's build quality has been nearly perfect (which I didn't expect because of lots of contrary reports in 2020.) I tried FSD on the $200/month plan and I agree it's bad. The car stopped at green lights, kept going at red, turned right from the middle lane, etc. So I canceled it.
I live in the Rocky Mountains so I can relate about the hills, but haven't noticed a big range deficit from them. Probably because every uphill has a corresponding downhill and regen braking can recover some of the uphill energy loss. What I notice much more is wind. Driving fast into a headwind entails a huge energy loss (proportional to your airspeed cubed--yikes!) and it cannot be recovered. OTOH driving with a tailwind can add significant range.
I've also not noticed much of a problem finding open superchargers but that might be because I mostly drive in "flyover country." The supercharger network has also expanded significantly just in the 18 months I've had the car.
Re:Andrej Karpathy leaves Tesla
by dreamcompiler on Wednesday July 13, 2022 @08:47PM
(#32090614)
Can you blame us? The messaging from the company is both inconsistent and insane. I just call the built-in autosteer wizard "the lane keeper" now because that bypasses the terminology confusion. BTW it works reasonably well on the highway in good conditions. It's perfect as a way of taking a short break and stretching all 4 of my limbs during a drive, but that's the only reason I use it.
Re:Andrej Karpathy leaves Tesla
by dham on Wednesday July 13, 2022 @09:12PM
(#32090792)
They should just rename Autopilot to some generic thing (but not Autopilot haha) like every other companies adaptive cruise control. Then use Autopilot for FSD.
Re:Andrej Karpathy leaves Tesla
by carbadtraingood on Wednesday July 13, 2022 @06:43PM
(#32089661)
As an owner for 5+ years, the cars show well but pretty quickly become a pain in the ass.
They'll get eclipsed by other electric car manufacturers real quick.
Edit: more specifically, the parts break and they are difficult to replace. The battery degrades. They stopped providing maps to the vehicle unless I'm willing to spend several hundred dollars to replace the media console, they've told me I'm covered by a recall/warranty but have been unable to schedule the appointment.
Re:Andrej Karpathy leaves Tesla
by rootusrootus on Wednesday July 13, 2022 @07:28PM
(#32090029)
> As an owner for 5+ years, the cars show well but pretty quickly become a pain in the ass.
I agree. As a former owner. They are fun to show. But there are real annoyances. In the case of the Model 3 in particular, I quickly tired of the door handles. The psychotic windshield wipers. No CarPlay. The smartphone unlocking which worked most of the time until just that moment when your hands were full. It became a chore to live with. But dear god was it fast (I had the Performance trim). Not enough. I need my daily driver to not be a PITA.
I'm very interested in what the competition is doing. Ford one-upped the Model Y by putting that knob on the display and then adding another display in front of the driver. Most of the competitive EVs have real interiors, for that matter. All of them have CarPlay. Porsche made a legit sports car.
Re:Andrej Karpathy leaves Tesla
by bredren on Thursday July 14, 2022 @05:19PM
(#32101582)
Thanks for this. I checked out a YT video about Ioniq 6 and was interested enough to look for the official page. (that matte black one looks pretty cool) [1]
But oof, the web site is just terrible. I can't imagine the effort that went into that car and then have it be paired with what they've come up with there.
I hope that competition rises to the level of Tesla on the product presentation / ordering side as well.
Re:Andrej Karpathy leaves Tesla
by Denzel on Wednesday July 13, 2022 @07:59PM
(#32090273)
Ok? As a Model 3 owner for 3+ years the car shows well and has been rock solid this whole time.
> Parts break difficult to replace
I think I had a set of squeaky control arms that Tesla replaced under warranty in less than a week, free of charge. I don’t remember because it was such a nonissue.
Side swiped by another driver; dented my fender, bumper, smashed the headlight. Their insurance took fault, Tesla certified body shop gave estimate and fixed in less than a week (from the time dropped off).
> The battery degrades
Knew this going in. What battery doesn’t? Still comfortably road-tripping and camping with the family in my car.
> They stopped providing maps
Huh? I receive updates every time my car updates which is often. I’m guessing you’re talking the an older Model S.
> Recall/warranty and unable to schedule appointment
I’ve scheduled 5+ appointments with Tesla service center or mobile service through the app. Never been an issue.
On top of all that, my car is worth more now than it was when I bought it. Everyone in my family that drives the car loves it. The car turns heads and generates questions on the daily for 3+ years now. My young daughter’s friends still lose their mind when she gets picked up in the Model 3. It’s almost like owning a supercar without the price tag or the inconvenience.
So I guess different people have different experiences. But this is the first car I’ve ever wanted to drive until it dies.
Oh, and FSD certainly IS NOT worth it. And I doubt it will be anytime soon. :)
Re:Andrej Karpathy leaves Tesla
by carbadtraingood on Wednesday July 13, 2022 @11:25PM
(#32091634)
Yeah, I have an older model S. It could be my model just doesn't get the care that newer ones do, and my experience reflects an "early mover" experience. But I've had to replace door handles, sensors, memory, windshield, and a bunch of other stuff due to defects. The car stutters on the road at 50-55 mph, but is fine above that.
It was awesome in 2015. It's a pain in the ass in 2022.
Re:Andrej Karpathy leaves Tesla
by Denzel on Friday July 15, 2022 @10:06PM
(#32114666)
True, 2015 Teslas are much different (read: worse in some ways) than 2018 Teslas. That’s why I waited for them to improve the technology haha. Been following them since the Roadster’s R&D. I remember having to convince everybody back then that electric cars were going to be viable soon - no one believed Tesla could do it back then. Crazy how things have gone since.
Re:Andrej Karpathy leaves Tesla
by nunez on Thursday July 14, 2022 @01:08AM
(#32092237)
counterpoint: long drives have been improved significantly by Navigate on Autopilot, and the FSD Beta is nice.
example: I live in Houston and needed to go to Dallas for a work trip.
If my wife weren't using our Tesla that week (she drove it to Tennessee), I would have driven there (200-ish miles). I've done 1000+ mile trips with the Model 3 with zero issues, all because of "FSD."
Despite having another car that I really love, driving long distances manually is rough on me. So instead, I took an Uber Black both ways, flew, and rented a car in Dallas. (I expensed the UberX rate, so I paid the rest out of pocket. We are an hour from the airport.)
Re:Andrej Karpathy leaves Tesla
by Denzel on Friday July 15, 2022 @10:10PM
(#32114683)
I don’t disagree. What I mean to say is that FSD is not worth $12k or whatever insane price it is today and there’s no sign that it’ll ever be worth it in the near-term 2 years. And when I say FSD I mean the literal FSD that’s supposed to navigate everything (city, highway, weather, etc) from one address to another address cross country with zero interventions.
With that said, yes I agree, highway driving with Autopilot is worth somewhere on the order of $1-2k to me personally. It’s made long highway drives a lot more pleasant — just used it this past July 4th for 500+ miles of highway driving.
Re:Andrej Karpathy leaves Tesla
by dekhn on Wednesday July 13, 2022 @07:12PM
(#32089896)
I was prepared to buy a Tesla, and even planned on doing the full acceptance process (https://github.com/polymorphic/tesla-model-y-checklist) at the factory (a short drive from my house) but after Musk announced the Model Y was losing the radar and reading a bit more about their problems with FSD Beta (which I was planning to spend $10K to get), I concluded their cars were not the best in the world. I went and got a toyota which could pretty much have the engine compartment welded shut for ten years (modulo oil changes) and run perfectly.
It's a real shame because in principle having a manufacturing facility making great electric cars in the bay area would be a real win. Musk's reality distortion field is cracking.
Re:Andrej Karpathy leaves Tesla
by sn41 on Wednesday July 13, 2022 @09:24PM
(#32090886)
IMHO, the best cars in the world are still Toyotas - not the bleeding edge, mind you, just more reliability, overall "gets out of the way and does the job" in the most effective manner possible.
Re:Andrej Karpathy leaves Tesla
by kylehotchkiss on Wednesday July 13, 2022 @10:54PM
(#32091465)
With the supply chains this wild, and increased costs everywhere else, I’m also happy to be a Toyota owner. A healthy aftermarket for parts too just in case. And we get CarPlay!
Re:Andrej Karpathy leaves Tesla
by pwagland on Wednesday July 13, 2022 @06:48PM
(#32089701)
It is a stretch, but they are clearly also not the worst. The company clearly has value without FSD. Not the value that the market currently gives it, but value nonetheless.
Re:Andrej Karpathy leaves Tesla
by hinkley on Wednesday July 13, 2022 @11:04PM
(#32091521)
In theory if Tesla just figures out how to make batteries at scale they could be quite successful even if their sales numbers plateau. But in practice it doesn't seem like auto part wholesalers have a whole hell of a lot of power to set prices. Some of the better known brands are subsidiaries, and a few seem to have started as such.
Re:Andrej Karpathy leaves Tesla
by cmelbye on Wednesday July 13, 2022 @09:10PM
(#32090788)
I think his point is that FSD is an inevitability and when it comes it will generally upend the way we think about cars. Manual driving may always be a thing but it would become more of a passion than a way to get to work in the morning. The vast majority of value would come from autonomous transportation and logistics.
Re:Andrej Karpathy leaves Tesla
by bhauer on Wednesday July 13, 2022 @06:45PM
(#32089681)
It was exaggeration as a figure of speech to suggest that if self-driving is solved, it will make the EV business look incredibly small.
What's shocking is how many people interpreted it literally--that the value is literally zero without self-driving--as if the successful EV business is in fact unsuccessful.
Re:Andrej Karpathy leaves Tesla
by kaba0 on Thursday July 14, 2022 @03:48AM
(#32093203)
How are they the best cars in the world? I saw you add IMHO, but unless you mean it like children saying t-rex being the best dino, it really doesn’t bode well with reality.
Like, at least give one metric on which they are measurably “the best”.
Re:Andrej Karpathy leaves Tesla
by carbadtraingood on Wednesday July 13, 2022 @06:45PM
(#32089682)
The cars are real but they are... Mediocre. The first year of ownership is an amazing honeymoon period, assuming you got one with decent build quality. But the parts are cheap, and they break quickly. I've had one for 5+ years and it's gradually become something I prefer driving less and less.
Re:Andrej Karpathy leaves Tesla
by Shebanator on Wednesday July 13, 2022 @07:24PM
(#32089991)
Your personal experience is not something that can be so easily generalized. I've had my Model 3 for 4+ years, and the only real problems I've had are non-mechanical (nails embedded in tires, getting keyed in SF, etc.). See - we cancel out....
Re:Andrej Karpathy leaves Tesla
by YZF on Wednesday July 13, 2022 @08:31PM
(#32090482)
3.5 years here with a model 3. Zero problems. Still love it. What other EV would you pick and what would you use instead of the supercharger network? I don't want to own any more gasoline cars...
Re:Andrej Karpathy leaves Tesla
by carbadtraingood on Wednesday July 13, 2022 @11:20PM
(#32091603)
Currently have a reservation in for a Ford Lightning (but we use a truck for our forest). We have a plug in hybrid that has a 20 mile range on battery that basically never runs on gas as well.
I've heard good things about the Kia Niro, VW ID.4, and Hyundai Kona as well.
Re:Andrej Karpathy leaves Tesla
by armchairhacker on Wednesday July 13, 2022 @07:44PM
(#32090145)
they’re electric cars. And i’m pretty sure they’re the biggest electric car brand with the most chargers, which they lease to other automakers at a profit.
My family has a Tesla and they seem to be very happy with it. I’ve driven in it and it seems really nice, maybe not exceptional but not bad.
I do have to say though, the Lidar and self-driving is glitchy and kind of gimmicky. But the fact they’re electric makes them worth it regardless.
Re:Andrej Karpathy leaves Tesla
by 01100011 on Wednesday July 13, 2022 @06:21PM
(#32089460)
For how long though? It seems like traditional automakers have mostly figured out EVs now. I love my Chevy EV, and it's 4 years old now. Similarly, the Kia EV I recently drove was excellent(although the Bolt one pedal driving is better IMHO).
Re:Andrej Karpathy leaves Tesla
by atombender on Wednesday July 13, 2022 @06:54PM
(#32089759)
The situation outside the US is even worse for Tesla. There's a whole swathe of great EVs these days from VW (ID.3, ID.4), Renault (Megane, E-2008), Opel (Corsa-e), Volvo (C40, XC40), Ford (Mustang Mach-E), Jaguar (I-PACE), Polestar, BMW (i4, iX), Audi (e-Tron), Mercedes (EQS), Skoda (Enyaq), etc.
The range of models is also much wider in terms of affordability. In Europe, we've reached the point where an EV is just another car, and even the cheaper ones have tons of clever bells and whistles like 360 cameras.
Re:Andrej Karpathy leaves Tesla
by rsynnott on Wednesday July 13, 2022 @08:20PM
(#32090416)
Eh? Tesla is third behind VW Group and Stellantis in the EU (fourth if you count Renault-Nissan, but that's a marginal case), and third behind BYD and SAIC in China.
Now, it's true that they're the biggest single BEV _brand_ in Europe (and second-biggest in China), but that's... basically just a different marketing approach. VW Group has multiple constituent brands mostly selling largely the same thing (SEAT/SKODA/Scania/Cupra/VW/Audi); it's no skin off their nose if someone buys a VW id3 or a Cupra Born (these are the same thing).
Re:Andrej Karpathy leaves Tesla
by atombender on Wednesday July 13, 2022 @08:04PM
(#32090310)
They sell better than any single car brand, sure, but much less as a fraction of the market. Their market share in Europe has been around 25% (compared to around 70% in the US). And it's falling. In March 2022, Tesla's market share was just 10.5%.
Re:Andrej Karpathy leaves Tesla
by practice9 on Thursday July 14, 2022 @03:54AM
(#32093247)
There is a large demand for EVs for multiple reasons (incl. the current energy crisis) and Tesla is not scaling fast enough. It's great that others also started producing EVs (consumer choice, price etc.).
But in absolute numbers it will not be easy to catch up, as batteries are a limiting factor.
Energy efficiency in modern EV brands also isn't very good, which requires putting more battery (and weight) into the car. (perhaps excluding Hyundai Ioniq-s)
Combined with fast scaling of the car production + high price of lithium batteries, this will limit how many cars can be produced or increase the car price for the consumer.
This may change if manufacturers will start improving efficiency or building battery factories for themselves. Which I think only VW is currently planning to do
Re:Andrej Karpathy leaves Tesla
by jeffbee on Wednesday July 13, 2022 @06:37PM
(#32089598)
If I have to pick a side in the battle of who can produce the most cheap batteries, an insane Twitter addict or state-controlled industries of South Korea, I'm going with the Koreans.
Re:Andrej Karpathy leaves Tesla
by mathverse on Thursday July 14, 2022 @09:51AM
(#32096090)
He mixed that up with Chinese corporations. Korean chaebols are more like "state endorsed monopolies". Or state "you can get away with almost anything corporations because you make a large chunk of our GDP and employ a lot of people".
Re:Andrej Karpathy leaves Tesla
by jeffbee on Thursday July 14, 2022 @11:26AM
(#32097239)
I'm not mixed up but I guess I should have said state-controlling instead of state-controlled. The chaebols are running the place, that's why they won the DRAM wars. Batteries, same thing. And I was referring to LG Chem, not Hyundai.
Re:Andrej Karpathy leaves Tesla
by TheAlchemist on Wednesday July 13, 2022 @06:21PM
(#32089463)
That's probably true !
But in itself, just making on of the best electric cars today would justify a valuation of 1/10 of what Tesla currently have.
I still admire Musk and Tesla for having started the electric revolution. But by 2025 (and maybe already are), they will just be one of many electric car manufacturers - somewhere in the middle of the pack.
Re:Andrej Karpathy leaves Tesla
by filoleg on Wednesday July 13, 2022 @10:44PM
(#32091407)
Correct, yeah. Tesla was founded in mid 2003, Elon became the largest shareholder in early 2004, became the CEO in 2008, and then the company IPOd in mid 2010.[0]
The comment you were replying to definitely seemed quite a bit incoherent with their personal take on what hostile takeovers actually mean.
Re:Andrej Karpathy leaves Tesla
by lazyjones on Wednesday July 13, 2022 @07:32PM
(#32090059)
> Does anybody seriously think Karpathy would step down if FSD was really close to be released ??
Life is not only about work. I stepped down from the company I funded after 14 years, it never stopped growing after that. Some people just get bored after doing one thing for a long time and want to explore other areas, especially if they always had broad interests.
> It really starts to feel like Tesla is a huge fraud which is about to be uncovered.
I seriously doubt that my Model S will somehow stop working so well and turn out to be just a fake car after 5 years.
Re:Andrej Karpathy leaves Tesla
by TheAlchemist on Wednesday July 13, 2022 @10:35PM
(#32091355)
You have a point.
But did Theranos customers were thinking they were a fraud ? Nope - they were getting their blood test results done, although not in a way Theranos advertised.
Of course the Tesla cars are not a fraud - they are actually pretty good - and for a long time they were the only EV out there. But it's no longer a case, and they are just becoming one of the 50 EV car makers out there.
And Elon seems to know it - that's why he's insisting that the entire company insane valuation is tied to FSD, or whatever other futuristic product he can imagine.
What I mean is that it's a fraud because it's an (maybe a bit above) average EV car making company, but it's CEO and the company itself insists it has extremely advance technology and products - which for now, doesn't exist. As a result, it's $ valuation is higher than most other car makers combined.
Re:Andrej Karpathy leaves Tesla
by atonse on Friday July 15, 2022 @07:15AM
(#32106952)
While I wouldn’t just naively say Musk is 100% innocent, most of these examples are cases of really bad estimation.
Nobody would care about the slipped FSD timelines if they hadn’t paid for it. Tesla’s mistake was charging for it.
I chose not to pay for it since I knew his estimates were rubbish. But most don’t. Doesn’t mean It’s fraud. They have been working on it. And you can see it in people’s cars.
Re:Andrej Karpathy leaves Tesla
by lazyjones on Monday July 18, 2022 @04:15AM
(#32135825)
> Nobody would care about the slipped FSD timelines if they hadn’t paid for it. Tesla’s mistake was charging for it.
I paid for it (€2500 or 3000 I don't remember) and I'm not stressed. I have the world's best "autopilot" (EAP) already in my 5 years old car and it's getting better and better.
Other vendors would have sold me a parking heater at that price (or higher).
Re:Andrej Karpathy leaves Tesla
by lazyjones on Thursday July 14, 2022 @04:34AM
(#32093519)
> and they are just becoming one of the 50 EV car makers out there.
The Model Y was recently the best-selling car regardless of technology (i.e. overall best-selling passenger car) in several countries. Most notably, last month in China.
Re:Andrej Karpathy leaves Tesla
by sidcool on Thursday July 14, 2022 @01:08AM
(#32092231)
Tesla has been over promising for sure. But it’s not a fraud. Had it been it would have met the same fate as Nikola. I am for heavy fines on Tesla for their lofty claims, but I don’t know why people want to see Tesla destroyed. They do have a profitable electric car business with no fraud.
Re:Andrej Karpathy leaves Tesla
by SergeAx on Thursday July 14, 2022 @05:25AM
(#32093803)
Karpathy would step down if his vesting schedule is over and he failed to negotiate another stock option. TSLA is public, it's value was inflated at least an order of magnitude last year, so any rational person would cache hugely on that.
Re:Andrej Karpathy leaves Tesla
by dham on Wednesday July 13, 2022 @07:53PM
(#32090214)
I've really gotten into self driving the past couple years. Watched every video I can find on it. Got a Toyota Rav 4 bought a Comma 2 then later a Comma 3. Really enjoy Comma AI as a product on the highway and some in town. That being said, self driving in city streets is a problem that literally doesn't exist. On highway you can relax, mostly because the car is keeping a straight line and not much is happening. As soon as a car is negotiating stop signs, doing turns, etc it stops being fun and relaxing and starts becoming anxiety inducing.
The only thing that needs to be solved fully is highway with auto lane change. That's literally it. And the system needs to do eye tracking like Comma Ai. If your adaptive cruise control makes you put your hand on the wheel it's useless.
Re:Andrej Karpathy leaves Tesla
by adverbly on Wednesday July 13, 2022 @09:13PM
(#32090800)
You're mostly right about long distance commuting/travel... but FSD in cities is needed for trucking/delivery/taxis to be fully automated. If you need to pay for a driver to drive then a lot of value is going to be left on the table still.
Re:Andrej Karpathy leaves Tesla
by dham on Thursday July 14, 2022 @08:31AM
(#32095162)
It's starting to look like we'll need general intelligence AI to solve self driving fully within cities. For trucking, let AI solve the long distance stuff, then have drivers drive the last few miles. I don't know if it would work but worth thinking about. That seems like a much closer thing than having AI negotiating an 18 wheeler through a city
Re:Andrej Karpathy leaves Tesla
by mkl on Wednesday July 13, 2022 @06:36PM
(#32089596)
That's pretty much a totally different category of employee, though:
"Tesla is laying off 229 data annotation employees who are part of the company’s larger Autopilot team [...] Most of the workers were in moderately low-skilled, low-wage jobs, such as Autopilot data labeling"
Data annotation can be cheaply outsourced or scaled up and down without much affecting progress on self-driving. Karpathy leaving says more about that progress to me.
Re:Andrej Karpathy leaves Tesla
by xeromal on Wednesday July 13, 2022 @06:45PM
(#32089676)
On top of that, this might signal that Tesla is confident enough in their autolabeling that they no longer need as much human intervention. This job title theoretically should be temporary.
Re:Andrej Karpathy leaves Tesla
by pm90 on Wednesday July 13, 2022 @08:30PM
(#32090480)
autopilot != FSD
I agree that autopilot by itself, currently is still pretty valuable. What I worry about (and seems to be confirmed) is that Musk misunderstands what’s possible with the current technology and will make outrageous demands from the team, they will fuck up trying to deliver, then the whole thing will become radioactive.
Re:Andrej Karpathy leaves Tesla
by visarga on Thursday July 14, 2022 @01:26AM
(#32092347)
> Data annotation can be cheaply outsourced or scaled up
Only if you don't care about quality. In my experience using annotation companies leads to a conflict of interest - annotate more to earn more, or annotate better.
Re:Andrej Karpathy leaves Tesla
by kentf on Wednesday July 13, 2022 @10:29PM
(#32091320)
I shared a desk with Andrej when he was interning at our lab for the summer at the University of Toronto. One of the smartest people I ever connected with about all CS topics. Hopefully he finds what he is looking for and takes a well earned break.
Re:Andrej Karpathy leaves Tesla
by spicymaki on Wednesday July 13, 2022 @06:08PM
(#32089351)
A couple of theories:
1) It sometimes can be hard to leave a company when you are "in the thick of it." A sabbatical can give you personal time to reflect on whether you want to stay or not.
2) Sometimes people use sabbaticals to prep/perform job interviews or plan career transitions.
3) Sabbaticals can allow you to quit early while waiting for vesting restricted stock units, employee stock plan sales, retirement contributions (matches), etc. There are certainly many more timed bonuses available for senior leaders.
Re:Andrej Karpathy leaves Tesla
by SilverBirch on Thursday July 14, 2022 @05:55AM
(#32093983)
It also buys them time to figure out if you really were critical and see who steps up to replace you. If at the end of the sabbatical you really were irreplaceable, they can fight a lot harder to keep you.
Re:Andrej Karpathy leaves Tesla
by TigeriusKirk on Wednesday July 13, 2022 @07:15PM
(#32089918)
At some companies sabbaticals are an explicit part of the benefits package. Every X years, you'll get a paid sabbatical of Y months. If you're close to X, why not wait and get the Y before you leave?
Re:Andrej Karpathy leaves Tesla
by fshbbdssbbgdd on Wednesday July 13, 2022 @09:03PM
(#32090730)
When a key person leaves, a lot of things can go haywire. If they take a break first, they can be semi-available to help resolve the most urgent issues. Kind of like turning off the circuit at the breaker to find out what is plugged into it.
Re:Andrej Karpathy leaves Tesla
by yalogin on Wednesday July 13, 2022 @08:18PM
(#32090395)
We haven’t seen Musk’s usual “full self driving is coming Xth of next month” tweet in a while now. I really hope it’s Andrej convince my him to stop, if so that is a great win in my book. After his leaving musk may feel the need to sell his company again to show everything is fine. I will not be surprised to see that tweet again in the next few months.
Re:Andrej Karpathy leaves Tesla
by make3 on Wednesday July 13, 2022 @09:45PM
(#32091018)
I don't think he ever claimed he could do it. Like, really. He's a scientific, I only think he said he would do his best. Which is a fine thing to say, and keeps all the respect of the field, because everyone knows it's fucking hard / next to impossible.
Re:Andrej Karpathy leaves Tesla
by hwers on Wednesday July 13, 2022 @07:55PM
(#32090242)
He mentions open source and education which I’m really excited about. There’s been a big lack of accessible from-first-principles resources on this (plenty of abstracted libraries though). Now is a great time to build up excitement among amateurs to learn about this stuff imo. (Right near the super cool text-to-image breakthroughs.) It shouldn’t just be openai and google building these things.
Re:Andrej Karpathy leaves Tesla
by Barrera on Wednesday July 13, 2022 @06:50PM
(#32089728)
The autopilot part of Tesla has never made much sense. Is Tesla the electric car company, or is it the luxury car company? Either way, why does the power train (EV or ICE) come into play at all?
Not only that, but Tesla has played the Innovator's Dilemma game from the position of the upstart financially, but targeted the segment of the market that incumbents will defend to the death (luxury cars).
Tesla could have gone a different way and played the game from the true upstart: targeting the low end of the car market. Attack from below. But it didn't do that.
Incumbents always win at the sustaining innovation game. The electric power train is a sustaining innovation for the automobile industry. It doesn't break any incumbent's business model (financing the purchase of expensive cars), especially at this point. And we're now seeing this with all of the EV introductions and announcements from incumbents. Oddly, though, there are plenty of upstarts trying to do exactly what Tesla tried - attacking the blubber-rich end of the market with an immature technology.
Re:Andrej Karpathy leaves Tesla
by coenhyde on Wednesday July 13, 2022 @07:17PM
(#32089931)
The incumbents will defend that market segment to their death indeed. Tesla is pulling a 30% gross margin on their EV's, while legacy auto looses money on their EV's. I don't see legacy auto being capable of refactoring their cars, manufacturing processes and business models fast enough to survive.
The fall can cascade quickly, as the incumbents are stuffed with debt. When sales of ICE fall due to the growing EV segment they will have a hard time seeking the funding necessary to transition. IMO it's all a bit late. But good luck to them. From my observation only Ford and VW really appreciate the situation they are in, and they are trying hard to navigate out. Hopefully they survive. GM is screwed.
Re:Andrej Karpathy leaves Tesla
by giantrobot on Wednesday July 13, 2022 @09:47PM
(#32091038)
> I don't see legacy auto being capable of refactoring their cars, manufacturing processes and business models fast enough to survive.
That doesn't make any sense. "Legacy auto" knows how to make cars. To their final assembly factories there's not a huge difference between a BEV, PHEV, or an ICE drive train. So long as they feed in components they get cars out. They definitely know how to get components made to feed into their factories.
That's a place where they have an advantage over Tesla. They can make BEVs that break even or lose money because they have a whole line of ICE cars making a profit. Tesla only has their up market BEVs to make their money.
Tesla doesn't have a moat around BEVs. Now that "legacy auto" is making them Tesla is just another BEV manufacturer. As their market share erodes they're going to have a harder time maintaining their price premiums. They also don't have the deep bench of fleet sales that "legacy auto" has. The places they're trying to diversify (Power Wall, solar, etc) aren't markets that support the premium prices they currently enjoy with their cars.
Re:Andrej Karpathy leaves Tesla
by coenhyde on Wednesday July 13, 2022 @11:59PM
(#32091849)
> That doesn't make any sense. "Legacy auto" knows how to make cars. To their final assembly factories there's not a huge difference between a BEV, PHEV, or an ICE drive train. So long as they feed in components they get cars out. They definitely know how to get components made to feed into their factories.
That's the problem. When they do it that way, they don't make a profit on BEV's. "Legacy auto" got good at building the supply chain network for parts. Then they pick and choose and assemble into a car. But everyone is taking a slice, and it's hard to optimize designs for efficiency between so many suppliers. Then they have their dealers to contend with.
What i'm saying is that "legacy auto" can certainly build and sell a BEV like they do with ICE. And it's not too hard for them to make that change, baring battery supply challenges. But they don't have the 30% gross margin that Tesla does. That margin will continue to grow and then turn into a weapon when Tesla needs to be competitive.
Re:Andrej Karpathy leaves Tesla
by giantrobot on Thursday July 14, 2022 @03:16AM
(#32092973)
> That margin will continue to grow and then turn into a weapon when Tesla needs to be competitive.
This does not follow at all. Tesla sells their barely up market cars at luxury car prices and makes a significant amount of money off selling emission credits and raking in other government subsidies.
As "legacy auto" manufacturers ramp up their EV production they won't need to buy emission credits from Tesla. They'll also themselves be eligible for the bottom line boosting government subsidies.
I also don't see Tesla being able to compete on luxury as they have significant problems with fit and finish. Now that traditional luxury brands have solid EV offerings it seems unlikely Tesla will be able to keep their margins and increase their sales volume.
Re:Andrej Karpathy leaves Tesla
by coenhyde on Thursday July 14, 2022 @06:29AM
(#32094158)
> This does not follow at all. Tesla sells their barely up market cars at luxury car prices and makes a significant amount of money off selling emission credits and raking in other government subsidies.
Emission credits were 3.6%[1] of revenue last quarter (Q1 2022). I don't know what "subsidies" you are referring too but you may be thinking of the EV tax credit, which was exhausted by Tesla in late 2019[2]. So in that regard other EV automakers have an advantage over Tesla.
> I also don't see Tesla being able to compete on luxury as they have significant problems with fit and finish. Now that traditional luxury brands have solid EV offerings it seems unlikely Tesla will be able to keep their margins and increase their sales volume.
Tesla has certainly had fit and finish issues but they are solving this. Their new Model Y produced in TX uses their "giga castings" which removes the opportunity to screw up alignment by removing ~150 welds for the body. Look it up if you want to know more.
I think error in your thinking is that Tesla will remain static while others catchup. That's not going to happen. Tesla is innovating (increasing margin) and scaling at a faster rate than "legacy auto".
Re:Andrej Karpathy leaves Tesla
by sangnoir on Thursday July 14, 2022 @01:20AM
(#32092322)
> But they don't have the 30% gross margin that Tesla does.
Sure, but they'll make it up on volume. Tesla also will have much lower than 30% gross margins in 10 years -but can it catch up with "legacy auto" on volume?
Re:Andrej Karpathy leaves Tesla
by dahdum on Wednesday July 13, 2022 @08:07PM
(#32090324)
> I don't see legacy auto being capable of refactoring their cars, manufacturing processes and business models fast enough to survive.
My take is the opposite. Incumbents already have like 90% of what Tesla had or chose to build from scratch. EV's are not complicated at all compared to ICE, and incumbents have been refining their manufacturing process for decades in a brutally competitive industry.
Unless Tesla can somehow get an effective monopoly on battery tech or FSD, which they are not, they're going to be just another car company. Nothing they can deliver can't be done by others.
Personally I think it's way more likely Waymo or Apple deliver FSD first, with broad industry partnerships wiping out Tesla's advantage.
Re:Andrej Karpathy leaves Tesla
by coenhyde on Wednesday July 13, 2022 @09:19PM
(#32090838)
I agree that the EV tech stack is easy. EV retro fits illustrate how simple EV's are. But that's not the part that matters. What matters is if you can make an outsized profit building and selling EV's. Legacy auto can't, Tesla can. Tesla is very vertically integrated so they can eek out extra margin that others can't. They also aren't inhibited by the existing dealer / service / financing model. So what I'm saying is if legacy auto wants to compete with Tesla, they have to refactor their entire business. And i don't see that happening. It will be interesting to see who is right in 5-10 years.
Re:Andrej Karpathy leaves Tesla
by steveBK123 on Wednesday July 13, 2022 @11:08PM
(#32091536)
I was with you in my 4 years of Tesla ownership but having researched & sampled the competition I just can't agree anymore.
Tesla has gone down a cul-de-sac with FSD to the point that there's plenty of equally competent highway "self driving", which is all 99% of people actually need/want.
Further Tesla is extremely focussed on SKU minimization .. very few models with very few options. Tesla only has 4 cars which are kind of like 3.5 given how similar 3/Y are. People want a variety of sizes/shapes/luxury levels, and to have some options within a model.
At the Model 3&Y end of price curve, they face serious competition from Ford, Hyundai, Kia and VW.
At the S&X end, they are actually in worse shape because the Germans will sell you a wide range of cars, which actually feel luxurious inside for the ~$100K price you are paying... with lots of fun colors and options packages. The interior of a $50K Model 3 and $130K Model S are more similar than dissimilar.
You can get also get worse EVs for cheaper than the lowest Tesla starting price... not every car can start at $50K.
I mean it's kind of crazy the Tesla Model Y has crept up to $68k starting price. There are a lot of crossover/hatchback EVs in the $40-60k range especially with tax credits included...
Re:Andrej Karpathy leaves Tesla
by coenhyde on Wednesday July 13, 2022 @11:44PM
(#32091760)
Tesla is focused on unit production, SKU minimization is a side effect. They are supply contained. Why make additional models of cars if you can sell more of the ones you already make instead? There's more than enough demand to support their limited SKU's, high price points and current production; for the moment. When Tesla manages to cap out on their demand, they can lower prices and introduce more models. But when that happens they will be at a scale where their economies of scale and vertical integration allows them to still make a large profit while their competition breaks even or worse.
Re:Andrej Karpathy leaves Tesla
by steveBK123 on Thursday July 14, 2022 @08:33AM
(#32095184)
Maybe? But cars are like fashion. Demand can change more rapidly than Tesla can design, announce, and scale production of new models to fill all the gaps in their model line.
Once competitors can ship in higher volumes at the Model 3/Y price points then they can readjust pricing quickly of course.
Look at the Model S right now, if you want a Plaid you can essentially have it RIGHT NOW, there's even a few inventory cars popping up periodically. For the Model 3/Y, if you go with performance model, again you can have it in weeks like in normal times. To me this looks like demand at the high end is cooling off for Tesla.
Re:Andrej Karpathy leaves Tesla
by hedora on Wednesday July 13, 2022 @07:16PM
(#32089924)
Analysts suggest that, while they may still be the market leader in EVs, by 2025 they're looking at a decline from today's 70-75% market share to 11-20%:
This meshes pretty well with them not having anything in the compact, pickup truck, offroading/camping segments (luxury, or not). They also don't have any commercial vehicles like delivery vans.
All of those segments are being filled in rapidly by competitors. Also, the first real non-Tesla luxury sedans have been on the market for what, under a year?
Re:Andrej Karpathy leaves Tesla
by giantrobot on Wednesday July 13, 2022 @10:03PM
(#32091139)
Fleet sales is a place I see demand seriously ticking up for BEVs. Even modulo today's price gouging on gas, gas prices are only going to increase over time and many countries/states are increasing emission regulations.
In California at least there's a significant percentage of fleet vehicles that are HEVs or low emission ICEs like CNG. Fleet edition BEVs will sell like gangbusters here (if they're not already).
I don't see Tesla really able to target the fleet vehicle market. They're currently geared entirely for consumer sales and then only up market consumer sales. Fleet sales aren't flashy or exciting but they're reliable income generators for car companies.
Re:Andrej Karpathy leaves Tesla
by mikkelam on Thursday July 14, 2022 @04:09AM
(#32093344)
I feel like, most commenters are speculating too much around Tesla and their lack of FSD capabilities being the issue. Perhaps Karpathy just felt that the work was too draining and decided to he needed a break. I believe Karpathy has recently been on a lengthy sabbatical.
My point is, people leave their jobs for many reasons other than how well the company is doing. At least I hope so.
Re:Andrej Karpathy leaves Tesla
by bhauer on Wednesday July 13, 2022 @07:15PM
(#32089912)
He was the director of AI at the company, an important position. Notably, however, the AI director position is distinct from the director of the Autopilot team. That position is held by Ashok Elluswamy.
Re:Andrej Karpathy leaves Tesla
by snek_case on Wednesday July 13, 2022 @07:38PM
(#32090104)
Oh. Well that puts a different spin on things then. Karpathy said he wanted to sharpen his technical skills. He might have left in part because he felt he was too far from the action, since he was at least 2, if not 3 levels removed from the actual research and implementation work.
Re:Andrej Karpathy leaves Tesla
by selfportrait on Thursday July 14, 2022 @12:56PM
(#32098553)
Let’s admit the real innovation here. It’s not FSD. It’s the underground tunnels with traffic. Underground traffic for all to be autopiloted through with their Teslas so that we can all meet at the digital town square on our phones.
Re:Andrej Karpathy leaves Tesla
by bsaul on Wednesday July 13, 2022 @06:17PM
(#32089430)
i wonder if tesla can afford to abandon autopilot. the strategy of always selling a futuristic vision of driving has always been core to the brand. if they happen to become just another boring electric car company, i'm not sure they can compete in the long run.
Re:Andrej Karpathy leaves Tesla
by bowmessage on Wednesday July 13, 2022 @06:43PM
(#32089658)
They can pivot to selling an auto-autopilot; an AI-based process run totally within the car, which will autonomously work on the code for autopilot for the next 5 years. (/s).
Re:Andrej Karpathy leaves Tesla
by rafaelero on Wednesday July 13, 2022 @06:32PM
(#32089561)
It's fun to see everybody succumbing to scaling laws. We will only have FSD when we can run realtime inference with a huge model. No amount of creativity seems to overcome the fact that bigger is better. So, let's wait Moore's law do its job.
Re:Andrej Karpathy leaves Tesla
by rafaelero on Wednesday July 13, 2022 @08:02PM
(#32090296)
I am not aware of any autoregressive transformer model that doesn't follow scaling laws. Tesla only needs to tokenize actions and images and voi la, self-driving capabilities. The problem, of course, is how you deploy such a big model so every car can run it locally.
Re:Andrej Karpathy leaves Tesla
by ShamelessC on Wednesday July 13, 2022 @08:41PM
(#32090565)
Scaling parameter count requires a similar increase in the amount of (accurate, labeled) data. This can be mitigated by “bootstrapping” techniques that make labeling new data easier, but is still likely the bottleneck for training such a model effectively (assuming they can probably spin up a supercomputer to scale their models otherwise).
Re:Andrej Karpathy leaves Tesla
by ShamelessC on Wednesday July 13, 2022 @10:02PM
(#32091137)
I don’t think I would do very well under Elon’s management style ha - the whole butts-in- seats from 8-6 thing is basically a dead end for me (personally).
I’m not sure what architecture they use, but they do indeed already have a pre trained “auto-labeler” that their annotators use. My understanding is that due to hallucinations from the model and the risks involved with driving, they still need to be vetted manually before being added to the dataset.
Re:Andrej Karpathy leaves Tesla
by rafaelero on Wednesday July 13, 2022 @10:39PM
(#32091385)
Makes sense. Fortunately, scale is less of a problem for the autolabeler, so they can put a lot of processing power on this step. But yeah, they will need human labelers for the edge cases where the model is unsure. I wish Tesla would publish their results so we could understand what they are doing and how much it is improving.
Re:Andrej Karpathy leaves Tesla
by visarga on Thursday July 14, 2022 @02:09AM
(#32092601)
I wouldn't have dared to step into his role even if I had the chops. Takes real courage to do self driving where a mistake can cost human life. In my line of work a prediction mistake costs 1 minute of extra manual work.
Re:Andrej Karpathy leaves Tesla
by naveen99 on Wednesday July 13, 2022 @07:03PM
(#32089827)
hmm, I think the real time aspects of self driving are hard. There is lots of promise with masked language and image modeling, but plenty of work to be done, even for non real time applications.
Re:Andrej Karpathy leaves Tesla
by Infinitesimus on Wednesday July 13, 2022 @07:43PM
(#32090140)
What's your definition? They certainly do a lot of driving related things pretty well and others quite poorly (much like humans but we have different failure modes).
If you life in San Francisco, CA, you'll often see Cruise cars roaming the streets at night collecting data with no physical driver present.
Re:Andrej Karpathy leaves Tesla
by trixie_ on Wednesday July 13, 2022 @08:09PM
(#32090339)
Really? Because autopilot works pretty well for me already. I have it on way more than I have it off. Long roads with lots of stop lights, and 6 hour drives no longer bother me.
Re:Andrej Karpathy leaves Tesla
by rvz on Wednesday July 13, 2022 @05:50PM
(#32089196)
Oh dear. So who is going to improve on making and shilling the 'Fools Self Driving' (FSD) beta demoware that not only it is 'allegedly' half-working, but is already under ridiculous amounts of scrutiny and investigation by the regulators, especially with deceptive advertising putting drivers on the road at risk?
Once again, where are the robot-taxis as promised for release in 2020?
This announcement comes after a 4 month sabbatical where Karpathy said he wanted to take some time off to “sharpen my technical edge,” which makes it sound like this is the result of frustration with the technical approach instead of burnout.
The fundamental flaws are in the decision-making being based upon 10-30 second feature memory, ignoring features outright, and only depending on visible road features instead of persisted map data.
For instance, near my house there's an intersection where it will try to use a turn-only lane with a red arrow when it's trying to go straight thru a light. 100% of the time. Even if I'm in the correct lane with no traffic around.
That's because the turn arrow on the ground is worn off. It is not a perception problem, it is
a) ignoring the obvious red turn arrow signal's significance for lane selection deliberately b) makes no attempt to persist or consult map data for 'which lanes go where' c) it completely disregards painted lines on the ground in the "no drive here" striping.
Also one block from my house, FSD will stay still indefinitely waiting for trash cans (displayed as trash cans) to clear the leftmost lane so that it will turn left.
None of the failures I encounter are due to lack of perception.
I think that's optimistic. Ten plus years.
There's too many exceptions. In my home town, an intersection. Imagine, if you will:
Traveling westbound there's four straight ahead lanes. There's a traffic light for each straight lane. The traffic lights will alternate "left two straight, green; right two straight red" and then "left two straight, red; right two, green". It does this because there's a tunnel and a roundabout right there. I guarantee that FSD will choke on this.
We also have a road with a reversible lane in the middle. Thankfully it recognizes the red X sign for this. Unfortunately, if it's driving for 11 seconds without seeing anothee, it will suddenly decide to merge into the incoming lane to make an upcoming left...
I think in Japan or China this approach could actually work, but there is zero hope for it to work generally in the US.
Tesla has been collecting thousands of dollars, each, from car buyers and utterly failing to deliver what it represented, and keeping the money year after year. Would be let GM, Toyota, or Audi do this? Where is the criminal prosecution? Where are the refunds?
I bought it knowing it was in beta and with no timeline for production release. They haven't represented it as anything more than that.
Being along for the journey is a big part of why I decided to pay.
Is not
"literally said in a public conference keynote that robotaxis would be running in 2019"
Here is a longer video of that announcement: https://www.youtube.com/watch?v=0GnH_C6NrOM
I would not, personally, be so dissuaded.
I vividly remember a conversation I had with an acquaintance who had recently taken an engineering position with an AV company that occurred circa late 2018. He claimed that they were at most 1 year away. In fact, his exact words were something along the lines of "They're already here. It's just a few edge cases to work out and some regulatory hurdles to overcome."
The reality is that the first 80% of the problem had been solved quickly and significant progress had been made at the time on the next 10%. The end was in sight. Unfortunately, that next 10% ended up taking as long as the first 80% to solve, and the final 10% will likely take decades if it's even possible.
You aren’t beta testing complex automation system that’s operating on public roads. To do any meaningful testing you should have defined operation domain, specific behaviors to test, direct line to the engineering team to report issues, etc, etc.
I'm thinking of being an unwitting test crash dummy on public roads and sidewalks for "Full Self Driving". They just slap the binding legal agreements and waivers on their drivers, but it is tantamount to fraud. I'd rather this didn't exist on public roads in such numbers, and that people don't have to pay to be free Tesla drivers, beta testers, and data points instead of being considered people.
It's not acceptable to have it fail for limited number of users. As my kid who may get killed by the failure didn't sign up for it.
How would you feel if this was a standard for aircrafts? "Let's just push this change to a small portion of the fleet, and boy, if that plane crashes, it's soooo much better if all our planes would crash. High five, where's my bonus?!".
still a very hard problem.
but what it requires is a consistent world model. and if it detects that the current stretch of road is incomprehensible for its model it should safely disengage.
of course Tesla opted for the cowboy version of this, and turned the confidence of the model up .. without having a good model :|
3 years was my minimum, assuming they scrap their current model and begin working on one with real geo-spatial awareness now.
They have the data for it already.
To over-essentialize the problem with their approach, you simply cannot safely drive in Atlanta as a person who has never seen the streets. Humans are no exception. You have to know how each road works, and remember that for next time.
Elon has been over-promising(i.e. flat out lying) about self-driving every year since.. 2014(there's a youtube video compilation of it)?
It seems like his strategy is to just come up with increasingly grandiose promises every year when he fails to deliver on his past promises. He's trapped in his swirling vortex of bullshit. Very worrying to see Karpathy leaving...
Steve Jobs was also known for his “reality distortion field”, so maybe it comes with the territory.
That said, FSD progress seems asymptotic and the Optimus thing always seemed like bullshit.
The only ones I met who thought so was managers and software developers and ML-people, i.e. people who has never in their life seen the level of effort it actually takes to get something qualified for RTCA or other safety standards.
And you were right, but most people aren't like you, and people like you don't drive the discussion on what trends are coming. The world needs more folks with your background. Generally no one wants to listen to folks like you because you come off as a Debbie Downer despite being correct most of the time.
I think Mercedes has a reasonably sensible game-plan as far as I know. They currently have Level-3 on some highways in Germany which is still freaking hard to achieve, but still a narrow enough scope that you might be able to pull it off.
Time will tell, my bet is its still 10+ years off.
The guy was critized for being old school and not having adapted to the latest tech (including by elon musk when he dumped mobileeye), but in fact he was just plain right.
i think the tech community owes him an apology.
But his fundamental opposition to ML for things related to safety was, IMHO absolutely correct.
Let's face it Neuralink isn't going anywhere too.
Tesla wasn't started by Musk and relies heavily on Panasonic battery developments and SpaceX and Starlink is good old fashioned ex-NASA and MIT talent.
What does Musk actually do? Annoy the SEC, go on Joe Rogan to smoke weed and have more girlfriends per hour than Gengis Khan?
Seriously? Either you're trolling or you have some irrational hatred of the guy.
Lets remember the only reason he's around today is because some very rich people and NASA bailed him out. SpaceX left to just Musk's ability, ego and resources died in 2008.
He relies so much on mysticism for parting people from their money, eventually some people get fed up with the 'mysterious future and repeated failure' business model.
Expectations around his personal abilities should be lowered. His track record is not that great and it's a fact people call trolling. Sorry, not sorry.
The abilities that made spacex and tesla were hundreds of highly skilled engineers. Elon just raised money and is the face brand for japanese battery tech.
He's not worth worshipping and his incompetence is covered by idolatry.
“Just raised money” is patently false. He’s known for being extremely hands on with both Tesla and SpaceX.
I maintain you’re either trolling or ignorant.
1) the beams are not full, so many users are getting unrealistic service since they're not doing traffic shaping in those areas yet.
2) the areas that are full are seeing significantly worse speeds and latencies. see Reddit.
3) Elon said <20 ms pings will be normal. they're averaging 30-40ms in full areas.
4) it's not financially viable without many more users, higher costs, and cheaper launches.
Elon in 2026: “by 2028 we’ll have FTL drives”
Elon in 2028: “time machine!”
Well, to be fair, he only has to hit _that_ goal - at which point he can go back in time at his leisure and fix all the others. And he could hit even the time machine goal as late as he wants, and it won't matter.
So I think the 'other civilization' thing only works if they're already approximately here with a running machine.
Wanna start a trading venture with me? :-)
To be fair he'd only have to hit the FTL goal and then FTL can be used as a time machine.
We might well have one - back to the stone age based on the potential to escalate ongoing conflicts...
They are just going about it better but not trying to selling it.
Any reason why everyone seems to be stuck on this problem?
"A Cruise autonomous vehicle ("Cruise AV") operating in driverless autonomous mode, was traveling eastbound on Geary Boulevard toward the intersection with Spruce Street. As it approached the intersection, the Cruise AV entered the left hand turn lane, turned the left turn signal on, and initiated a left turn on a green light onto Spruce Street. At the same time, a Toyota Prius traveling westbound in the rightmost bus and turn lane of Geary Boulevard approached the intersection in the right turn lane. The Toyota Prius was traveling approximately 40 mph in a 25 mph speed zone. The Cruise AV came to a stop before fully completing its turn onto Spruce Street due to the oncoming Toyota Prius, and the Toyota Prius entered the intersection traveling straight from the turn lane instead of turning. Shortly thereafter, the Toyota Prius made contact with the rear passenger side of the Cruise AV. The impact caused damage to the right rear door, panel, and wheel of the Cruise AV. Police and Emergency Medical Services were called to the scene, and a police report was filed. The Cruise AV was towed from the scene. Occupants of both vehicles received medical treatment for allegedly minor injuries."
Now, this shows the strengths and weaknesses of the system. The Cruise vehicle was making a left turn from Geary onto Spruce. Eastbound Geary at this point has a dedicated left turn lane cut out of a grass median, two through lanes, a right turn bus/taxi lane, and a bus stop lane. It detected cross traffic that shouldn't have been in that lane and was going too fast. So it stopped, and was hit.
It did not take evasive action, which might have worked. Or it might have made the situation worse. By not doing so, it did the legally correct thing. The other driver will be blamed for this. But it may not have done the thing most likely to avoid an accident. This is the real version of the trolley problem.
[1] https://www.dmv.ca.gov/portal/vehicle-industry-services/auto...
[2] https://earth.google.com/web/@37.78169591,-122.45337171
[3] https://patch.com/california/san-francisco/speed-limit-lower...
For all the woe and gloom in the news reporting, Google (and Cruise)'s rollouts have been more or less what I expected: no enormous accidents that were clearly caused by a computer, but instead, a small number of small accidents usually due to the human driver of another vehicle doing something wrong. That seems to lead towards greater acceptance of self-driving cars and confidence that they are roughly as good as an attentive newbie.
The next big situation, I think, will be some really large-scale pileup with massive damages and deaths, and a press cycle where the self-driving car gets blamed. But the self-driving car collected a forensic quality audit log, which of course will aid the police in determining which human caused the accident.
Humans tend not to do that, and, as a result, some fraction of the time they get T-boned.
AI should absolutely mimic the behavior of real (good) drivers.
Although that's not what you're describing here, another problem for AI could result from it knowing more than an average driver; for example, if a high-mounted LIDAR were able to see around corners and let the car decide it's "safe" to do a turn that no human would attempt for lack of visibility, that could cause problems.
(Also, it's surprising that an autonomous car doesn't detect that another car is following it too closely, and slows down appropriately in anticipation. How is this not taken into account.)
An autonomous vehicle has to protect its occupants at the expense of everything else (or, at the very least, appear to do so in a convincing manner), because otherwise no one will step inside.
(At the very least, if a machine is going to sacrifice me or my family to save a third party, I need to know what hierarchy it is following, and how it was decided and by whom.)
But what this incident seems to illustrate is that it's difficult for a self-driving car to share the road with human drivers, and behave like a human -- meaning, allowing human drivers anticipate what it will do.
I drive a motorcycle and a bike in Paris; the reason I'm still alive is because after so many years of this I can tell what all the other cars will do at all times, before they know it themselves.
But an autonomous vehicle that would behave so differently from a human driver as to be unpredictable, would be terrifying.
Even the simple automatic emergency braking features in my model 3 result in some dangerously unpredictable behaviour at times. I have them set as off and insensitive as possible and they still do some awful stuff from time to time. I was on a road trip in northern Ontario this week passing a service vehicle moving very slowly along the shoulder on the right. I was doing 105 km/hr in the right lane of a 3 lane road: 2 lanes in my direction and 1 opposing. The 2nd lane switches directions every 5-10 km to serve as a passing zone. Posted speed limit is 80 km/hr, but prevailing speeds on this road are 90-110 and you’d never be ticketed for anything under 110 in this region. There was a truck gaining on me coming up on the left, so I signalled left and partially moved over to give the service vehicle some room, but didn’t fully take the left lane to let the faster truck know I would let them through as they came past. Very common pattern on this type of road and circumstance. The AEB slammed on the brakes as I came level with the service vehicle despite the fact there was plenty of space to complete the pass. I wasn’t expecting my car to slow down let alone apply emergency braking force, so in my surprise I nearly collided with the service vehicle. I have no idea what the other drivers thought, but neither of them could have possibly been predicting or expecting me to slam on the brakes. I was really upset with the car since it took a highly dangerous action in an otherwise perfectly safe and common situation. And that was the automatic stuff that can’t be turned off; I don’t let autopilot drive ever because it is the worst type of driver: unpredictable. The choices it made in the extremely short time I tested it about lane placement, follow distance, defensive driving (and the complete lack thereof), and general behavioural clues provided to other drivers were genuinely terrifying.
It performed the only sane solution to the problem - stopping. You can't possibly predict what the most likely thing is to avoid an accident, because there is a multitude of factors beyond just 2 cars moving towards each other. Are there pedestrians present? Other parked cars? Storefronts with customers inside? How close to the sidewalk? Trees? Construction/Debris?
Once we get AI working better than 99.9% of humans on roads with speed limits of up to 30 mph - we can expand it to faster roads and introduce advanced behaviors. But for now, stopping in uncertainty is the best available option.
Not only there are other factors, but you also need to predict what the other human driver will do. As stated in a sibling comment this is a huge part of safe driving.
> Once we get AI working better than 99.9% of humans on roads
But what you stated above require AGI, so what's the plan to get there? It's even more blurry than commercial fusion at that point.
Just to be clear, this statement only applies to AVs, right?
To solve the self-driving problem we need "smart" A.I., which means we have to approach it with systematic engineering, and the solution will probably involve some combination of better sensors, introspectable neural nets, symbolic A.I., and logical A.I.
Things like traffic signals that actively communicate their status to nearby robot cars (more than just a red lamp that can be occluded by weather, other vehicles, or mud on the camera lens). Or lane markings that are more than just reflective paint, but can be sensed via RF. Rules around temporary construction that dictate the manner of signage and cone placement that the robot cars can understand. The cones might have little transponders in them, I don't know.
But without a massive leap forward in AI capability, our current road system—optimized for human drivers over the past century—is not going to work.
If we can't make the cars just as smart as an alert and capable driver, then maybe we need to meet halfway and make the roads a littler "dumber" (simpler) to accommodate the robots.
The problem you then face is that any of those could be forged / faked without some kind of way of securely validating the message in some way. You could cause absolute chaos by driving down the road broadcasting false messages. It's a little harder to hack and modify traffic light signals, for example. But we've also seen hackers screw up Tesla cars by sticking stuff on the back of their car to deliberate mislead it based on vision.
Even without self-driving cars, an "attacker" can go into a theater and yell "fire" and cause a stampede.
They can get a high-viz vest and clipboard, and stand in intersections directing cars to take detours they don't need and holding up traffic.
My point here is that society has a lot of trust baked in. We trust people don't just yell "fire" without reason. Just because it's FSD cars doesn't mean people will start broadcasting the equivalent of "fire" constantly. It's already easy to cause accidents.
The consequences of potential attacks on centrally-orchestrated traffic are a lot more severe. Hack the control node, and you can stop traffic nation-wide. Or cause mass accidents that overwhelm first responders. And they can be executed by anyone, anywhere in the world, for a cost within range of many medium-size corporations (let alone nation states).
I won't comment on the challenges of the approach Tesla et al. are currently taking, but I don't think central control is the panacea commenters in this thread are making it out to be (and I'm personally glad this isn't the route we're pursuing).
It’s like arguing that we can’t possibly build autonomous cars because then someone might turn it into an autonomous bomb.
Keep in mind that solving this is “worth” about 40,000 lives a year in the US - nearly $1 trillion in economic damages a year in life and property.
Bad things can always be done with good tools. As always, you provide layers of protection that make sense and in the end must rely on the underlying fabric of civilization to persevere.
I’ve personally tested creating a fake toad sign and my tesla reads it as a real sign just fine.
I wonder what happens to autopilot on a 70mph freeway when it encounters a 5mph limit sign…
It immediately reduced speed from 60mph to 25mph .. aggressively.
This falls into a pattern of Tesla autopilot/NoA where it just doesn't seem to have much memory or foresight.
For example the car is driving itself on the highway, it knows it's been on the highway, for 20 minutes. I am not even in the exit lane, it knows what lane I am in. How could it think I am suddenly on the local road below the highway based solely on the GPS pin movement in the span of a second, without having moved to the exit lane and gone down the exit ramp?
For an example of lack of foresight - the car will happily speed towards an obvious semi-distant slowdown right until it needs to aggressively break from 60mph down to 30mph as it approaches following distance of the nearest car. I also find it can get really weird in stop&go traffic, not easing into speed, down to a stop very well as if it has only GO or STOP.
Oh wow. This happens often with a car-mounted GPS (or on a phone) and it's pretty annoying. Sometimes the GPS instructs you to do a U-turn at the next available fork in the road, and it takes a moment to understand what's going on.
But in a self-driving car it's terrifying! And absurd.
Any reason routine crypto methods would not solve this? Seems like one of the easier parts to me.
The real concern would be whether someone can engineer a terrorist level mass scale attack but as long as it requires physical tampering that adds up to a tremendous amount of work. So if the signalling is largely burned into fixed infastructure it eliminates a lot of that or at least sets the bar high enough that its probably more work than various other types of attack that are likely to be just as impactful.
Sounds like a job for...blockchain.
Yep, I talk to people working in traffic engineering, and their mindset is always building new road tech and road-side and cloud infra to support autonomous driving. They have no expectation of fully autonomous vehicle without road and infrastructure assistance.
And from historical perspective, the coming of automotive and the replacement of horse and other animal carts, are exactly facilitated by the road transformation; which has been the single largest scale infrastructure in human history.
It makes no sense that an even bigger transformation of the vehicle would require less drastic road transformation.
The very marginal benefits of laying road vs track more or less disappear when automation in play.
Is is really worth maintaining the ability to go off road/track when you’re not even driving anymore?
This idea is not new and it mostly applies to freight convoys but I think it also has merit for ad hoc passenger car convoys on long highway trips.
I think the idea is to get rid of the roads and have the robo vehicles travel instead on tracks. That increases fuel efficiency and bypasses a lot of AI challenges.
It’s the low-key case that Elon will be remembered poorly (like Robert Moses’ rapidly degrading legacy) for
1) Having the wrong vision for EVs (but successfully executing non it anyway)
2) Making space travel cheap (thereby increasing the amount of carbon energy dedicated to it) without really improving an average human’s quality of life
[0]: https://news.ycombinator.com/item?id=31968482
Fortunately thats not a lot of people.
When electricity was being rolled out, Westinghouse and Edison didn’t bellyache about not being able to provide electricity to rural areas. They electrified all the cities.
Rural areas will just never be able to pay for modern infrastructure. And… thats ok, its not a lot of people.
This is a thing in Europe, and even some US cities - my Audi has traffic sign recognition and when at a compatible intersection knows what the light is at (by radio, not by light), and how long until it changes (will show a countdown in seconds til the next light change).
Are our roads really? Most in cities over a certain age are just haphazard relics of times gone by, and don't get me started on "stroads" which are good for nobody
This aspect of FSD has always fascinated me and I'm a little surprised it doesn't get more discussion. Meeting halfway. At what point could/would/should FSD influence the environment around it?
For example - a poorly painted road sign*. Tesla/Waymo could say "We cannot support L5 FSD on this road until you fix this sign." If it meant a step forward in autonomy, Tesla/Waymo could even offer to share the cost of that improvement!
There are a million reasons why implementation of that would be problematic. Costs and incentives would be all over the place. But I am more interested in the framing: The machines are the ones that need to adapt. Which is essentially hoping for continued hardware improvements or a spaghetti mess of if/else statements. ie "do this weird thing if you see this other weird thing in front of you". Can we get rid of the weird thing and avoid the engineering challenge altogether?
* Yes, this is an overly simple example. Some environment changes could be so large that they would require a full redesign of a city/buildings/traffic patterns. But surely there are classes of improvements where some are easier than others.
what's missing is combining this kind of "human concept relations" model (language, rules, minimal reasoning, text encoded human preferences) with perception, and safety (which means that the model should know that if other cars are driving just fine in front then it's unlikely that the road is on fire, or that the low certainty crack in the road is okay if two other cars already went over it unimpeded, if the road marks and the signs are inconsistent, but other vehicles have formed a slow but consistent pattern of traffic then that's the local ruleset, and so on)
it's still a very hard problem. and the required amount of compute is still bonkers, the required amount of data and training is still absolutely huge, and the whole problem of safely disengaging, handling the asleep/drunk passengers (likely target audience after all)... are all hard problems too :)
Or even cycle? I hear great things.
A part of the reason people wish they had FSD so badly is because they want to be rescued from this fundamental failure of NA-style urban planning that necessities driving, all the time, across both short and long distances.
It doesn't work like that in most countries; small cities and towns are navigable on foot and public transport.
If you could replace double-decker buses that arrive every 15–30 minutes with self-driving minibuses that arrive every 3–5 minutes, that would be great! (for everyone except the bus drivers who lose their jobs)
Actually, I suspect this makes self-driving a particularly _bad_ solution for city buses; getting into the bus stops takes some manoeuvring, particularly when there are other buses there.
One place that self-driving buses could be interesting (and indeed there are already a couple of systems like this) is on fully/near-fully segregated lines, where they don't have to deal with human-operated traffic. Another would be small towns, but you're looking at full magic level 5 at that point.
I’m envisaging a system of minibuses, either AI-driven or at least dynamically directed by a central control system. People would use a phone app to book journeys; the app would tell them where to get on and where to transfer, and the central control system would optimise the fleet to get everyone where they need to go.
With much smaller buses, and electronic tap-in rather than cash payments, stops should be fast enough that buses can just queue up in order at each stop, hopefully mitigating the parking difficulties you mentioned (modulo breakdowns, medical emergencies, etc). Likewise, if transfers are fast and easy, hopefully they’d be less objectionable to travellers.
Requiring a phone isn’t ideal as it limits accessibility and privacy. There could also be pre-printed tickets, with QR codes that you scan at the bus stop to see the route info.
Why minibuses and not just taxis? I suspect there’s a good balance to be made between efficient road usage (buses) and efficient routing for each traveller (cars).
I’m also envisaging that if this system were to take off, personal cars could be gradually removed from city centres! Again, that makes life easier for the AI vehicles.
This is all pie-in-the-sky stuff, I know; but I do feel like there are ways we could radically improve city transport mostly using existing roads, rather than building new rails or tunnels.
I heard the other way - people leaving cities for suburbs
Edit: I have a whole mental model for other drivers and different approaches for them. Someone driving like a grandma? Pass when available. Nervous/erratic/lost driver? Keep extra distance then pass as soon as possible. Aggressive driver? Relax, give some space and let them get ahead. And so on. I get that stereotyping is bad but ignoring the subtle signals other drivers give off seems like it would be myopic. An AI that doesn't anticipate what others will do on the road will always be reactive rather than proactive.
I maintain the position that if self-driving cars handle the most common situations as well as average human beings, there won't be a strong drive to make cars that drive significantly better than humans. Cruise and Waymo are collecting a limited version of that dataset right now. It's unclear how many deaths because some details are being kept under wraps.
They’ve been absorbing years of data classifying traffic and things like that.
Because it's really, really difficult. A lot of AI-ish stuff pretty rapidly gets to the point where it _looks_ quite impressive, but struggles to make the jump to actual feasibility. Like, there were convincing demos of voice recognition in the mid-90s. You could buy software to transcribe voice on your home computer, and people did. And, now, well, it's better than in the mid-90s certainly, but you wouldn't trust it to write a transcript, not of anything important. Maybe in 2040 we'll have voice recognition that can produce a perfect transcript, and human transcription will be a quaint old-fashioned concept. But I wouldn't like to bet on it, honestly.
And voice recognition is arguably a far, far easier problem.
I took part in a legal deposition where an "AI Transcription Software" was being used. When I received the transcript it had numerous errors, but they were all subtle. More common names were inserted in place of the name that I said, e.g., "Kennedy" instead of "Kemeny". "You have a [something]" was transcribed as "I have a [something]", completely reversing the meaning. And many more errors.
The common thread between the errors was that what was inserted into the transcript would have been the MOST EXPECTED word or phrase, instead of the ACTUAL MORE SURPRISING (surprising in an information-theory way) word or phrase. It's evident that on top of the phoneme recognition layer, this transcription software checked questionable items against tables/graphs of most likely words to occur near the other words it confidently identified in that context. Makes a transcription sound great, but it is WRONG.
The result was that the "AI Transcription" actively destroyed key information and hid that destruction under the guise of a smoothly edited transcription.
Although this surely was not the intent of the system's creators, I cannot think of a better way to make a more evil transcription system.
It's somewhat unfair because we used to simply collect less comprehensive data on performance and therefore know less about our corner cases - but you don't get to live in the future without dealing with the problems of the future.
Is this the fault of software or people generally frequently using bad sound equipment in poor and noisy conditions, such as talking on the phone while driving, on the street, poor connection, wind/rain, etc. ?
Personally, because English isn't my first language, I frequently "fail" to transcribe what is being said and have to ask the other person to repeat themselves. It seems like an AI voice transcriber in 2022 is going to work better than me.
Not sure what you're talking about really.
ML maximalism focused on the narrow problem of 'solving driving' while not recognizing that any task as complex as driving requires probably something closer to general intelligence, and theoretically the field has been impoverished in favor of "throw more graphics cards at everything".
1. Need to understand all standard signage (seems possible with AI).
2. Need to understand all "unstandard" signage (not sure how possible).
3. Need to understand the cop with the thick NY accent yelling at you saying "Can't you see there's been an accident and the road is covered with glass you dufus? Turn the F around."
I can certainly see AI solving the problem of driving in specially designed limited access highways (which could also support normal human drivers), and that alone would be a huge benefit, but I never saw how so many were willing to make the leap to "robotaxis that can drive you anywhere in the city."
5. Need to understand that occluded objects have not vanished from the universe never to be seen again
8. Generally understand the true context of things you're seeing. E.g a 4x8 sheet of plywood in the road, a squashed piece of road kill, a large metal pipe, a stopped vehicle, a baby carriage, a dishwasher, a tumbling large slab of styrofoam (all things I've encountered in the last year).
9. Is there a stopped firetruck in front of me (I list this because of the ludicrous fact that a Tesla plowed full-speed into such an obstacle).
What you describe is the classic west coast non-confrontationalism. You're probably annoying enough that it's simply not worth it to counter anything you say because you just dive into a petty and self-aggrandizing argumentative mode.
Brash and confused conservatives think everyone agrees with them, but in reality people don't want to get caught up in absolute bullshit by joining any kind of interaction with them. This is a common pattern by now. You would do well to recognize it.
- driving across an unmarked grassy mound to park a car at a store in their designated area.
- paying a fee with coins to enter and exit a toll road.
- stopping to move around roadworks based solely on hand signals from one of the workers.
These aren’t even scratching the surface in terms of edge cases that could be encountered regularly.
People point at statements like "it just needs to drive better than the average driver" and "well lots of idiots drive".
On the flip side, lots of intelligent people with other skills do not have the confidence & comfort to drive outside of their towns local roads, or at all.
There are problem sets for ML like quant trading or phone album image tagging where you just need to be right 51% of the time to make money / be novel & useful.
We've seen plenty of examples showing ML is not appropriate for life&death problems like being the primary reviewer of diagnostic imaging for cancer screening.
The bar for ML to drive a car is much much higher, and I'm not even sure we have the right sensor suites feeding into the models, not to mention the compute capacity to operate at low enough latency.
We can't build a robot which can walk down a sidewalk without running into people either. The sensor tech and mapping fidelity are red herrings. People drive well because only people are good at predicting human behavior.
Alternatively, an autonomous vehicle operator in a homogenous network full of other autonomous operators has capabilities and characteristics that greatly simplify failure modes. Maybe even majority autonomous, partially heterogeneous? You can literally slow or stop the whole show to deal with a catastrophic event. It’s still “social” but probably much reduced from the scenario where you’ve got the full scope of human expressivity behind the wheel.
The REAL problem is how do we take our roads to the crossover point where those simplified network features become accessible.
I not only assume it, I say it out loud: “[fully autonomous, …] maybe even majority homogenous, partly heterogenous?”
> “When our roads are not used exclusively by motor vehicles to begin with.”
I’m not following what you’re saying here in the context of the earlier clause. If you mean not used exclusively by autonomous vehicles, yes, and that’s why I’m pointing out the provisional aspect.
But I’ve thought the same, too. If every car on the road is robot-controlled then it changes the problem. Modulo failures, discrete algorithms should behave predictably towards each other, like the unix API philosophy.
It seems hard to get there, though. Even today it’s a PITA to maintain API boundaries in simple libraries, never mind make sure that the new Tesla v12.4 Full Self Driving For Real This Time doesn’t trigger edge cases in Volvo v7.7a Actually Real Self-Driving We Promise.
Can we make software that allows cars to behave as predictably as rail cars, but without the rails? Maybe, but I expect only on limited-access freeways. I’m sure these robot-driven cars will remain incompatible with common road uses cases like pedestrians, cyclists, and children chasing balls.
https://np.reddit.com/r/CatastrophicFailure/comments/43juk4/...
I certainly wouldn't argue with you that it isn't ready for prime time and wide distribution, but it is interesting to see their progress in San Francisco, a much different driving problem.
If it takes them 10 years to get to prod in Mesa, two (maybe three?) in SF, maybe they start shrinking that a lot in metros without winters. ¯\_(ツ)_/¯
I thought they had real self-driving taxis in Pheonix that you can order? Real ones, with no safety driver.
That definitely sounds "better", even if it is heavily geo-fenced.
The Tesla AI Day[0] surprised me as it showed they only had a simple architecture for a very long time, simply feeding barely processed camera pixels to a DNN and hoping for the best with little more than supervised learning off human feeds. Their big claim to glory was that they rearchitectured it to produce a 2D map of the environment… which I thought they had years ago, and is still a far cry from the 3D modeling that is needed.
After all, sure, we humans only take two video feeds as input… But we can appreciate from it the position, intent, and trajectory of a wealth of elements around us, with reasonable probability estimates for multiple possibilities, sometimes pertaining to things that are invisible, such as kids crossing from nowhere when near a school.
Cruise also seems to have better tech; they had a barely-watched 2h30 description of their systems[1] which shows they do create a richer environment, evaluate the routing of many objects, and train their systems on a very realistic simulation, not just supervised training, which means it can learn from very low-probability events. They have a whole segment on including the probability that unseen cars may travel from perpendicular roads; Tesla’s creeping hit-or-miss are well-documented on Youtube.
[0]: https://www.youtube.com/watch?v=j0z4FweCy4M
[1]: https://www.youtube.com/watch?v=uJWN0K26NxQ
No, we use both our perception and proprioception when we drive or walk for that matter. We have two accute visual sensors mounted in a housing with six degrees of freedom and a sensor feedback mechanism.
We also have fairly sensitive motion and momentum sensors all throughout our bodies. Additionally we have audio sensors feeding into our positional model.
All this data is fed into an advanced computing system that can trivially separate out sensor noise from useful signal. The computing system controls the vehicle, navigates, and even performs low priority background tasks like wondering if the front door of the house was locked.
We have dozens of integrated sensor inputs. It's just silly to assume we only use our eyes when driving. They're certainly an important sensor for driving but definitely not the only one.
If you ever review your Tesla Dashcam footage you'll see that you can rarely even make out a license plate. The cameras are not even HD, let alone UHD.
Further the refresh rate is a paltry 36fps.
Drive the car at high noon or night and you realize how poor the dynamic range is with highlights and/or shadows get lost.
Depending on the route, you could probably even do it with comma.ai hardware.
When I think of FSD, I think any route under any condition.
They absolutely cannot. They won't even try, they require a driver to be there to be ready to take over with no notice. Their software also makes so many basic mistakes that even what they're allowing it to do is dangerously reckless.
Or we could build 1-dimensional roads, which would make the AI's jobs much easier. Like, we could put down two parallel piece of metal, which vehicles could "hook" onto somehow...
Because they're all trying visual- or line-of-sight methods only, I call this the "robo-human" fallacy in ML: trying to automate the processes that humans undergo so that you eventually have a drop-in replacement for a human. But that is a myopic and unimaginative approach because you could be re-assessing the system itself and eliminating inefficiencies that lead to poor performance.
In the autonomous vehicles space, there is massive potential for self-organizing swarm algorithms to control pelotons of cars, rather than individual cars with no intrinsic sense of the general flow of traffic. You wouldn't need a top-down "commander" style architecture, it could be designed so that cars only talk to their immediate neighbors and emergent patterns keep traffic flowing smooth and fast.
I have always been skeptical of the attempts to reduce the amount of information about the road that a car receives. (Moving from stereoscopic to monocular vision to save the cost of one camera seems just stupid.) But people who dream of "smart cities" really seem to see little more than The Jetsons in their mind, and it limits the scope of research to our detriment.
How is AI supposed to confidently distinguish a real stop sign from someone/something holding up a picture of a stop sign?
Yes, this is a weird edge case, but I think it gets at the core issue being that it takes way more sophistication to release this tech into the wild then ppl would like to admit.
Tesla is taking a fundamentally more broad and deep approach - working with the fundamental fact that a pair of visual sensors and a compute engine (eyes & brain) can successfully figure out driving in strange areas in real time, ergo, it should be possible without a map/model or lidar. Once they get it solved, it will be solved once and for all. Bigger gamble, bigger payoff. Equipping the car with dozens of eyes is the easy part. The question is whether enough compute power can be brought to bear on solving the recognition problems, and the edge cases. They have obvious issues with failing to recognize large objects like trucks in unexpected orientations, left turns etc. Using millions of miles of live human driver data as a training set is great, except that the average driver is really bad, so it's entirely polluted with bad examples, ESPECIALLY around the edge cases that get people killed. There, examples from professionally trained drivers, who really understand the physics and limits of the car, adhesion, traffic dynamics, etc, are what you want to train on, but that isn't what they have. It is also possible that even if the set of training data would actually be sufficient, the big question will kill them - perhaps the solution requires orders of magnitude more compute power to approach human performance, and they just don't have the hardware to simulate human compute power. So, have they just hit the limits of what their compute power can do?
I think Tesla's approach is fundamentally the way to go, as it is a general solution, compared to everyone else's limited map/model approach.
But both may require either or both a more specifically programmed higher-level behaviors, and/or something much closer to AGI than exists, something that has actual understanding of the machine-learned objects and relationships, which does not yet exist (if one is known, pleas correct me - I'd love to know about it).
They have a big head start, but other car companies are now investing much more in battery tech etc and will quickly catch up. Not to mention Tesla's have terrible build quality, they have a lot of shady business practices like overcounting sales, reusing sold parts etc which came out in the recent leak.
Thing like the 4860 battery which were so hyped turn out to be not that much better. FSD is years away. Stop selling vaporware.
What they need to focus on is things they innovated on like OTA updates, integrated systems, no dealerships etc.
They have terrible manufacturing quality. The screens melt in Arizona heat. Maybe the ride is cool and feels good, but the car itself is not incredible.
That's a very old talking point about the original Model S screens from ~2012. Do you have any recent justification for this claim?
This is not to helpfully make sure the driver gets into a nice cool car when they finish their errand. It’s because the non-automotive grade screen isn’t rated or tested above 40C and were failing in heat. Rather than upgrade the part and do a recall Tesla opted to just use battery to keep the cabin below 40-45C.
I love EVs, but that’s some pretty dodgy behaviour.
This is not really an option in an ICE car because it would require running the engine. In an EV, it's easy.
They may want to think about that strategy soon. Model 3 is starting to seem dated (not to mention Model S, which is ten years old). There are very competitive alternatives on the market now that have strengths where Tesla is weak, and which are not especially weak in the areas Tesla is strong.
There are certainly some questions that are hard to answer. Maybe the Tesla will continue to hold value. But given that I see them everywhere now, they're feeling more like a commodity every day. I'm not sure how it will play out, the market is dynamic and recent events have been very disruptive. All EVs are selling out months ahead of production at this point.
[1] https://www.youtube.com/watch?v=QdMwGJBFUd4
https://en.wikipedia.org/wiki/Bj%C3%B8rn_Nyland_(YouTuber)#W...
Range is okay, but Tesla overestimates. Mine lost about 1.2 miles of range for every mile driven, and as a practical matter it was more of a 200 mile car than a 300 mile car, unless you really wrung it out. There are a bunch of 300+ mile EVs either on the roads now or releasing in the next few months. The only Tesla that has a range worth bragging about is the 400 mile version of the Model S. I do look forward (hopefully!) to regular cars having that kind of range, instead of just the top end ones.
I personally think Tesla is playing with fire leaving the quality so low. Well over half of all Model 3s have to return for repair within the first month. That's terrible. Recall how long it's taken other domestic manufacturers to regain any kind of reputation for quality, and even then many people will never believe they make good cars. For what a Tesla costs, people have high expectations. They're enjoying fad status right now, and that's great, but there is no shortage of Tesla owners already who've sworn off ever buying another one.
How so? They're not selling robotaxis or building factories to build them
> Tesla has repeatedly promised FSD is right around the corner
Which means it's years away and/or "FSD" means "automatic cruise control and lane keep assist" or whatever standard feature from auto manufacturers they've renamed
Because they chose to back themselves into that corner. Musk says that Tesla is worth nothing without full self-driving. Certainly it's the only thing left to justify the stock price:
https://electrek.co/2022/06/15/elon-musk-solving-self-drivin...
> Which means it's years away and/or "FSD" means "automatic cruise control and lane keep assist"
Well, more precisely it means Musk has been lying about it for nine years straight:
https://jalopnik.com/elon-musk-promises-full-self-driving-ne...
The lies have been profitable so far. People have bought into the false promises. Perhaps they'll start demanding refunds for the full self-driving they paid for that has still not been delivered.
Solar
And I also think they could do some clever stuff with home HVAC, possibly using waste heat from crypto miners as the H.
Lastly, afaik they went camera-only in their cheap cars (3/Y) and still use fancy stuff in the S/X.
They gave fsd customers new computers once. What’s to stop them from going back to vision+lidar or whatever once the parts are available and retrofitting as needed?
The whole ‘vision-only is better’ gag seemed like an obvious ploy to keep being able to ship cars from the beginning of supply chain problems.
And yeah, Elon does not appear to be a good person.
That doesn't sound... particularly clever. Crypto miners are essentially disposable, with a useful economic lifetime of a couple of years, typically. And they are 100% thermally efficient. Which sounds quite good, until you consider that an air source heat pump is typically around 300% thermally efficient, rising to up to 500% for ground source.
So, once your crypto miner is no longer really making anything (a couple of years), you're left with a really inefficient heating system.
> Tesla has just confirmed that it has removed radar from the Model S and Model X as of mid-February 2022, moving its entire lineup to what it calls ‘Tesla Vision,’ which is an array of cameras that Tesla says negates the need for radar. The manufacturer did the same for the Model 3 and Model Y in May of last year and even though this prompted some questions from the IIHS, the institute is now fine with it after testing.
That's exactly what I would expect someone burning out to say. You feel the burnout so you need time to get over it and feel 100% (regain your technical edge). You're still burnt out after 4 months, so you don't come back.
Frustration with the technical approach can also cause burnout.
There is usually a hierarchy of sensors, mainly for redundancy. Example: Bumper sensory at the wheel base, sonar / Lidar at the mid, and a camera at the top for advanced sensing.
For the sake of cost cutting Tesla has done away with their radar sensors at the front of the vehicle. It would be a substantial cost overhead, but have very real repercussions when it comes to safety, while also providing a "ground truth" to what at least the front facing cameras are seeing.
I don't think Lidar is a practical sensor for them to adopt, because it is quite bulky and has limited viewing angles, but I would expect them to have adopted some novel, lower cost radar solution.
Apart from the lower cost of the camera, I think Elon's rationale for having a camera only FSD is not valid, has made the problem needlessly complex and unsafe. He believes since we have eyes, and we can drive a car, then it should be sufficient to drive the car, but we only use eyes because these are the sensors we were born with, it is the best we have. In my mind, Elon's approach is like looking at a horse, and saying to yourself, that you want to build a car based on a horse, where instead of wheels, you have four mechanical legs, and those mechanical legs are limited is so many ways, but they should still at least "work", but there is no reason to limit locomotion in that way. The same with the vision system on a FSD, the whole spectrum of light is available, with any number of configurations, providing data at rates and with precision far beyond what a camera system can do.
My background is in physics, but I find myself having a growing appreciate for the vision-only stack. It's really challenging building a formal understanding of the world that is robust to outliers that are so numerous as navigating in an urban environment. With vision, you have multiple kinds of information that are highly correlated (colour, spatial distribution, depth, etc) that are self-consistent. Whereas, fusing radar with vision, where object responses to radar are highly geometry & material dependent, is a much harder task.
I'm really not an expert, so this reads more as an opinion than an experienced view, but I can see the merits in doubling down on vision.
And Tesla cars have more than one camera on them. The front-facing camera is actually an array of 3 cameras (the two farthest ones are at about human eyes distance), but they're also equipped with forward and rearward looking side cameras, and back cameras.
I think Tesla underestimated how hard vision-only FSD is, but having a single camera (they don't) is not the reason.
Also, I never said they have one camera. Multi camera != multi view.
LOL no, he was jumping ship already.
BTW, Andrej, if you're reading this, it is not just excellent it is beyond excellent. I do a lot of tinkering with transformers and other models lately, and base them all on minGPT. My fork is now growing into a kind of monorepo for deep learning experimentation, though lately it started looking like a repo of Theseus, and the boat is not as simple anymore :)
Well, I'm not sure that anyone's tech stack is capable of solving it; the live examples of robotaxis are, well, not something you'd bet your company on (and generally their creators are _not_ betting their companies on them). There was, I think, a decade ago the idea that fully self-driving cars were a near-term inevitability. That's fading, now.
Both clauses seem wrong.
Essentially an admission of failure for the self-driving car industry.
How so?
If humans can master driving with 2 eyes looking forward, why would a car with plenty of cameras in all directions not have sufficient sensory input to master it?
The problem is the software, not the sensors.
If birds had engines on their wings, they would probably fly more like airplanes.
But cameras are a poor substitute for human vision, because they can't move or pivot or refocus much.
you're using elon's own argument btw, are you repeating that knowingly
I think Karpathy realized (probably way back) that cheap sensors + no HD maps + their (reckless) public testing feedback loop doesn't advance towards L5 self driving and is bailing out. Karpathy has always backed Elon Musk whenever he talks about their technical approach, so it can't be frustration with the approach all of a sudden.
Tesla filed with the FCC in May to get authorization for a new radar system.
Does anybody seriously think Karpathy would step down if FSD was really close to be released ??
It really starts to feel like Tesla is a huge fraud which is about to be uncovered.
In fairness, this is just another in the long line of ridiculous things that he is prone to saying.
The tech is all right, and I got to try auto pilot at a discount. Unfortunately the phantom braking made AP completely useless with passengers who would freak out and complain. However, when it worked it was quite nice but I ended up using it way less than I'd hoped. Glad I didn't pay 12k for it!
The best part of owning the car was the insane acceleration and supercharger network at the beginning. But, that got annoying as more people started getting Teslas. Going on longer trips meant a ton of anxiety especially since some superchargers in cities would be packed. Worse, some would be out of order or slow charging. After the gimmick wore off, wasting 45 minutes to go another 2-3 hours started becoming annoying. And before someone asks why 2-3 hours, its called hills. California is full of them, and especially where I live I lose so much efficiency climbing hills.
Anyway overall I'd rate the car 5/10. Fastest car I've ever owned. Beyond that it was pretty much exactly as they described - a beta product. I'll probably try a Tesla again in 5-10 years.
I live in the Rocky Mountains so I can relate about the hills, but haven't noticed a big range deficit from them. Probably because every uphill has a corresponding downhill and regen braking can recover some of the uphill energy loss. What I notice much more is wind. Driving fast into a headwind entails a huge energy loss (proportional to your airspeed cubed--yikes!) and it cannot be recovered. OTOH driving with a tailwind can add significant range.
I've also not noticed much of a problem finding open superchargers but that might be because I mostly drive in "flyover country." The supercharger network has also expanded significantly just in the 18 months I've had the car.
They'll get eclipsed by other electric car manufacturers real quick.
Edit: more specifically, the parts break and they are difficult to replace. The battery degrades. They stopped providing maps to the vehicle unless I'm willing to spend several hundred dollars to replace the media console, they've told me I'm covered by a recall/warranty but have been unable to schedule the appointment.
I agree. As a former owner. They are fun to show. But there are real annoyances. In the case of the Model 3 in particular, I quickly tired of the door handles. The psychotic windshield wipers. No CarPlay. The smartphone unlocking which worked most of the time until just that moment when your hands were full. It became a chore to live with. But dear god was it fast (I had the Performance trim). Not enough. I need my daily driver to not be a PITA.
I'm very interested in what the competition is doing. Ford one-upped the Model Y by putting that knob on the display and then adding another display in front of the driver. Most of the competitive EVs have real interiors, for that matter. All of them have CarPlay. Porsche made a legit sports car.
The future looks bright!
Until the windshield wipers are solved, I would not expect the FSD. SotA deep learning models are not good enough to control that function yet.
* What are your current top alternative make / models?
* If you have some you're tracking, which make / models are you most anticipating?
I'm keeping an eye on Kia, VW, Hyundai right now. But I expect other manufacturers will catch up.
But oof, the web site is just terrible. I can't imagine the effort that went into that car and then have it be paired with what they've come up with there.
I hope that competition rises to the level of Tesla on the product presentation / ordering side as well.
[1] https://www.youtube.com/watch?v=UGlmdcS8bZU
> Parts break difficult to replace
I think I had a set of squeaky control arms that Tesla replaced under warranty in less than a week, free of charge. I don’t remember because it was such a nonissue.
Side swiped by another driver; dented my fender, bumper, smashed the headlight. Their insurance took fault, Tesla certified body shop gave estimate and fixed in less than a week (from the time dropped off).
> The battery degrades
Knew this going in. What battery doesn’t? Still comfortably road-tripping and camping with the family in my car.
> They stopped providing maps
Huh? I receive updates every time my car updates which is often. I’m guessing you’re talking the an older Model S.
> Recall/warranty and unable to schedule appointment
I’ve scheduled 5+ appointments with Tesla service center or mobile service through the app. Never been an issue.
On top of all that, my car is worth more now than it was when I bought it. Everyone in my family that drives the car loves it. The car turns heads and generates questions on the daily for 3+ years now. My young daughter’s friends still lose their mind when she gets picked up in the Model 3. It’s almost like owning a supercar without the price tag or the inconvenience.
So I guess different people have different experiences. But this is the first car I’ve ever wanted to drive until it dies.
Oh, and FSD certainly IS NOT worth it. And I doubt it will be anytime soon. :)
It was awesome in 2015. It's a pain in the ass in 2022.
example: I live in Houston and needed to go to Dallas for a work trip.
If my wife weren't using our Tesla that week (she drove it to Tennessee), I would have driven there (200-ish miles). I've done 1000+ mile trips with the Model 3 with zero issues, all because of "FSD."
Despite having another car that I really love, driving long distances manually is rough on me. So instead, I took an Uber Black both ways, flew, and rented a car in Dallas. (I expensed the UberX rate, so I paid the rest out of pocket. We are an hour from the airport.)
Convenient, but I still missed the Tesla.
With that said, yes I agree, highway driving with Autopilot is worth somewhere on the order of $1-2k to me personally. It’s made long highway drives a lot more pleasant — just used it this past July 4th for 500+ miles of highway driving.
It's a real shame because in principle having a manufacturing facility making great electric cars in the bay area would be a real win. Musk's reality distortion field is cracking.
As for luxury, quality, ride comfort - they’re just ok
What's shocking is how many people interpreted it literally--that the value is literally zero without self-driving--as if the successful EV business is in fact unsuccessful.
Like, at least give one metric on which they are measurably “the best”.
I've heard good things about the Kia Niro, VW ID.4, and Hyundai Kona as well.
My family has a Tesla and they seem to be very happy with it. I’ve driven in it and it seems really nice, maybe not exceptional but not bad.
I do have to say though, the Lidar and self-driving is glitchy and kind of gimmicky. But the fact they’re electric makes them worth it regardless.
i friggin love our model 3. two years and almost 60,000 miles in!
i want to get the model s refresh and be a two tesla household, but my pay needs to go up a little :)
But are the financials of the company also real ? The prospects of future products ? Robotaxis, FSD, Cybertruck, Semi ?
The range of models is also much wider in terms of affordability. In Europe, we've reached the point where an EV is just another car, and even the cheaper ones have tons of clever bells and whistles like 360 cameras.
Now, it's true that they're the biggest single BEV _brand_ in Europe (and second-biggest in China), but that's... basically just a different marketing approach. VW Group has multiple constituent brands mostly selling largely the same thing (SEAT/SKODA/Scania/Cupra/VW/Audi); it's no skin off their nose if someone buys a VW id3 or a Cupra Born (these are the same thing).
But in absolute numbers it will not be easy to catch up, as batteries are a limiting factor.
Energy efficiency in modern EV brands also isn't very good, which requires putting more battery (and weight) into the car. (perhaps excluding Hyundai Ioniq-s)
Combined with fast scaling of the car production + high price of lithium batteries, this will limit how many cars can be produced or increase the car price for the consumer.
This may change if manufacturers will start improving efficiency or building battery factories for themselves. Which I think only VW is currently planning to do
https://eu-evs.com/marketShare/ALL/Groups/Line/All-time-by-Y...
So far in 2022 Tesla is fourth, just behind Hyundai (Hyundai's brands are Hyundai, Kia, and Genesis).
For the first 5 months of 2022 there were 500,000 BEVs sold in Europe with Tesla 3 and Y accounting for a little over 60,000. [1]
There is a tidal wave of competing offerings and Tesla will soon be on the sidelines.
[1]: https://insideevs.com/news/594688/europe-plugin-car-sales-ma...
That said...I would bet on koreans too.
But in itself, just making on of the best electric cars today would justify a valuation of 1/10 of what Tesla currently have.
I still admire Musk and Tesla for having started the electric revolution. But by 2025 (and maybe already are), they will just be one of many electric car manufacturers - somewhere in the middle of the pack.
The comment you were replying to definitely seemed quite a bit incoherent with their personal take on what hostile takeovers actually mean.
0. https://en.wikipedia.org/wiki/Tesla,_Inc.
Life is not only about work. I stepped down from the company I funded after 14 years, it never stopped growing after that. Some people just get bored after doing one thing for a long time and want to explore other areas, especially if they always had broad interests.
> It really starts to feel like Tesla is a huge fraud which is about to be uncovered.
I seriously doubt that my Model S will somehow stop working so well and turn out to be just a fake car after 5 years.
I say that I must be imagining that I’ve actually been driving an EV for the past four years.
I must’ve dreamt having to drive only 2 hours out of a 12 hour road trip.
Bugs? Yea. Some really dangerous ones we all have read about. Manufacturing defects? Yup! Missed Deadlines? Hell yeah.
But a fraud? Nope.
But did Theranos customers were thinking they were a fraud ? Nope - they were getting their blood test results done, although not in a way Theranos advertised.
Of course the Tesla cars are not a fraud - they are actually pretty good - and for a long time they were the only EV out there. But it's no longer a case, and they are just becoming one of the 50 EV car makers out there.
And Elon seems to know it - that's why he's insisting that the entire company insane valuation is tied to FSD, or whatever other futuristic product he can imagine.
What I mean is that it's a fraud because it's an (maybe a bit above) average EV car making company, but it's CEO and the company itself insists it has extremely advance technology and products - which for now, doesn't exist. As a result, it's $ valuation is higher than most other car makers combined.
Nobody would care about the slipped FSD timelines if they hadn’t paid for it. Tesla’s mistake was charging for it.
I chose not to pay for it since I knew his estimates were rubbish. But most don’t. Doesn’t mean It’s fraud. They have been working on it. And you can see it in people’s cars.
I paid for it (€2500 or 3000 I don't remember) and I'm not stressed. I have the world's best "autopilot" (EAP) already in my 5 years old car and it's getting better and better.
Other vendors would have sold me a parking heater at that price (or higher).
The Model Y was recently the best-selling car regardless of technology (i.e. overall best-selling passenger car) in several countries. Most notably, last month in China.
It was always the case.
The only thing that needs to be solved fully is highway with auto lane change. That's literally it. And the system needs to do eye tracking like Comma Ai. If your adaptive cruise control makes you put your hand on the wheel it's useless.
Just perfect highway driving first. Trucking alone would massively change if goods could be transported to edge of urban areas autonomously.
I'm sure it's being worked on too, but puzzling why that use case is not priority 1, 2 and 3
Data annotation can be cheaply outsourced or scaled up and down without much affecting progress on self-driving. Karpathy leaving says more about that progress to me.
I agree that autopilot by itself, currently is still pretty valuable. What I worry about (and seems to be confirmed) is that Musk misunderstands what’s possible with the current technology and will make outrageous demands from the team, they will fuck up trying to deliver, then the whole thing will become radioactive.
Only if you don't care about quality. In my experience using annotation companies leads to a conflict of interest - annotate more to earn more, or annotate better.
Why do people leave companies in this manner?
1) It sometimes can be hard to leave a company when you are "in the thick of it." A sabbatical can give you personal time to reflect on whether you want to stay or not.
2) Sometimes people use sabbaticals to prep/perform job interviews or plan career transitions.
3) Sabbaticals can allow you to quit early while waiting for vesting restricted stock units, employee stock plan sales, retirement contributions (matches), etc. There are certainly many more timed bonuses available for senior leaders.
Employer: Are you sure? Why don’t you take some time off and think about it?
https://youtu.be/DxREm3s1scA
Except he failed to achieve what he claimed he could.
Not only that, but Tesla has played the Innovator's Dilemma game from the position of the upstart financially, but targeted the segment of the market that incumbents will defend to the death (luxury cars).
Tesla could have gone a different way and played the game from the true upstart: targeting the low end of the car market. Attack from below. But it didn't do that.
Incumbents always win at the sustaining innovation game. The electric power train is a sustaining innovation for the automobile industry. It doesn't break any incumbent's business model (financing the purchase of expensive cars), especially at this point. And we're now seeing this with all of the EV introductions and announcements from incumbents. Oddly, though, there are plenty of upstarts trying to do exactly what Tesla tried - attacking the blubber-rich end of the market with an immature technology.
The fall can cascade quickly, as the incumbents are stuffed with debt. When sales of ICE fall due to the growing EV segment they will have a hard time seeking the funding necessary to transition. IMO it's all a bit late. But good luck to them. From my observation only Ford and VW really appreciate the situation they are in, and they are trying hard to navigate out. Hopefully they survive. GM is screwed.
That doesn't make any sense. "Legacy auto" knows how to make cars. To their final assembly factories there's not a huge difference between a BEV, PHEV, or an ICE drive train. So long as they feed in components they get cars out. They definitely know how to get components made to feed into their factories.
That's a place where they have an advantage over Tesla. They can make BEVs that break even or lose money because they have a whole line of ICE cars making a profit. Tesla only has their up market BEVs to make their money.
Tesla doesn't have a moat around BEVs. Now that "legacy auto" is making them Tesla is just another BEV manufacturer. As their market share erodes they're going to have a harder time maintaining their price premiums. They also don't have the deep bench of fleet sales that "legacy auto" has. The places they're trying to diversify (Power Wall, solar, etc) aren't markets that support the premium prices they currently enjoy with their cars.
That's the problem. When they do it that way, they don't make a profit on BEV's. "Legacy auto" got good at building the supply chain network for parts. Then they pick and choose and assemble into a car. But everyone is taking a slice, and it's hard to optimize designs for efficiency between so many suppliers. Then they have their dealers to contend with.
What i'm saying is that "legacy auto" can certainly build and sell a BEV like they do with ICE. And it's not too hard for them to make that change, baring battery supply challenges. But they don't have the 30% gross margin that Tesla does. That margin will continue to grow and then turn into a weapon when Tesla needs to be competitive.
This does not follow at all. Tesla sells their barely up market cars at luxury car prices and makes a significant amount of money off selling emission credits and raking in other government subsidies.
As "legacy auto" manufacturers ramp up their EV production they won't need to buy emission credits from Tesla. They'll also themselves be eligible for the bottom line boosting government subsidies.
I also don't see Tesla being able to compete on luxury as they have significant problems with fit and finish. Now that traditional luxury brands have solid EV offerings it seems unlikely Tesla will be able to keep their margins and increase their sales volume.
Emission credits were 3.6%[1] of revenue last quarter (Q1 2022). I don't know what "subsidies" you are referring too but you may be thinking of the EV tax credit, which was exhausted by Tesla in late 2019[2]. So in that regard other EV automakers have an advantage over Tesla.
> I also don't see Tesla being able to compete on luxury as they have significant problems with fit and finish. Now that traditional luxury brands have solid EV offerings it seems unlikely Tesla will be able to keep their margins and increase their sales volume.
Tesla has certainly had fit and finish issues but they are solving this. Their new Model Y produced in TX uses their "giga castings" which removes the opportunity to screw up alignment by removing ~150 welds for the body. Look it up if you want to know more.
I think error in your thinking is that Tesla will remain static while others catchup. That's not going to happen. Tesla is innovating (increasing margin) and scaling at a faster rate than "legacy auto".
[1] Q1 2022 Financials https://tesla-cdn.thron.com/static/IOSHZZ_TSLA_Q1_2022_Updat... [2] https://fueleconomy.gov/feg/taxevb.shtml
Sure, but they'll make it up on volume. Tesla also will have much lower than 30% gross margins in 10 years -but can it catch up with "legacy auto" on volume?
My take is the opposite. Incumbents already have like 90% of what Tesla had or chose to build from scratch. EV's are not complicated at all compared to ICE, and incumbents have been refining their manufacturing process for decades in a brutally competitive industry.
Unless Tesla can somehow get an effective monopoly on battery tech or FSD, which they are not, they're going to be just another car company. Nothing they can deliver can't be done by others.
Personally I think it's way more likely Waymo or Apple deliver FSD first, with broad industry partnerships wiping out Tesla's advantage.
Tesla has gone down a cul-de-sac with FSD to the point that there's plenty of equally competent highway "self driving", which is all 99% of people actually need/want.
Further Tesla is extremely focussed on SKU minimization .. very few models with very few options. Tesla only has 4 cars which are kind of like 3.5 given how similar 3/Y are. People want a variety of sizes/shapes/luxury levels, and to have some options within a model.
At the Model 3&Y end of price curve, they face serious competition from Ford, Hyundai, Kia and VW.
At the S&X end, they are actually in worse shape because the Germans will sell you a wide range of cars, which actually feel luxurious inside for the ~$100K price you are paying... with lots of fun colors and options packages. The interior of a $50K Model 3 and $130K Model S are more similar than dissimilar.
You can get also get worse EVs for cheaper than the lowest Tesla starting price... not every car can start at $50K.
I mean it's kind of crazy the Tesla Model Y has crept up to $68k starting price. There are a lot of crossover/hatchback EVs in the $40-60k range especially with tax credits included...
Once competitors can ship in higher volumes at the Model 3/Y price points then they can readjust pricing quickly of course.
Look at the Model S right now, if you want a Plaid you can essentially have it RIGHT NOW, there's even a few inventory cars popping up periodically. For the Model 3/Y, if you go with performance model, again you can have it in weeks like in normal times. To me this looks like demand at the high end is cooling off for Tesla.
https://www.forbes.com/sites/neilwinton/2022/07/11/ev-makers...
This meshes pretty well with them not having anything in the compact, pickup truck, offroading/camping segments (luxury, or not). They also don't have any commercial vehicles like delivery vans.
All of those segments are being filled in rapidly by competitors. Also, the first real non-Tesla luxury sedans have been on the market for what, under a year?
In California at least there's a significant percentage of fleet vehicles that are HEVs or low emission ICEs like CNG. Fleet edition BEVs will sell like gangbusters here (if they're not already).
I don't see Tesla really able to target the fleet vehicle market. They're currently geared entirely for consumer sales and then only up market consumer sales. Fleet sales aren't flashy or exciting but they're reliable income generators for car companies.
My point is, people leave their jobs for many reasons other than how well the company is doing. At least I hope so.
https://www.youtube.com/c/WholeMarsCatalog/videos
Because there’s 0 chance they let go of the first, since that’s integral to any new car these days.
That's fun. We should join their AI team.
I’m not sure what architecture they use, but they do indeed already have a pre trained “auto-labeler” that their annotators use. My understanding is that due to hallucinations from the model and the risks involved with driving, they still need to be vetted manually before being added to the dataset.
I’m not sure if many people 5 years out of their PhD can say they did anything close to what Andrej did.
Unless I have been reading lies, this statement is at least half false
If you life in San Francisco, CA, you'll often see Cruise cars roaming the streets at night collecting data with no physical driver present.
Once again, where are the robot-taxis as promised for release in 2020?