News for hackers. Stuff that matters.
Re:Andrej Karpathy talks about how Tesla's NNs are structure... by maxerickson on Sunday November 10, 2019 @10:26AM (#21498300)
Good ol' velocity-cubed.

Increasing their compute per watt allows them to get more compute per watt, so they will pursue it lots, low speed energy savings are a way of making the range extension seem like a big deal when it isn't (maintaining highway speeds requires tens of kilowatts).

Re:Andrej Karpathy talks about how Tesla's NNs are structure... by mlyle on Sunday November 10, 2019 @04:51PM (#21500395)
It was a big deal for Tesla, though, because they had to fit into a tiny power budget. HW2.0 wasn't enough for what they wanted to do, and to retrofit existing cars they had to consume a similar amount of power.

Power efficiency does make a range difference and is worth seeking, but Tesla is exaggerating this, IMO, to conceal one of the ways that the churn-heavy cycle for FSD has imposed organizational costs (an entire chip-level hardware program, in this case).

Re:Andrej Karpathy talks about how Tesla's NNs are structure... by maxerickson on Sunday November 10, 2019 @07:28PM (#21501204)
I would expect them to seek compute/watt basically until they stopped making progress.

An actual working system might slow them down, but even then, better hardware is one of the ways to make it better.

Re:Andrej Karpathy talks about how Tesla's NNs are structure... by mlyle on Monday November 11, 2019 @05:36PM (#21509668)
Designing ICs is a very expensive treadmill. If you can buy fast enough hardware to do your job, it's really hard to justify spending a lot for something that may be nominally a little better on some metric.

There's commodity computing of comparable throughput that other automakers can incorporate without too much cost, but it doesn't fit into the existing TM3 vehicles because it has a larger footprint in power, space, and cooling than HW2.

Here, Tesla spends a bunch of money to develop HW3 and overcome this problem, but the advantage in a new car design between HW3's efficiency and commodity hardware is limited.