News for hackers. Stuff that matters.

A comment on An inside look at the custom CPUs in Tesla's Dojo Supercomputer.

Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by hirundo on Friday August 20, 2021 @08:47PM (#28253031)
Now assume that Moore's law stays healthy and in a few decades we're carrying around dojo-equivalent smart phones. Or implants. What do our apps do with all that compute? Detailed convincing AR, accurate real-time translation, identify almost any object in sight, turing-test passing answering machine. We'll be carrying around neural-net training hardware that is different than the stuff between our ears, often worse but sometimes much better. A cyber brain. Scary af.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by pplante on Friday August 20, 2021 @08:53PM (#28253074)
We will have 7 more layers of UI abstraction to solve the problem of not adequately warming the users hands as they use it during extreme winter weather caused by climate change.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by vlovich123 on Friday August 20, 2021 @09:08PM (#28253151)
Moore’s law is quite dead. Transistor density isn’t doubling. We’re still getting speed increases due to architectural improvements, but transistor density is capping out because thermals are a problem. That’s why you see these massive wafer designs and they’re not shrinking.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by pabs3 on Friday August 20, 2021 @09:46PM (#28253318)
Both TSMC and Intel have transistor density increases on their process roadmaps, although they definitely aren't doubling.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by WoodenChair on Friday August 20, 2021 @09:18PM (#28253199)
> Transistor density isn’t doubling.

It pretty much continues to double: https://en.m.wikipedia.org/wiki/Transistor_count#/media/File...

[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by Baeocystin on Friday August 20, 2021 @09:44PM (#28253309)
Raw transistor count isn't the same as density.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by WoodenChair on Friday August 20, 2021 @10:24PM (#28253539)
Sure, but if you look at the raw transistor count of a series of similarly sized dies (take Apple's A series for example), it holds up. It only doesn't hold up if you look at Intel the last 5 years. If you look at series' made on TSMC or Samsung, it holds up.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by smolder on Saturday August 21, 2021 @04:29AM (#28255243)
If you look at CPU performance relative to density as it has progressed over the last few decades, there's a clear decline in speed improvement. Denser only means faster to a point, regardless of Intel's process update failures.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by WoodenChair on Saturday August 21, 2021 @03:57PM (#28260043)
Not sure what you’re replying to. The statement I’m replying to didn’t say anything about performance. It said “ Transistor density isn’t doubling.”
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by smolder on Monday August 23, 2021 @12:25AM (#28272326)
I have always looked at Moore's "law" as a proxy for performance, so I felt it was relevant, if tangential.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by chrisseaton on Friday August 20, 2021 @10:17PM (#28253492)
Moore’s law was about count, not density.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by AussieWog93 on Friday August 20, 2021 @10:43PM (#28253651)
I mean, strictly speaking, you're technically correct. Informally, though, it's a proxy for transistor density.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by shadilay on Friday August 20, 2021 @11:08PM (#28253789)
It was about cost. https://hasler.ece.gatech.edu/Published_papers/Technology_ov...
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by jhgb on Saturday August 21, 2021 @01:07AM (#28254376)
Yes, count for optimum cost per transistor. So perhaps GP's statement was incomplete but not wrong.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by rPlayer6554 on Saturday August 21, 2021 @03:47AM (#28255055)
> What do our apps do with all that compute? Detailed convincing AR, accurate real-time translation, identify almost any object in sight, turing-test passing answering machine. We'll be carrying around neural-net training hardware

Or more likely they'll spend the compute power on the latest JavaScript framework....

[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by pbalau on Friday August 20, 2021 @10:07PM (#28253446)
> What do our apps do with all that compute?

javascript

[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by sillysaurusx on Friday August 20, 2021 @10:32PM (#28253591)
This isn’t far from the truth. But embrace it rather than feel upset by it. The world of programmers can be unlocked by a good API. And the underlying components can be C{,++}, as V8 is.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by jameskilton on Friday August 20, 2021 @08:49PM (#28253051)
I wish I had your optimism. All I expect are better ways to deliver targeted advertising.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by mysterydip on Friday August 20, 2021 @10:55PM (#28253713)
Based on current computing resource usage: ads.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by Keyframe on Saturday August 21, 2021 @04:53AM (#28255354)
Predict weather and issue an AR warning where to seek shelter from nearby tornado and a passing heat dome, all sponsored by your telecom and facilitated by facebook, of course.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by roca on Friday August 20, 2021 @09:08PM (#28253150)
Performance per watt is not improving that much, nor is feature size. You'll probably never be carrying around a supercomputer with this many FLOPS.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by cma on Friday August 20, 2021 @09:36PM (#28253281)
Even with reversible computing?
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by roca on Saturday August 21, 2021 @07:29AM (#28256073)
If we ever use reversible computing it won't look anything like this Tesla stuff, that's for sure.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by freemint on Saturday August 21, 2021 @12:11PM (#28258079)
Linear algebra is reversible if you nudge the matrixes so that the determinant is non-zero.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by nefitty on Friday August 20, 2021 @10:19PM (#28253504)
What about cloud services. A 5G connection to a supercomputer on demand.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by roca on Saturday August 21, 2021 @07:30AM (#28256080)
You can have that now. That's now that the parent was hoping for.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by _ph_ on Saturday August 21, 2021 @07:39AM (#28256144)
If have a recent iPhone, you are carrying some special purpose neural net hardware around in your pocket already. I think this is a trend which is going to continue. First obvious application is, that speech recognition moves onto the phones themselves, no network required any more.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by icytrumpet on Friday August 20, 2021 @09:09PM (#28253153)
That's not a world I want to live in. Not even a little bit.
[ Parent | on HN ]
Re:An inside look at the custom CPUs in Tesla's Dojo Superco... by flipbrad on Saturday August 21, 2021 @02:56AM (#28254861)
It's going to be really good at scanning your texts and photos to check they don't contain unacceptable content.
[ Parent | on HN ]