Re:Will Intel's AXG division survive Pat Gelsinger’s axe?
by PaulHoule on Tuesday August 09, 2022 @04:22PM
(#32403722)
Yes and no.
If you have all the cores running hard the power consumption goes up a lot but if it is just one core it won't go up too much. If worse come to worse you can throttle the clock.
In general it's a big problem with SIMD instructions that they aren't compatible across generations of microprocessors. It's not a problem for a company like Facebook that buys 20,000 of the same server but normal firms avoid using SIMD entirely or they use SIMD that is many years out of date. You see strange things like Safari not supporting WebP images on a 2013 Mac while Firefox supports them just fine because Apple wants to use SIMD acceleration and they'd be happier if you replaced you 2013 Mac with a new one.
I worked on a semantic search engine that used an autoencoder neural network that was made just before GPU neural networks hit it big and we wrote the core of our implementation in assembly language using one particular version of AVX. We had to do all the derivatives by hand and code them up in assembly language.
By the time the product shipped we bought new servers that supported a new version of AVX that might have run twice as fast but we had no intention of rewriting that code and testing it.
Most organizations don't want to go through the hassle of keeping up with the latest SIMD flavor of the month so a lot of performance is just left on the table. Intel is happy because their marketing materials can tell you how awesome the processor is but people in real life don't experience that performance.
If you have all the cores running hard the power consumption goes up a lot but if it is just one core it won't go up too much. If worse come to worse you can throttle the clock.
In general it's a big problem with SIMD instructions that they aren't compatible across generations of microprocessors. It's not a problem for a company like Facebook that buys 20,000 of the same server but normal firms avoid using SIMD entirely or they use SIMD that is many years out of date. You see strange things like Safari not supporting WebP images on a 2013 Mac while Firefox supports them just fine because Apple wants to use SIMD acceleration and they'd be happier if you replaced you 2013 Mac with a new one.
I worked on a semantic search engine that used an autoencoder neural network that was made just before GPU neural networks hit it big and we wrote the core of our implementation in assembly language using one particular version of AVX. We had to do all the derivatives by hand and code them up in assembly language.
By the time the product shipped we bought new servers that supported a new version of AVX that might have run twice as fast but we had no intention of rewriting that code and testing it.
Most organizations don't want to go through the hassle of keeping up with the latest SIMD flavor of the month so a lot of performance is just left on the table. Intel is happy because their marketing materials can tell you how awesome the processor is but people in real life don't experience that performance.