News for hackers. Stuff that matters.
Re:Intel SPMD: Compiler for High-Performance SIMD Programming by alkonaut on Monday April 11, 2016 @03:33AM (#11470119)
That's a good reference - however the drawback of comparing a GTX280 vs an i7 from the same period, is that now 8 years later the GPUs have scaled quite well for the same set of (simple) problems, with more units/bandwidth whereas CPU performance hasn't. The difference between todays biggest graphics cards and the GTX 280 is larger than the difference between the i7 from 2008 and the big desktop CPU from 2016. The "100x" is still a myth, but we are significantly closer today than 2008.
Re:Intel SPMD: Compiler for High-Performance SIMD Programming by vardump on Monday April 11, 2016 @04:08AM (#11470233)
2008 Bloomfield i7 can do 8 FP ops per clock cycle. Recent Intel CPUs can do 32 FP ops per clock.

Bloomfield era you could have 4 (?) cores per CPU socket. Now Broadwell EP has 22.

Only thing that hasn't scaled much CPU side is memory bandwidth. I think it's only a matter of time until Intel integrates HBM2 or something like it to same package. They've already done that for eDRAM.

Re:Intel SPMD: Compiler for High-Performance SIMD Programming by creshal on Monday April 11, 2016 @04:56AM (#11470367)
> Bloomfield era you could have 4 (?) cores per CPU socket.

4 per socket, and at most 2 sockets per board.

Broadwell-EX, to be released this quarter, has 24 cores and up to 8 sockets per board.

So 64 FP ops per machine and cycle versus… 6144.

In the same time, GPUs went from 900 GFLOPS per card, 2 cards per machine (1800 GFLOPS total vs. 192 on CPU), to 9600 GFLOPS per card, 4 cards per machine (38400 vs. 12000). GPUs are still faster, but the advantage isn't that significant any more.

Re:Intel SPMD: Compiler for High-Performance SIMD Programming by CyberDildonics on Monday April 11, 2016 @10:22AM (#11471656)
32 FP ops per clock? I don't think that is true, and if it is it is very misleading.

First with Haswell introducing the fused multiply add, suddenly all the 'peak flops' numbers doubled, which is technically true, but only if everything you do is a fused multiply add (with no cache misses of course).

Even so only the Xeon Phi (and only the unreleased silvermont cores?) has 16 wide vector units, even Skylake still has 8 wide AVX units, which would be 16 fma operations.

Are you saying that AVX instructions are pipelined (or some other technique) and have a throughput greater than their width per cycle?

Re:Intel SPMD: Compiler for High-Performance SIMD Programming by vardump on Monday April 11, 2016 @12:45PM (#11472911)
> 32 FP ops per clock? I don't think that is true, and if it is it is very misleading.

https://www.google.com/search?q=haswell+32+single+precision+...

> First with Haswell introducing the fused multiply add, suddenly all the 'peak flops' numbers doubled, which is technically true, but only if everything you do is a fused multiply add (with no cache misses of course).

Yeah, FMA (fused multiply-adds).

Better or worse, it's de facto standard to quote one FMA as two FLOPS, because it's a very commonly combined operation.

> Are you saying that AVX instructions are pipelined (or some other technique) and have a throughput greater than their width per cycle?

Yeah, AFAIK, they're (mostly) pipelined and dual issue per clock.