News for hackers. Stuff that matters.
Re:Flavors of SIMD by dragontamer on Tuesday February 19, 2019 @02:01PM (#19201737)
> Comparing GPUs and CPUs are tricky

I agree it is tricky, but my point in the above post is not to compare processing girth, but instead to compare memory-allocation. If you are aiming for occupancy 10 on Vega64, every 32-bit DWORD you allocate will allocate a total of 655,360 bytes.

Yes, this code, a simple 4-byte allocation in OpenCL:

    __private uint32_t foobar;
This code just allocated 655,360 bytes on Vega64 (assuming worst-case Occupancy 10 per queue). While this following OpenCL code:

    __private uint64_t wow;
Just allocated 1.25 MB. By itself. The single line of code. The total amount of memory used adds up surprisingly quickly on GPUs. This is IMO the biggest issue with GPU programming, the absurdly small amount of memory you're expected to work with per shader.

There are no comments on this comment yet.