News for hackers. Stuff that matters.
Re:Intel proposes XeGPU dialect for LLVM MLIR by gardenfelder on Sunday December 17, 2023 @02:37PM (#38675671)
Re:Intel proposes XeGPU dialect for LLVM MLIR by mplewis9z on Sunday December 17, 2023 @05:18PM (#38677030)
You replied to the wrong topic.
[dead]
Re:Intel proposes XeGPU dialect for LLVM MLIR by superb_dev on Sunday December 17, 2023 @10:18PM (#38678884)
From the thread it looks like AMD and Nvidia have something similar, maybe Intel is wants feature parity
Re:Intel proposes XeGPU dialect for LLVM MLIR by ColonelPhantom on Monday December 18, 2023 @05:33AM (#38680967)
It looks like offload is mostly about generic abstractions for accelerator devices. XeGPU on the other hand seems to be a way of encoding Xe-specific hardware features/instructions, so pretty different? I don't see how these are anything but orthogonal.
Re:Intel proposes XeGPU dialect for LLVM MLIR by westurner on Sunday December 17, 2023 @06:40PM (#38677578)
https://discourse.llvm.org/t/rfc-add-xegpu-dialect-for-intel... :

> XeGPU dialect models a subset of Xe GPU’s unique features focusing on GEMM performance. The operations include 2d load, dpas, atomic, scattered load, 1d load, named barrier, mfence, and compile-hint. These operations provide a minimum set to support high-performance MLIR GEMM implementation for a wide range of GEMM shapes. XeGPU dialect complements Arith, Math, Vector, and Memref dialects. This allows XeGPU based MLIR GEMM implementation fused with other operations lowered through existing MLIR dialects.

Re:Intel proposes XeGPU dialect for LLVM MLIR by brucethemoose2 on Sunday December 17, 2023 @09:12PM (#38678531)
Inference is going to be interesting in 2025.

By that time we will have a good number of MI300 hosts. AMD Strix Halo (and the Intel equivalent?) will be out for high memory jobs locally. Intel Falcon Shores and who knows will finally be coming out, and from the looks of it the software ecosystem will be at least a little more hardware agnostic.

Re:Intel proposes XeGPU dialect for LLVM MLIR by cyanydeez on Monday December 18, 2023 @03:43PM (#38687939)
https://www.amd.com/en/products/apu/amd-ryzen-7-7840hs this has existed since 2023 with "Neural Processing Unit".

Seems like if you want to catch the wave, it's really already here. Not sure what this thing can do, and hope to find out next year, but local AI is going to be a killer app.

Re:Intel proposes XeGPU dialect for LLVM MLIR by brucethemoose2 on Monday December 18, 2023 @10:06PM (#38691307)
The NPU is reportedly slower than the IGP (just like in Apple devices) and restricted in what it can do. Both it and the GPU are bottlenecked by the 128 bit memory bus anyway. The 7840HS is just not fast in generative AI, even in the best case scenario.

Halo Strix's memory bus will be twice as wide, higher speed, and the GPU will be much bigger. It will be closer to a small GPU with a huge VRAM pool, rather than a dreadfully slow IGP.

Re:Intel proposes XeGPU dialect for LLVM MLIR by viksit on Sunday December 17, 2023 @11:33PM (#38679270)
could someone eli5 about what this means for engineers working on systems from an app perspective / higher level perspective?

(have worked extensively with tf / pytorch)

Re:Intel proposes XeGPU dialect for LLVM MLIR by gavinray on Sunday December 17, 2023 @11:57PM (#38679382)
Absolutely nothing, this is a "sausage being made" sort of thing.
Re:Intel proposes XeGPU dialect for LLVM MLIR by zer0zzz on Monday December 18, 2023 @12:22AM (#38679497)
When the core compiler infrastructure generalizes more of the GPU support bits, it means you can pay less for hardware because the software stack is less coupled with one vendor’s hardware.
Re:Intel proposes XeGPU dialect for LLVM MLIR by CalChris on Monday December 18, 2023 @12:33AM (#38679545)
“XeGPU dialect provides an abstraction that closely models Xe instructions.”

How is that an abstraction? It sounds more like a representation.

Re:Intel proposes XeGPU dialect for LLVM MLIR by JonChesterfield on Monday December 18, 2023 @10:58AM (#38684211)
Weird when there's no codegen for it in llvm. I guess the idea is to use MLIR with a toolchain built from intel's GitHub.