yes, but Intel now has mainstream GPUs that are reasonably (~ RTX 3060) performant, which is what I assume this is for

Are you talking about Intel Arc? I'm yet to see any ML relevant benchmarks on Intel Arc. If you are aware of any please let me know.

Same here. At 16GB of VRAM and only $349, it could fill a really nice slot for DL.

You won't for some time as ARC is only supported on Linux kernel 6+. And honestly, their hardware is pretty bad for ML given you can pick up a used 3090 for $600. I just don't think there will be an ML push for ARC with current gen.

> And honestly, their hardware is pretty bad for ML given you can pick up a used 3090 for $600.

How do you know it's bad? Do you have benchmarks?

Just checked, used 3090s are going for $700-900 on eBay.

hardwareswap.reddit.com is the best way to buy used computer hardware.

It won’t be alone to make use of CUDA, which is more than enough reason.

I think a recent Linux version requirement shouldn't hamper benchmarking if you're a somewhat technical user.

You can get the latest Linux pacakges for eg Ubuntu here: https://wiki.ubuntu.com/Kernel/MainlineBuilds - probably other distributions have similar easy ways since it's needed so often in bug reporting for users to tell if a hw support bug is in a distro specific kernel change or not.

It presumably has to support Aurora urgently: https://www.alcf.anl.gov/aurora

I don’t know much about Intel’s toolchain: people say good stuff about TBB and things like that.

Historically doing inference on Intel gear was mostly about whether or not to target AVX2 or AVX512 when building Eigen or whatever. A few years ago the net win was AVX2 because the de-clock and re-clock just killed you.

What’s the game these days? Long term I doubt inference will be done on x86, but I think a lot of people still do it.