News for hackers. Stuff that matters.
Re:PyTorch Library for Running LLM on Intel CPU and GPU by Aromasin on Wednesday April 03, 2024 @09:01AM (#39916880)
There's the Max GPU (Ponte Vecchio), their datacentre offering, with 128GB of HBM2e memory, 408 MB of L2 cache, and 64 MB of L1 cache. Then there's Gaudi, which has similar numbers but with cores specific for AI workloads (as far as I know from the marketing).

You can pick them up in prebuilds from Dell and Supermicro: https://www.supermicro.com/en/accelerators/intel

Read more about them here: https://www.servethehome.com/intel-shows-gpu-max-1550-perfor...

There are no comments on this comment yet.