News for hackers. Stuff that matters.
Re:PyTorch Library for Running LLM on Intel CPU and GPU by goosedragons on Wednesday April 03, 2024 @08:49AM (#39916760)
For consumer stuff there's the Intel Arc A770 with 16GB VRAM. More than that and you start moving into enterprise stuff.
Re:PyTorch Library for Running LLM on Intel CPU and GPU by ZeroCool2u on Wednesday April 03, 2024 @11:53AM (#39919065)
Which seems like their biggest mistake. If they would just release a card with more than 24GB VRAM, people would be clamoring for their cards, even if they were marginally slower. It's the same reason that 3090's are still in high demand compared to the 4090's.