News for hackers. Stuff that matters.
Re:Intel CEO: 'The entire industry is motivated to eliminate... by icelancer on Thursday December 14, 2023 @09:29PM (#38650462)
Yep. I have a fleet of P40s that are good at what they do (Whisper ASR primarily) but anything even remotely new... nah. fp16 support is missing so you need P100 cards, and usually that means you are accepting 16GB of VRAM rather than 24GB.

Still some cool hardware.

Re:Intel CEO: 'The entire industry is motivated to eliminate... by muxr on Friday December 15, 2023 @08:14AM (#38653836)
For us hobbyists used 3090 or new 7900xtx seem to be the way. But even then you still need to build a machine with 3 or 4 of these GPUs to get enough VRAM to play with big models.
Re:Intel CEO: 'The entire industry is motivated to eliminate... by icelancer on Friday December 15, 2023 @02:36PM (#38657820)
For sure - our prod machine has 6x RTX 3090s on some old cirrascale hardware. But P40s are still good for last-gen models. Just nothing new unfortunately.