News for hackers. Stuff that matters.
Re:Llama.cpp: Full CUDA GPU Acceleration by SilverBirch on Tuesday June 13, 2023 @05:07AM (#36307543)
I think you're totally right with this, just to add - it's often possible to do a lot of things that are neat in hardware but create difficult problems in software. Virtually always when this happens it turns out to be nearly impossible to actually create software that takes advantage of it. So it's massively important to have a closed loop feedback system between the software and hardware so that the hardware guys don't accidentally tie the software up in knots. This is common in companies that consider themselves hardware companies first.
Re:Llama.cpp: Full CUDA GPU Acceleration by davidgl on Tuesday June 13, 2023 @05:24AM (#36307680)
Examples being the PS3 cell architecture and HP's Itanium chips