News for hackers. Stuff that matters.
Re:Making AMD GPUs competitive for LLM inference by osmarks on Tuesday December 24, 2024 @08:13AM (#42501697)
Most of these are just an EPYC server platform, some cursed risers and multiple PSUs (though cryptominer server PSU adapters are probably better). See https://nonint.com/2022/05/30/my-deep-learning-rig/ and https://www.mov-axbx.com/wopr/wopr_concept.html.
Re:Making AMD GPUs competitive for LLM inference by Keyframe on Tuesday December 24, 2024 @08:58AM (#42501921)
Looks like a fire hazard :)
Re:Making AMD GPUs competitive for LLM inference by icelancer on Tuesday December 24, 2024 @11:44PM (#42506885)
WOPR read is the best IMO.