Re:Making AMD GPUs competitive for LLM inference
by osmarks on Tuesday December 24, 2024 @08:13AM
(#42501697)
Most of these are just an EPYC server platform, some cursed risers and multiple PSUs (though cryptominer server PSU adapters are probably better). See https://nonint.com/2022/05/30/my-deep-learning-rig/ and https://www.mov-axbx.com/wopr/wopr_concept.html.
[ Parent
| on HN ]