Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs
by fouc on Thursday August 07, 2025 @11:41AM
(#44825950)
I've seen some mentions of pure-cpu setups being successful for large models using old epyc/xeon workstations off ebay with 40+ cpus. Interesting approach!
[ Parent
| on HN ]
There are no comments on this comment yet.