Re:Ask HN: How can ChatGPT serve 700M users when I can't run...
by iJohnDoe on Friday August 08, 2025 @11:38PM
(#44843854)
Are there better paths you would suggest? Any hardware people have reported better luck with?
[ Parent
| on HN ]
Re:Ask HN: How can ChatGPT serve 700M users when I can't run...
by kj4ips on Saturday August 09, 2025 @02:00AM
(#44844358)
Honestly, unless you //really// need nvlink/ib (meaning that copies and pcie trips are your bottleneck), you may do better with whatever commodity system with sufficient lanes, slots, and CFM is available at a good price.