News for hackers. Stuff that matters.
Re:Ask HN: How can ChatGPT serve 700M users when I can't run... by iJohnDoe on Friday August 08, 2025 @11:38PM (#44843854)
Are there better paths you would suggest? Any hardware people have reported better luck with?
Re:Ask HN: How can ChatGPT serve 700M users when I can't run... by kj4ips on Saturday August 09, 2025 @02:00AM (#44844358)
Honestly, unless you //really// need nvlink/ib (meaning that copies and pcie trips are your bottleneck), you may do better with whatever commodity system with sufficient lanes, slots, and CFM is available at a good price.