Re:Nvidia might do for desktop AI what it did for desktop ga...
by kadushka on Wednesday January 15, 2025 @10:41PM
(#42720858)
I see the DIGITs box as mainly for inference, not training. It allows me to load a fairly large model (e.g. 70B llama or 12B flux) and run it locally at decent speeds.
[ Parent
| on HN ]
Re:Nvidia might do for desktop AI what it did for desktop ga...
by richardw on Wednesday January 15, 2025 @11:16PM
(#42721131)
Then surely far simpler custom chips are the eventual model, like happened with crypto? Groq, Etched etc. In that universe, Nvidia has absolutely no moat and a thousand chips are coming.
Re:Nvidia might do for desktop AI what it did for desktop ga...
by kadushka on Friday January 17, 2025 @07:38AM
(#42736895)
Maybe. For me to consider buying some unknown hardware it needs be a lot better than Nvidia. Like double the speed, half the power, and half the price. And the software better be rock solid and tested on all popular models.
Many startups have been trying for several years now, and eventually someone will succeed, but it's not easy. Even AMD hasn't been able to pull it off.