Re:What if AI doesn't need more RAM but better math?
by zozbot234 on Sunday March 29, 2026 @11:09AM
(#47563828)
The underlying advantage of local inference is that you're repurposing your existing hardware for free. You don't need your token spend to pay a share of the capex cost for datacenters that are large enough to draw gigawatts in power, you can just pay for your own energy use. Even though the raw energy cost per operation will probably be higher for local inference, the overall savings in hardware costs can still be quite real.
[ Parent
| on HN ]
There are no comments on this comment yet.