News for hackers. Stuff that matters.
Re:Apple Silicon costs more than OpenRouter by visarga on Sunday May 17, 2026 @10:57AM (#48169498)
> Frontier AI companies are selling at a loss.

There are huge economies to be had by batching requests and using lots of RAM for MoE (sparse models). You can't achieve that efficiency at batch size 1 on a single node.

Re:Apple Silicon costs more than OpenRouter by asjir on Sunday May 17, 2026 @11:12AM (#48169638)
Exactly, they put a lot of money into engineering and it does give results
Re:Apple Silicon costs more than OpenRouter by eikenberry on Sunday May 17, 2026 @03:58PM (#48172683)
Inference isn't the problem.