News for hackers. Stuff that matters.
Re:Anthropic IPO by nicce on Thursday November 12, 2026 @12:03PM (#50470509)
> macbook M5 pro 48GB

With couple affordable GPUs you can get it to 200t/s. Macbook is not the best price efficient example. Tensor parallelism is the key, the same technology that they use in the cloud.

Re:Anthropic IPO by JacobAsmuth on Thursday November 12, 2026 @12:51PM (#50471278)
So instead of buying a $20 Anthropic subscription you recommend that the average person go out and buy a couple affordable GPUs and build a home server?
Re:Anthropic IPO by hnav on Thursday November 12, 2026 @02:52PM (#50473206)
Once the memory cartel is reigned in by CXMT, Apple ships a Home with 512GB unified memory for <$10k. It'll have confidential compute so they'll let you sell tokens and they'll collect 30% for facilitating.
Re:Anthropic IPO by andriy_koval on Thursday November 12, 2026 @03:53PM (#50474116)
> So instead of buying a $20 Anthropic subscription you recommend that the average person go out and buy a couple affordable GPUs and build a home server?

Ant moat is model. If model quality is not an issue for you, there are plenty of provides which will give you access to open models.

Re:Anthropic IPO by jefftk on Thursday November 12, 2026 @01:35PM (#50471980)
I looked into this last week, and it seemed like if I wanted to get something in the Opus 5.5 range I'd be talking about $500k in hardware. Is this actually all much cheaper than I was seeing?
Re:Anthropic IPO by MaKey on Thursday November 12, 2026 @03:28PM (#50473730)
The weights of Kimi K3.1 Pro are 1.56 TB. I guess with four of the upcoming MaixBlade cards from Sipeed you'll be able to run it without quantization but that setup would still be >$50k.
Re:Anthropic IPO by LUmBULtERA on Thursday November 12, 2026 @02:20PM (#50472731)
What do you call a couple affordable GPUs?