News for hackers. Stuff that matters.

A comment on Anthropic IPO Buyers See Valuation as Low as $1.1T. Parent comment

Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by wernam on Friday November 06, 2026 @02:57PM (#50397532)
12GB GPU is useless. The good experience is with 128-256GB unified memory architectures like strix halo etc. You don't need to buy any hardware, you can experience the latest open weight MOE (flash) models from DeepSeek, qwen, or GLM on openrouter using a local agent like kilo.
[ Parent | on HN ]
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by the__alchemist on Friday November 06, 2026 @03:06PM (#50397666)
That is a shift of comparisons though, right? This thread was about running locally, explicitly as an alternative to cloud services. I would guess few people have graphics cards with > 12GB ram.
[ Parent | on HN ]
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dofm on Friday November 06, 2026 @03:08PM (#50397698)
A few more will have Macs with 48GB RAM though. (Indeed if you push it a little, 36GB unified is possibly enough for Muse Glimmer; I have not tested this theory)

There is, for sure, a limiting factor in the x86 architecture, but I think the RTX Spark will change that a bit.

[ Parent | on HN ]
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by wernam on Friday November 06, 2026 @03:56PM (#50398416)
AMD Ryzen AI/Strix Halo is for running locally on your hardware. Openrouter is for evaluating the models you'll be running locally, before buying the hardware.
[ Parent | on HN ]
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by the__alchemist on Friday November 06, 2026 @04:04PM (#50398515)
> 128-256GB unified memory systems running MOE models is the "cheap"

I'm not familiar with these. How much does one cost, and from what store / what product name?

[ Parent | on HN ]
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dofm on Friday November 06, 2026 @03:06PM (#50397677)
Would you talk to me a mo about Kilo compared to Pi?

I am digging in on Pi (in lovely Paseo and exploring Pendant when in VS Code).

What would I find better or worse in Kilo?

[ Parent | on HN ]
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by IsTom on Friday November 06, 2026 @03:30PM (#50398037)
A 3060 + good chunk of system RAM can run qwen3.8 flash next.
[ Parent | on HN ]