DeepX claims inference up to 100B parameters at less than 5 W

Re:DeepX claims inference up to 100B parameters at less than... by LaurensBER on Monday November 09, 2026 @05:06PM (#50432938)

I'm getting questions weekly about running AI in-house now, in Europe trust in both the US and China seems to have hit an all-time low and AI is already scary for a lot of people.

I have no doubt that local first is the future that we're heading towards. We're seeing "algorithmic progress" towards more efficient models and _some_ hardware being available (NPUs, this chip, etc).

At the moment it doesn't seem like an appealing offer since it's just a little bit too constrained and since internet is universally available but if we can run a DeepSeek 4.1 Flash class model cheap and local, it becomes a no brainer.

[ Parent | on HN ]

Re:DeepX claims inference up to 100B parameters at less than... by ares623 on Monday November 09, 2026 @05:32PM (#50433239)

The more the labs optimize inference to increase their margins, the more feasible it makes to run models locally

[ Parent | on HN ]

Re:DeepX claims inference up to 100B parameters at less than... by NewJazz on Tuesday November 10, 2026 @01:01AM (#50436642)

[delayed]

[ Parent | on HN ]