News for hackers. Stuff that matters.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by esseph on Saturday July 25, 2026 @03:15PM (#49050629)
> Sadly until china scales production of hardware it really isn’t economical to run this stuff yourself.

I'm running this stuff at home on my desktop and using it through an app on my phone. 60-140TPS depending on model / use case.

It's more than fast enough to even maintain voice conversation.

There are no comments on this comment yet.