News for hackers. Stuff that matters.
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by crystal_revenge on Sunday May 17, 2026 @01:48PM (#48171226)
> Based on what?

I take it you haven’t actually run any of the current gen local models?

They all fit on fairly accessibility hardware, and their performance is at least on par with what I was paying for last year.

I have one of my agents running entirely from a local model running on a MBP and it has repeatedly shown it’s capable of non-trivial tasks.

Playing around with another, uncensored, local model on my 4090 desktop has me finally thinking about canceling my personal Anthropic subscription. Fully private, uncensored chat is a game changer.

For work it’s still all private models but largely because, at this stage, it’s worth paying a premium just to be sure you’re using the best and it saves the time of managing out own physical servers. But if we got news tomorrow that Anthropic and OpenAI were shutting down, a reasonable setup could be figured out pretty quickly.

Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by Leynos on Sunday May 17, 2026 @01:56PM (#48171348)
What kind of useful context window are you getting on a 4090, out of curiosity?
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by crystal_revenge on Sunday May 17, 2026 @02:14PM (#48171581)
256k tokens for both the MBP and the 4090
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by thiisguy on Sunday May 17, 2026 @08:55PM (#48174575)
Can you share more about your setup please? Like which models and other specs on the machines?

Edit: ah I see the models mentioned in another comment of yours

Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by fakedang on Sunday May 17, 2026 @06:01PM (#48173572)
Which models are you currently using?
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by crystal_revenge on Sunday May 17, 2026 @06:50PM (#48173869)
Was using Gemma-4-A3b-26B for a while for chat (using llama.cpp for backend and Open Web UI for client features). I’ve been using Qwen-3.6-A3B for agents and am currently playing with one of HauHuaCS’s uncensored Qwen models for chat and really liking it.

I also have an agent using Kimi 2.6 as a backend (which is open, but not local) and for some coding tasks as well.