News for hackers. Stuff that matters.
Re:Show HN: First Claude Code client for Ollama local models by blizdiddy on Saturday January 24, 2026 @01:37AM (#46741553)
Gpt-oss is natively 4-bit, so you kinda can
Re:Show HN: First Claude Code client for Ollama local models by 3836293648 on Sunday January 25, 2026 @02:04PM (#46757075)
You can fit the weights + a tiny context window into 24GB, absolutely. But you can't fit anything of any reasonable size. Or Ollama's implementation is broken, but it needs to be restricted beyond usability for it not to freeze up the entire machine when I last tried to use it.