News for hackers. Stuff that matters.

josephinepqt

can you give an example?

LLMs Are Moving Local – So Why Are We Still Paying for Tokens?

Is anyone still using LLM APIs?Open models like SmolLM3 (~3B) and Qwen2-1.5B are getting surprisingly capable - and they run fine on laptops or even phones. With Apple rolling out on-device LLMs in iOS 18, it feels like we’re entering a real local-first phase.Small models already handle focused jobs: lightweight copilots, captioning, inspection.And not just text - Gemma 2 2B Vision and Qwen2-VL...

( Read More... | 3 comments | 2 points | on HN )