Can I Run AI locally?

Re:Can I Run AI locally? by tcbrah on Friday March 13, 2026 @01:40PM (#47367348)

tbh i stopped caring about "can i run X locally" a while ago. for anything where quality matters (scripting, code, complex reasoning) the local models are just not there yet compared to API. where local shines is specific narrow tasks - TTS, embeddings, whisper for STT, stuff like that. trying to run a 70b model at 3 tok/s on your gaming GPU when you could just hit an API for like $0.002/req feels like a weird flex IMO

[ Parent | on HN ]

Re:Can I Run AI locally? by hatthew on Friday March 13, 2026 @03:38PM (#47368751)

For me and probably many other people, local has nothing to do with cost and everything to do with privacy

[ Parent | on HN ]

Re:Can I Run AI locally? by tcbrah on Friday March 13, 2026 @05:55PM (#47370488)

genuine question - what are you working on that needs that level of privacy? outside of NSFW stuff most API providers arent doing anything with your prompts

[ Parent | on HN ]

Re:Can I Run AI locally? by hatthew on Friday March 13, 2026 @06:25PM (#47370792)

I would answer that, but it's private :)

I can think of several reasons: corporate policy, personal principles, NSFW stuff, illegal stuff

[ Parent | on HN ]