Or if you want to do development work while offline.
Good to have fallbacks but in reality most ppl ( at least in the west) will have internet 99% of the time.
Sure, but I am not one of them. I find myself wanting to code on trains and planes pretty often, and so local toolchains are always attractive for me.
"senior engineer level model" is the biggest cope I've ever seen
I will use a local coding model for our proprietary / trade secrets internal code when Google uses Claude for its internal code and Microsoft starts using Gemini for internal code.
The flip side of this coin is I'd be very excited if Jane Street or DE Shaw were running their trading models through Claude. Then I'd have access to billions of dollars of secrets.
> I'd be very excited if Jane Street or DE Shaw were running their trading models through Claude. Then I'd have access to billions of dollars of secrets.
Using Claude for inference does not mean the codebase gets pulled into their training set.
This is a tired myth that muddies up every conversation about LLMs
> This is a tired myth that muddies up every conversation about LLMs
Many copyright holders, and the courts would beg to differ.
lol yeah its weird to me why even ppl on HN can't wrap their heads around stateless calls.
unless you control both the client and the server, you cannot prove a call is stateless.
The only legit use case for local models is privacy.
I don't know why anyone would want to code with an intern level model when they can get a senior engineer level model for a couple of bucks more.
It DOESN'T MATTER if you're writing a simple hello world function or building out a complex feature. Just use the f*ing best model.