https://openrouter.ai/docs/guides/routing/provider-selection
I stopped using opencode because it has some issues with caching, so I suppose it doesn't do this
Using this interesting framework called Cordis I've recent discovered.
I also spent $280 on DeepSeek doing the tests (direct to DS, not OpenRouter). I suggest that if you can't conceive of anyone spending $200 on DeepSeek, you're not being ambitious enough!
tbf, i barely feel the difference with opus 5.5 anymore either.
What harness you are using?
So, spam?
If someone is asking you for a quote, and your tool replies, it's not spam.
It might be slop for all I know (or might not be!), but it's not spam.
Similarly for arranging meetings with parties that you already have a relationship with.
I can’t overstate how bad of an idea I think using an AI for customer interaction is.
But yeah, send me a non solicited AI slop email or worse, political ad, and you dont get the dignity of me saying stop to unsubscribe. Straight to spam for you.
> First, they come for the programmers, and next the mathematicians. Then it will be the biologists, lawyers and doctors. [...] Eventually, with advancements in robotics, stabs at increasingly more physical sciences will also be attempted. Eventually, AI will have its hand in the pie of all knowledge work, if it is possible.
You seem to think raising productivity is a bad thing?
> Humanities will stake it out a little bit longer because AI isn’t human, [...]
This is really silly. Many languages other than English don't use related words to describe 'humans' and 'humanities'. Will it be easier in those languages? Should we rename mathematics to 'humathematics' or so, to make it harder for AI to take over?
Higher productivity means very little to people whose labor plummets in value over the course of a couple of years. One day they won't be needed anymore, maybe that's good for you.
I'm a software developer by trade. I welcome the coming brave new world in which machines can do all the software.
At the moment, they ain't quite there yet, alas.
People often bring up something like "oh, someone will need to maintain the robots that just took your job." But that's seldom where the new jobs are, at least not en masse: the whole point of automation is to use less labour on the task in aggregate afterwards.
Baristas making overpriced fancy coffee is something the western world started to want to afford in the 1990s and 2000s, because we were getting rich enough thanks to lots of automation and technological progress in other areas. Coffee-making itself hadn't see much progress.
The new jobs can be anywhere in the economy, it doesn't have anything to do with the jobs that got automated or replaced.
Sorry, your comment is just far out of touch with reality.
I dont consider myself a programmer but use LLMs almost exclusively for coding.
The number of people able to create useful software today is much much larger than it used to be and arguably a minority of these people are/were "programmers"
Also even if your Gemini is giving you nonprogramming output, underneath the model is most likely generating code for certain tasks.
The shape of my work changes obviously, so it'll vary, sometimes more, sometimes less. For example, fixing all of the bugs and defects I found that week was 2-3 times the effort and chewed through my ChatGPT allowance, but I had banked resets...
Also worth noting that codex models have been kind of all over the place recently with their usage... and it looks like costs are changing again.
Gotta be honest though, I don't love fiddling with this all the time. I would rather be working on my projects than evaluating my usage. Having DS in my back pocket should i need it is a relief. The providers get fiddly though too.
Pi out if the box tries to optimise system prompt size, which is not necessarily good and will cause exactly this effect for all but the most simple tasks.
What you want is to give enough context to the agent to minimize the amount of searching within the codebase etc.
If you want to track cache, what you should do, imho, is to check if you have cache expirations mid sessions (ideally you should not), and if you don’t then lower cache use is actually better - it means that your model doesn’t reread what it just wrote.
And there's a lot of labour and effort involved in setting these things up and maintaining them. People don't even run their own email servers, even though the hardware side of that is trivial.
Not $400 a month, it doesn't.
And there's a lot of labour and effort involved...
Theoretically, the people who hang around HN are more likely than most to be capable of the labour and effort of setting these things up and maintaining them.
People don't even run their own email servers...
People don't run their own email servers because a convenient coalition of spammers, standards bodies, and large email providers have done their best to make running one's own email server almost impossible.
I did the math and decided it’d better to pay for tokens than to buy the hardware and generate them myself.
'Capable' doesn't mean your labour has no opportunity costs.
I think my argument is easier to attack by noting that you can use AI to substitute for much of that labour.
It's worth it, knowing that there are no rugs Sam or Dario or anyone else can pull.
At the moment, it's still very easy to switch from one open weights model to another, and even between the closed models. So the 'no rug pull' property is nice to have, but not as big of a deal.
Theoretically, the people who hang around HN have immense opportunity cost when doing this. Being capable does not mean it takes no time. Time they could be using for something more profitable (and fun?).
The AI models we currently have still maintain their working state with a finite and laughably-small context window, but that is already starting to change. My .claude directory already contains over 300 .md files. The question of who owns, stores, maintains, and can access the content that is currently being scribbled down in those ad-hoc files is going to become insanely important over the next couple of years. If you thought LLMs themselves were disruptive and contentious, just wait until the fight over object permanence gets under way. That's when owning your own box full of graphics cards is going to become important.
My own bet is that I won't care too much about the electric bill or my opportunity cost when we all find out what the AI labs really have in mind, and what they're going to have to do in order to justify the valuations they're seeking.
That's a good point. But you already have one possible answer: use an open source harness and call out to open-weigh models only. Then you can own all the relevant data. Still without any need to own a box full of GPUs.
So if you can spend $30K and immediately start mining $1500/month out of thin air, that's a pretty nice investment even if the electricity costs $200/month. Two years later the cards will have paid for themselves entirely and (I suspect) will still be pretty useful.
It does argue in favor of just paying OpenAI or Anthropic for tokens, though.
At the same time, when I need to use the hardware for something, whoever is renting it from me at the moment is going to get unceremoniously booted, and I imagine they are not going to be happy about that. I assume that vast.ai's providers get uptime ratings that drive their work allocation, right?
What I do is… rent on the same platform when I actually need to use a card. A benefit is that if I need a burst of more power, that’s not an issue since it’s available from other hosts. But obviously there’s an inflection point of first party utilization where it makes more sense to own.
Now, I have absolutely no clue how long this situation is going to last! But the economics don't really work out for local models while it does.
How is that different from feeding into the OpenAI or Anthropic machines?
It would definitely cost me more per month than a x20 ChatGPT or Claude plan, probably around $400+ was my estimate at the time. This was with Fireworks (ZDR) which has since increased their prices (and got slower!).
That being said, very impressed with the model, and looking forward to what comes next. As the frontier models become less subsidized, the open models will become more appealing.
P.S. There are subscription plans for open models, but I've found most of them to be extremely slow, have model throttling (only so much of model X), and also very sketchy about training and data retention. No thanks! If you want to share your data, just use Muse Spark contributor. Seems impossible to beat that on price per task if you don't mind feeding your data to the Meta machine (spoiler: I won't).