News for hackers. Stuff that matters.
Re:Kimi K3 is now live by dghlsakjg on Thursday July 16, 2026 @11:16AM (#48935743)
Tokenizers also matter. Anthropics tokenizers will encode the same piece of text at a way higher token count than OpenAi, for example.

That said, Kimi is competing against GLM in my mind, and GLM 5.2 is less than 1/3 the price.

Re:Kimi K3 is now live by leecommamichael on Thursday July 16, 2026 @11:28AM (#48935892)
Tokenizers define the alphabet on which the language model is trained. I don't want people to get the impression it's a module which can be swapped out or modified on its own. Alphabet size is a design consideration related to correctly encoding the training data.
Re:Kimi K3 is now live by smallerize on Thursday July 16, 2026 @12:03PM (#48936378)
That's true, but it makes it difficult to compare pricing when it's based on tokens. Maybe we need a benchmark for price per a specific input, like enwiki8.
Re:Kimi K3 is now live by leecommamichael on Thursday July 16, 2026 @12:23PM (#48936634)
Yes, almost all work people share which seeks to measure the capabilities and differences of models needs to get more precise. We are clamoring to say something meaningful about these things.
Re:Kimi K3 is now live by victorbjorklund on Thursday July 16, 2026 @01:05PM (#48937194)
It is kind of a shame we ended up comparing token pricing across models and providers when it doesn’t really make sense. Not sure what would be better though.
Re:Kimi K3 is now live by alain94040 on Thursday July 16, 2026 @01:11PM (#48937280)
Use price per page (standard English text)? That would also help make the metric easier to visualize.

If you think a page is too vague, use a famous known writer's work as a reference.

Re:Kimi K3 is now live by whoopdeepoo on Thursday July 16, 2026 @01:11PM (#48937283)
Well isn't that what benchmarks are for? They compare total cost for a unit of work.
Re:Kimi K3 is now live by whodatbo1 on Thursday July 16, 2026 @01:53PM (#48937870)
A better metric is price per byte. Most thinking traces, prompts, skills are in plain English, which is roughly 1 byte per character, assuming UTF-8 encoding (even code should not be much more either). As an aside, it is common to use bits-per-byte as a loss metric instead of the per token calculation, precisely because of the effect of different tokenizers.
Re:Kimi K3 is now live by smallerize on Thursday July 16, 2026 @02:05PM (#48938014)
It's going to vary dramatically based on which text you put in. Really it's hard to make one benchmark number that's relevant to all cases. But maybe we can make something a little more specific, like regular English text, code, the model's own thinking tokens, image inputs etc.
Re:Kimi K3 is now live by kevincox on Thursday July 16, 2026 @03:06PM (#48938839)
But even that isn't the whole story because the models can produce wildly amount of thinking output as well as regular output for a similar query. Sometimes you can take a cheap model and have it think a ton or an expensive model that thinks little and get similar results. But the number of tokens generated will be wildly different.
Re:Kimi K3 is now live by semiquaver on Thursday July 16, 2026 @02:27PM (#48938286)
I’ve been struggling to understand the reason for the newer apparently less efficient Anthropic token encoding. If all inputs are less efficient in this encoding, why does it exist? Has Anthropic released any information that would convincingly show it was anything other than a stealth price hike? Please don’t respond if you are speculating.
Re:Kimi K3 is now live by remus on Thursday July 16, 2026 @02:36PM (#48938407)
> Please don’t respond if you are speculating.

I doubt you are going to get a response from an anthropic employee, but I think it is safe to assume they have swapped to a new tokenizer because it improves the performance of their models.

Re:Kimi K3 is now live by re-thc on Thursday July 16, 2026 @03:09PM (#48938879)
> the reason for the newer apparently less efficient Anthropic token encoding

Less efficient in token usage but per the blogs; it enables the model to perform better.

Re:Kimi K3 is now live by mnicky on Friday July 17, 2026 @03:35AM (#48944366)
It's really simple I think.

More tokens per same text length means more capacity to encode information. More information means model can potentially perform better.

They introduced it around the time the Mythos came so my speculation is that if you have more capable model at some level you may find the current information encoding not using its full potential.

We will see whether OpenAI also introduces new tokenizer when they come to Mythos-size models.

Re:Kimi K3 is now live by cmrdporcupine on Thursday July 16, 2026 @12:15PM (#48936547)
GLM is actually quite expensive in actual practice because it's not very token efficient. I've yet to find a way to run it on a monthly sub reliably for cheaper than Codex.

Neuralwatt was cheap (but slow) but they cranked their price.

Ollama monthly sub is speedy but doesn't offer a lot of quota.

Right now unless you're paying by the token, there's no cost based reason to use the open weight models for daily coding work because the monthly coding plans from Anthropic and OpenAI are a better deal.

Re:Kimi K3 is now live by computerex on Thursday July 16, 2026 @01:06PM (#48937199)
I know GLM is relatively expensive and so is Kimi, in comparison to those DeepSeek V4 pro and flash are a godsend and are absolutely good value.
Re:Kimi K3 is now live by arizen on Thursday July 16, 2026 @04:01PM (#48939498)
And DeepSeek V4 Flash + GLM 5.2 is a really good blend of both (fast/cheap DS + more intelligent GLM)
Re:Kimi K3 is now live by versteegen on Thursday July 16, 2026 @10:57PM (#48942902)
I think MiMo 2.5 seems to be better than DS4 Flash, at the same price. DS4F can write pretty advanced code but it way overthinks the simple stuff, its CoT is full of errors (immediately corrects itself), and yesterday I was shocked it reliably struggled to spot a misplaced % in a format string when reading a whole file.
Re:Kimi K3 is now live by pimeys on Thursday July 16, 2026 @05:31PM (#48940528)
I use V4 flash as my personal agent. It categorizes documents, organizes my calendar, searches information etc. for pennies. Amazing model.

Not very good for programming though.

Re:Kimi K3 is now live by mark_l_watson on Thursday July 16, 2026 @01:18PM (#48937376)
re:

> Right now unless you're paying by the token, there's no cost based reason to use the open weight models for daily coding work because the monthly coding plans from Anthropic and OpenAI are a better deal.

Maybe. I am on a $20/month Anthropic subscription this month but I also use Claude Code frequently with Deepseek v4 flash and pro, GML5.2. For simple work Deepseek v4 flash is so nice because it is fast.

What you say is true however, the US hyper-scalers are still (desperately?) subsidizing subscriptions for market share to boost there valuations.

I really want to see AI inference costs approach zero, and I think I just need to wait a few years to see that.

Re:Kimi K3 is now live by cmrdporcupine on Thursday July 16, 2026 @02:02PM (#48937990)
DeepSeek is a whole other story. It and a few others are quite economical. But they're also not nearly at the same level.

I can get by working on code strictly in GLM. I can't with DeepSeek. It makes some pretty careless mistakes and isn't a very deep thinker.

It is very useful as a general purpose model for non-coding purposes though.

Re:Kimi K3 is now live by humanfromearth9 on Friday July 17, 2026 @04:51AM (#48944870)
For maths, it's also wrong most of the time. Generated stuff looks right, then let Opus audit and see the disaster.

DS4 is usable iff you have a way to test the generated stuff, and to convince yourself that its production is right. With successive review-fix rounds, it's obviously way more reliable too, but that can't compensate for it's lack of rigor when reasoning. It's very smart but neither rigorous nor careful. And that is a direct result of its architecture.

Re:Kimi K3 is now live by stavros on Thursday July 16, 2026 @01:58PM (#48937941)
I don't know, DeepseekV4 is so dirt cheap that it makes lots of sense to use over Sonnet.
Re:Kimi K3 is now live by tokai on Thursday July 16, 2026 @02:40PM (#48938459)
Compared to the flagship models GLM is still a 1/10th the price on the task I have tested.
Re:Kimi K3 is now live by cmrdporcupine on Thursday July 16, 2026 @09:58PM (#48942590)
Only if you're paying for said flagship models through API prices. Which I specifically said I was not and specifically mentioned coding plans.
Re:Kimi K3 is now live by UncleOxidant on Thursday July 16, 2026 @02:48PM (#48938586)
I'm on the Z.ai quarterly subscription plan (got in when the price was lower) and I was using it through opencode and it was like I'd only get maybe an hour of usage (if that, sometimes) before it would time out and say come back in 5 hours. Now I'm using it through their Zcode harness and I rarely hit that - they say they're giving 1.5x usage if you use it through Zcode, sometimes seems like even more than that.
Re:Kimi K3 is now live by esafak on Friday July 17, 2026 @01:30AM (#48943638)
Too bad Zcode sucks. The promo ends this month anyway.
Re:Kimi K3 is now live by ifwinterco on Thursday July 16, 2026 @03:58PM (#48939478)
I found this with kimi k2.7 as well: on paper it should be quite cheap, but it's not because it uses a lot of tokens for quite simple tasks
Re:Kimi K3 is now live by KronisLV on Thursday July 16, 2026 @05:39PM (#48940626)
> I've yet to find a way to run it on a monthly sub reliably for cheaper than Codex.

Matches my experience, I got their Pro subscription and while I enjoyed the model itself a lot and while their ZCode harness is also pretty nice, it gave me less tokens for similar amounts of money that Anthropic would give me on a subscription: https://blog.kronis.dev/blog/z-ai-s-glm-5-2-is-a-great-model...

I'm yet to try out Kimi, but if their subscription were to be anywhere comparable to Anthropic/OpenAI, I might just switch over because competition is good.

DeepSeek V4 Pro is really affordable per-token but regularly kept making mistakes in the tasks I gave it. I mean I could at least afford the tokens to go over the work a 2nd, 3rd, 4th and 5th time and gradually fix most of the issues, but it was a very frustrating mode of work.

Re:Kimi K3 is now live by asenna on Thursday July 16, 2026 @11:21AM (#48935800)
With that kind of pricing, I don't think they're competing with GLM with this new launch.
Re:Kimi K3 is now live by mdasen on Thursday July 16, 2026 @01:11PM (#48937286)
It also depends on how many tokens it needs to burn through to accomplish something.

At this point, I always look at things like Artificial Analysis' total cost to run their tests. It'll take into consideration the cost of tokens, how many tokens it burns through, and how effectively it uses caching (and the price of that caching).

If a model "costs the same" but its reasoning ends up going through a ton more tokens, it doesn't really cost the same in real world usage.

Re:Kimi K3 is now live by KennyBlanken on Thursday July 16, 2026 @10:26PM (#48942737)
Precisely. GLM 5.2 Thinking is pretty damn good - but it regularly does something nonsensical. Or even spits out what looks like a fragment of its memory cache. Or returns a bunch of Chinese.

I find myself having to resubmit a query very often...so it being a third of the cost of other AIs isn't really relevant.

Re:Kimi K3 is now live by zvikara on Thursday July 16, 2026 @01:49PM (#48937807)
I believe Kimi is spending more on marketing than GLM (a lot of ads lately) so I guess that's part of what the higher price supposed to cover.
Re:Kimi K3 is now live by InsideOutSanta on Thursday July 16, 2026 @04:39PM (#48939912)
> That said, Kimi is competing against GLM in my mind, and GLM 5.2 is less than 1/3 the price.

Having used GLM 5.2 extensively and K3 for a few hours now, these models are nowhere near each other. 5.2 is a great model, and I use it for a lot of things, but it's noticeably below Opus 4.8 or GPT-5.5 in real-world usage.

K3 is in the same ballpark as Fable or Sol.

Re:Kimi K3 is now live by wmedrano on Thursday July 16, 2026 @11:00PM (#48942926)
Where does the less than a third the price come from? From the provided benchmark suite, it came slightly under half.