News for hackers. Stuff that matters.
Re:DeepSeek launching v4.1 flash cheaper and more capable th... by idiotsecant on Wednesday September 09, 2026 @10:57AM (#49627683)
Models are not deterministic, but they do have a flavor. When that flavor changes it can change the nature of output in a way that is undesirable.

Sort of like shooting a rifle - where the bullets hit is (to some order of magnitude, no philosophizing please) non-deterministic, but different very similar rifles will group differently and need to be appropriately adjusted to hit anything.

Re:DeepSeek launching v4.1 flash cheaper and more capable th... by nolok on Wednesday September 09, 2026 @11:51AM (#49628554)
Yeah but then it doesn't matter if it's "the model changed to another one" or "the model changed but it's the same name". Point is, you're not hosting it, as far as you know it can change at any moment, build around that idea. Is that great no, is that ideal no, that's why I self host (I include actually renting online the capacity and hosting the model myself on it).
Re:DeepSeek launching v4.1 flash cheaper and more capable th... by switchbak on Wednesday September 09, 2026 @12:49PM (#49629474)
You've added a similar response like 5 times, but I don't see you adding more information.

Yes - model hosts can do nasty things to you aside from changing the underlying model. That doesn't mean it's cool to have them change the model automatically.

Yes, it would be preferable to have complete control over your model serving, and no - not everyone is in a position to do that themselves.

Re:DeepSeek launching v4.1 flash cheaper and more capable th... by vikramkr on Wednesday September 09, 2026 @02:21PM (#49631106)
Often via api you can pin to the specific snapshot. Yes the model provider can screw you over - it's physically possible for many vendors to screw you over, that doesn't mean that's not a dick move and that you can't expect/push for better behavior
Re:DeepSeek launching v4.1 flash cheaper and more capable th... by tomrod on Wednesday September 09, 2026 @11:06AM (#49627836)
This is a great way to think of it, idiotsecant.

That flavor profile is known -- it's typical behavioral distribution is somewhat understood (and, often, common failure modes addressed). If JSON breaks about 20% of the time, and that drops for 2% or blows up to 90%, it can drive all sorts of issues (not the least, costs for retries).