News for hackers. Stuff that matters.

A comment on Mixtral 8x22B. Parent comment

Re:Mixtral 8x22B by Zuiii on Wednesday April 17, 2024 @11:19PM (#40072639)
Wait. Isn't it a breaking change to change the underlying model like this? Wouldn't people start running into consistency issues in production? (given ollama appears to be oriented towards backend use)
[ Parent | on HN ]
Re:Mixtral 8x22B by orra on Thursday April 18, 2024 @04:04AM (#40074007)
Sure, in theory. But if you move so fast that you already are running the base 8x22B model from last week, you can easily fix this.

I've long thought that if you want reproducibility and reliability, you need to pin your deps.

So, IMO, the change is very much worth it to reduce confusion going forward.

[ Parent | on HN ]