News for hackers. Stuff that matters.
Re:There is minimal downside to switching to open models by intothemild on Monday June 22, 2026 @04:14AM (#48627258)
Since I started running my own inference server, I've had zero degradation that I didn't do myself. Basically the only time I see it get worse is if I drop one of the quants.

Which is what I suspect the providers are doing to fit more inference on the same amount of hardware over time.

There are no comments on this comment yet.