News for hackers. Stuff that matters.
Re:Microsoft BitNet: inference framework for 1-bit LLMs by swfsql on Friday October 18, 2024 @11:16AM (#41880200)
I think that since training must happen on a non-bitnet architecture, tuning towards bitnet is always a downgrade on it's capabilities, so they're not really interested in it. But maybe they could be if they'd offer cheaper plans, since it's efficiency is relatively good.

I think the real market for this is for local inference.

There are no comments on this comment yet.