News for hackers. Stuff that matters.
Re:Microsoft BitNet: 100B Param 1-Bit model for local CPUs by WithinReason on Thursday March 12, 2026 @03:48AM (#47347703)
This is 11 bit ops and a subtract, which I assume is ~11 clocks, while you can just do:

l1 = dot(A[:11000000],B[:11000000]) l2 = dot(A[:00110000],B[:00110000]) l3 = dot(A[:00001100],B[:00001100]) l4 = dot(A[:00000011],B[:00000011])

result = l1 * 64 + l2 * 16 + l3 * 4 + l4

which is 8 bit ops and 4x8 bit dots, which is likely 8 clocks and less serial dependence

There are no comments on this comment yet.