Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Microsoft BitNet: 100B Param 1-Bit model for local CPUs. Parent comment
l1 = dot(A[:11000000],B[:11000000]) l2 = dot(A[:00110000],B[:00110000]) l3 = dot(A[:00001100],B[:00001100]) l4 = dot(A[:00000011],B[:00000011])
result = l1 * 64 + l2 * 16 + l3 * 4 + l4
which is 8 bit ops and 4x8 bit dots, which is likely 8 clocks and less serial dependence
There are no comments on this comment yet.
l1 = dot(A[:11000000],B[:11000000]) l2 = dot(A[:00110000],B[:00110000]) l3 = dot(A[:00001100],B[:00001100]) l4 = dot(A[:00000011],B[:00000011])
result = l1 * 64 + l2 * 16 + l3 * 4 + l4
which is 8 bit ops and 4x8 bit dots, which is likely 8 clocks and less serial dependence