News for hackers. Stuff that matters.
Re:Microsoft BitNet: 100B Param 1-Bit model for local CPUs by fc417fc802 on Wednesday March 11, 2026 @04:39PM (#47341296)
Chip speed has increased faster than memory speed for a long time now, leaving DRAM behind. GDDR was good for awhile but is no longer sufficient. HBM is what's used now.

The last logical step of this process would be figuring out how to mix the CPU transistors with the RAM capacitors on the same chip as opposed to merely stacking separate chips on the same package.

A related stopgap is the AI startup (forget which) making accelerators on giant chips full of SRAM. Not a cost effective approach outside of ML.

Re:Microsoft BitNet: 100B Param 1-Bit model for local CPUs by azeirah on Wednesday March 11, 2026 @05:38PM (#47342373)
Cerebras?