News for hackers. Stuff that matters.
Re:Scalable MatMul-Free Language Modeling by gabesullice on Sunday June 09, 2024 @12:58AM (#40622157)
Reminds me of ghotz's interview: https://youtu.be/wE1ZoMGIZHM
Re:Scalable MatMul-Free Language Modeling by choppaface on Sunday June 09, 2024 @04:01AM (#40622763)
geohot is shilling his product, which aims to capitalize on making accelerator manufacturers compete with each other on FLOP / tensor core throughput.

the OP outlines what could be an entirely different compute paradigm for LLMs, hence the FPGA study. they just happen to also get impressive performance on GPUs making the most of the available interface.