Re:Scalable MatMul-Free Language Modeling
by gabesullice on Sunday June 09, 2024 @12:58AM
(#40622157)
Reminds me of ghotz's interview: https://youtu.be/wE1ZoMGIZHM
[ Parent
| on HN ]
Re:Scalable MatMul-Free Language Modeling
by choppaface on Sunday June 09, 2024 @04:01AM
(#40622763)
geohot is shilling his product, which aims to capitalize on making accelerator manufacturers compete with each other on FLOP / tensor core throughput.
the OP outlines what could be an entirely different compute paradigm for LLMs, hence the FPGA study. they just happen to also get impressive performance on GPUs making the most of the available interface.