News for hackers. Stuff that matters.

A comment on Scalable MatMul-Free Language Modeling.

Re:Scalable MatMul-Free Language Modeling by sva_ on Sunday June 09, 2024 @08:42AM (#40624059)
The FPGA in question, Intel FPGA PAC D5005 seems to cost around $8k
[ Parent | on HN ]
Re:Scalable MatMul-Free Language Modeling by ein0p on Sunday June 09, 2024 @12:31PM (#40625575)
That’s still 1/4th of an H100.
[ Parent | on HN ]
Re:Scalable MatMul-Free Language Modeling by mmoskal on Sunday June 09, 2024 @02:10PM (#40626308)
The FPGA would be only to prove the transistor efficiency. If this works people will eventually do ASICs (possibly inside the GPUs a few generations ahead).
[ Parent | on HN ]