News for hackers. Stuff that matters.

A comment on Matrix-vector multiplication implemented in off-the-shelf DRAM for Low-Bit LLMs. Parent comment

Re:Matrix-vector multiplication implemented in off-the-shelf... by summarity on Sunday May 04, 2025 @10:59PM (#43891586)
Getting LLM inference running on any thing is going to be the next “it runs Doom”
[ Parent | on HN ]
Re:Matrix-vector multiplication implemented in off-the-shelf... by iszomer on Monday May 05, 2025 @08:21AM (#43894294)
I guess the more contextual nuance would be "..it runs Quake".
[ Parent | on HN ]
Re:Matrix-vector multiplication implemented in off-the-shelf... by im3w1l on Monday May 05, 2025 @11:28AM (#43896125)
Well the goal here isn't to just run it. The goal is to run it at an attractive price/performance.
[ Parent | on HN ]