News for hackers. Stuff that matters.

A comment on Matrix-vector multiplication implemented in off-the-shelf DRAM for Low-Bit LLMs. Parent comment

Re:Matrix-vector multiplication implemented in off-the-shelf... by elcritch on Monday May 05, 2025 @01:08AM (#43892085)
I hope Micron or another commercial player builds a product on this!
[ Parent | on HN ]
Re:Matrix-vector multiplication implemented in off-the-shelf... by tamlin on Monday May 05, 2025 @03:17AM (#43892622)
Samsung and SK-Hynix have had specs and papers for a few years already for HBM and GDDR. e.g.

* https://www.servethehome.com/sk-hynix-ai-memory-at-hot-chips... * https://www.servethehome.com/samsung-processing-in-memory-te...

Not sure anyone has started using it in production.

[ Parent | on HN ]
Re:Matrix-vector multiplication implemented in off-the-shelf... by nsteel on Monday May 05, 2025 @11:16AM (#43895998)
And as mentioned in a comment elsewhere, LPDDR6-PIM is coming along too https://wccftech.com/samsung-collaborates-with-sk-hynix-in-p...

We'll see that before anything built around HBM or GDDR.

[ Parent | on HN ]