Re:Kaist develops next-generation ultra-low power LLM accele...
by moffkalast on Thursday March 07, 2024 @06:27PM
(#39635903)
The part where they have like 3 bytes of memory so you switch from extremely high latency of RAM to laughably sluggish latency of USB serial. I think there's also no support below 8 bit quants, which you'd really need.
[ Parent
| on HN ]
There are no comments on this comment yet.