Re:Efficient LLMs: how active is this research area today?
by te0006 on Monday November 03, 2025 @04:35PM
(#45804735)
Perhaps you are looking for larger savings but I would count the RWKV line of LLM architectures in this category:
https://wiki.rwkv.com/basic/architecture.html
[ Parent
| on HN ]
Re:Efficient LLMs: how active is this research area today?
by SergiuNistor on Monday November 03, 2025 @04:38PM
(#45804766)
Totally, that counts.
But indeed, I'm curious if anybody is trying even more radical ideas.