Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by jsnelgro on Thursday February 29, 2024 @01:11PM
(#39552867)
It all seems too good to be true but your comment helped me develop a mental model for how this could work.
The most inspiring aspect to me here is just realizing how much potential low-hanging fruit there is in this space! What other seemingly naïve optimizations are there to try out?
The most inspiring aspect to me here is just realizing how much potential low-hanging fruit there is in this space! What other seemingly naïve optimizations are there to try out?