Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by jairuhme on Wednesday February 28, 2024 @08:15AM
(#39537424)
They won't have something at that size because as you pointed out, it is still huge. But depending on how they are used, smaller parameter models may be better for specific on-phone tasks that start to make the size of the model not a problem. GPT4 is so large because it is very general purpose with the goal seeming to be to answer anything. You could have a smaller model focused solely on Siri or something that wouldn't require the parameter size of GPT4
[ Parent
| on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by sigmoid10 on Wednesday February 28, 2024 @04:01PM
(#39543365)
The thing a about GPT4 that matters so much is not just raw knowledge retention, but complex, abstract reasoning and even knowing what it doesn't know. We haven't seen that yet in smaller models and it's unclear if it is even possible. The best we could hope for right now is a better natural language interface than Siri for calling OS functions.