Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by int_19h on Wednesday February 28, 2024 @03:06PM
(#39542841)
GPT-4 is a tiny subset of "LLMs".
If you train a model to do math (and optimize representation for that), it'll do math. GPT-4 just isn't, and, generally speaking, they aren't, because it's much more efficient to train them to "use a calculator". Same as with humans.
If you train a model to do math (and optimize representation for that), it'll do math. GPT-4 just isn't, and, generally speaking, they aren't, because it's much more efficient to train them to "use a calculator". Same as with humans.