Re:Exponentially Faster Language Modelling
by voiceblue on Wednesday November 22, 2023 @05:58PM
(#38386378)
You're using an LLM as if you don't understand how or why it works. Math is not what it's for. Here, look at what ChatGPT 4 does (for a case that hasn't been fed to it by a hundred other users yet):
What does that prove? Only that I am using an LLM poorly and/or do not understand what it is. Using OpenChat-3.5 for what LLMs are actually good at (e.g. asking it for shell commands to perform certain operations, getting some general information about a topic) seems to work surprisingly well for a 7B model.
[ Parent
| on HN ]
Re:Exponentially Faster Language Modelling
by sorokod on Thursday November 23, 2023 @02:04AM
(#38390200)
Not sure what you mean by 'using'. The prompt is from one of the benchmarks used in scoring LLM models - don't recall which. Here is another from BBH [1]:
>>> (-1 + 2 + 9 * 5) =
... (-1 + 2 + 9 * 5) = 43
Re:Exponentially Faster Language Modelling
by GaggiX on Thursday November 23, 2023 @04:03AM
(#38390871)
This is even worse than the other, just straight up use a calculator.
Re:Exponentially Faster Language Modelling
by freilanzer on Thursday November 23, 2023 @04:59AM
(#38391177)
The use isn't the calculation, but the benchmark for its arithmetic capability.