News for hackers. Stuff that matters.
Re:Exponentially Faster Language Modelling by sorokod on Thursday November 23, 2023 @02:04AM (#38390200)
Not sure what you mean by 'using'. The prompt is from one of the benchmarks used in scoring LLM models - don't recall which. Here is another from BBH [1]:

>>> (-1 + 2 + 9 * 5) =

... (-1 + 2 + 9 * 5) = 43

[1] https://github.com/suzgunmirac/BIG-Bench-Hard/tree/main

Re:Exponentially Faster Language Modelling by GaggiX on Thursday November 23, 2023 @04:03AM (#38390871)
This is even worse than the other, just straight up use a calculator.
Re:Exponentially Faster Language Modelling by freilanzer on Thursday November 23, 2023 @04:59AM (#38391177)
The use isn't the calculation, but the benchmark for its arithmetic capability.