Re:Benchmarking GPT-4 Turbo – A Cautionary Tale
by boxed on Thursday November 09, 2023 @09:40AM
(#38205559)
> Also, I don't understand your obsession with the word cheating.
It's all about the rule set yea. Since the rule set is not defined, technically nothing is cheating. I just interpret the rule set as "can it code?" and for this rule set, it seems to me that it's cheating.
Re:Benchmarking GPT-4 Turbo – A Cautionary Tale
by boxed on Thursday November 09, 2023 @09:48AM
(#38205679)
> How much did the first model cheat, and how much did the second? If the second model "cheats" less, then it wins.
They both cheated 100%. Because they both never saw the problem. AT ALL. They just saw the title and the name of the website.
Also, I don't understand your obsession with the word cheating. If you have solved a problem before on a different website and solve it again, did you cheat? Or did you just use your brain to store the solution for later?