Re:Large Language Models: Scaling Laws and Emergent Properties
by lucubratory on Wednesday April 26, 2023 @08:56PM
(#35721938)
If that's actually true, please publish it. A blog post will do, it'll probably get popular and force a scientist to reproduce it.
> This is why I am pretty sure you're trolling. This is a lot like saying "You can make GPT-4 do prime factorisation of a semiprime by noting the constituent primes." The point of testing the model is to see if the model can give you the answer, not to give it the answer.
It is not "giving the answer to the model" if you adjust the prompt with additional instructions like "this is a test question" or "use common sense". It is about creating the correct frame of context. With these kind of adjustments GPT-4 passes every novel Winograd scheme I have presented it with.