News for hackers. Stuff that matters.
Re:GPT-4 performs better at Theory of Mind tests than actual... by lucasknight on Sunday April 30, 2023 @06:34PM (#35767181)
I'm genuinely curious to find out whether anybody is surprised by this given that it's a language model that has been trained on almost all of the information and the data on the internet will beat human accuracy on tests - computers can retain memories and data a lot better than humans can and models like these simply have a lot more non-unique information than humans have consumed in their lifetimes.
Re:GPT-4 performs better at Theory of Mind tests than actual... by fl7305 on Sunday April 30, 2023 @07:45PM (#35767600)
If GPT-4 has 10 terabytes (10^13) of stored memories, how long are the sentences it has stored if there are 100 (10^2) different words to choose from?

Wouldn't that be a table of sentences less than 7 words long?

100^7 = (10^2)^7 = 10^14