Input to GPT Matters a Lot

Re:Input to GPT Matters a Lot by dougmwne on Monday April 03, 2023 @11:52AM (#35425884)

What the heck is real reasoning with unlimited memory? Human minds are quite limited! Our short term context length is certainly not 30k words. Most psychological research says it’s about 7 items.

[ Parent | on HN ]

Re:Input to GPT Matters a Lot by pwinnski on Monday April 03, 2023 @02:32PM (#35429025)

Wow, this is conflating things that are not the same in an incredibly misleading way.

Hey, that was 15 words, and I had them all in my head at once before I started typing! I was able to form a sentence of more than seven words all by myself!

You seem to be misapplying the concept of working memory, where seven (plus or minus two) is about arbitrary and unrelated words or numbers, not "items." In fact, it's generally seven for numbers, but lower for words. And again, that's unrelated words, like "person woman man camera tv," but probably even more unrelated.

[ Parent | on HN ]

Re:Input to GPT Matters a Lot by dougmwne on Monday April 03, 2023 @02:54PM (#35429389)

Did you really have those 15 words in your head all at once or did you just predict 15 next words that would form a good reply to my words?

[ Parent | on HN ]

Re:Input to GPT Matters a Lot by pwinnski on Monday April 03, 2023 @03:07PM (#35429583)

Again, that's not how "working memory" works in the research. "Working memory" is considered over a time span of minutes, not fractional seconds.

[ Parent | on HN ]