Margaret Atwood Reviews a Margaret Atwood Story by AI

Re:Margaret Atwood Reviews a Margaret Atwood Story by AI by inciampati on Sunday October 15, 2023 @10:32PM (#37895377)

But we do manage to remember stuff that happened "quadrillions" of tokens (of sensory input) back. Sure, we are wrong a lot, but we have a context that goes way back. A LLM has a fruit fly's version of what we work with, although in some versions it has perfect recall in that context.

[ Parent | on HN ]

Re:Margaret Atwood Reviews a Margaret Atwood Story by AI by seanthemon on Monday October 16, 2023 @01:34AM (#37896233)

Or it can be said that we boil down our experience to a few millions of tokens, only a set of experiences, emotions and often wrong/made up memories.

Your comment assumes a human can recall all (potentially incorrect) memories and use those to make some judgement, but fact of the matter is we don't.

[ Parent | on HN ]

Re:Margaret Atwood Reviews a Margaret Atwood Story by AI by FrustratedMonky on Monday October 16, 2023 @01:25PM (#37903164)

Yeah, Humans do ton of aggregation and filtering. Thus you can't remember individual days of commuting, because it is so similar, the brain just lets it go.

I'd think something like this would be added to the models eventually. Of course, over-simplifying.

[ Parent | on HN ]