News for hackers. Stuff that matters.

A comment on GPT-4o. Parent comment

Re:GPT-4o by Aeolun on Monday May 13, 2024 @07:15PM (#40349698)
Dunno if you’d want a conversation partner with the memory of a goldfish though.
[ Parent | on HN ]
Re:GPT-4o by NwpierratorR on Monday May 13, 2024 @07:28PM (#40349788)
Memory is solvable tho.

Either through hacky means via RAG + prompt injections + log/db of interaction history or through context extensions.

IF you have a billion tokens of effective context, you might spent years until it is filled in full.

[ Parent | on HN ]
Re:GPT-4o by a_t48 on Monday May 13, 2024 @07:23PM (#40349756)
This is the case for now, but won't the context window keep getting bigger and bigger?
[ Parent | on HN ]