News for hackers. Stuff that matters.
Re:GPT-5 is behind schedule by BillyTheKing on Monday December 23, 2024 @04:49AM (#42493166)
just a question for understanding - if we say 'it learns', does it mean it actually learns this as part of its training data? or does this mean it's stored in a vector DB and it retrieves information based on vector search and then includes it in the context window for query responses?
Re:GPT-5 is behind schedule by dcre on Monday December 23, 2024 @09:01AM (#42494418)
The latter. “Learning” in the comment clearly refers to adding to the knowledge graph, not about training or fine-tuning a model. “and then you can RAG them.”