News for hackers. Stuff that matters.

A comment on Introducing GPTs. Parent comment

Re:Introducing GPTs by danielbln on Monday November 06, 2023 @03:21PM (#38168395)
It doesn't, but semantic search is a lot less relevant if you can squeeze 350 pages of text into the context.
[ Parent | on HN ]
Re:Introducing GPTs by quinncom on Monday November 06, 2023 @04:55PM (#38169586)
OpenAI charges for all those input tokens. If an app requires squeezing 350 pages of content in every request is going to cost more. Vector DB still relevant for cost and speed.
[ Parent | on HN ]
Re:Introducing GPTs by gk1 on Monday November 06, 2023 @09:18PM (#38172359)
Besides the cost factor, stuffing the context window can actually make the results worse. https://www.pinecone.io/blog/why-use-retrieval-instead-of-la...
[ Parent | on HN ]