News for hackers. Stuff that matters.
Re:Vector indexing all of Wikipedia on a laptop by qudat on Wednesday May 29, 2024 @04:19PM (#40516524)
As far as I understand it, context length degrades llm performance, so just because an llm "supports" a large context length it basically just clips a top and bottom chunk and skips over the middle bits.

There are no comments on this comment yet.