News for hackers. Stuff that matters.

A comment on Emerging Architectures for LLM Applications.

Re:Emerging Architectures for LLM Applications by m3kw9 on Tuesday June 20, 2023 @06:59PM (#36411918)
Still relatively simple, the stack being LLM hopefully most of the actual “stack” work will be transferred inside the LLM. Example, if context size becomes unlimited, could do away with vector dbs.
[ Parent | on HN ]
Re:Emerging Architectures for LLM Applications by sourcelabs on Wednesday June 21, 2023 @11:43AM (#36420014)
The accuracy degrades with a larger context size, as pointed out in the article itself:

> Claude offers fast inference, GPT-3.5-level accuracy, more customization options for large customers, and up to a 100k context window (though we’ve found accuracy degrades with the length of input).

[ Parent | on HN ]