Re:Emerging Architectures for LLM Applications
by sourcelabs on Wednesday June 21, 2023 @11:43AM
(#36420014)
The accuracy degrades with a larger context size, as pointed out in the article itself:
> Claude offers fast inference, GPT-3.5-level accuracy, more customization options for large customers, and up to a 100k context window (though we’ve found accuracy degrades with the length of input).
> Claude offers fast inference, GPT-3.5-level accuracy, more customization options for large customers, and up to a 100k context window (though we’ve found accuracy degrades with the length of input).