News for hackers. Stuff that matters.
Re:Gradient AI Releases 1M Context Llama 8B by segmondy on Monday April 29, 2024 @05:56PM (#40204590)
No you can't, KV buffer and compute buffer goes up as context window goes up.

There are no comments on this comment yet.