News for hackers. Stuff that matters.
Re:Mixtral 8x22B by jakderrida on Wednesday April 17, 2024 @06:07PM (#40070568)
While you're 100% correct, they are working on ways to make the middle useful, such a "Needle in a Haystack" testing. When we say we wish for context length that large, I think it's implied we mean functionally. But you do make a really great point.

There are no comments on this comment yet.