Re:Mixtral 8x22B
by jakderrida on Wednesday April 17, 2024 @06:07PM
(#40070568)
While you're 100% correct, they are working on ways to make the middle useful, such a "Needle in a Haystack" testing. When we say we wish for context length that large, I think it's implied we mean functionally. But you do make a really great point.
[ Parent
| on HN ]
There are no comments on this comment yet.