News for hackers. Stuff that matters.
Re:Things we learned about LLMs in 2024 by simonw on Tuesday December 31, 2024 @07:59PM (#42563096)
No, it's not. I've not seen any local models that can handle 1m+ tokens.

I haven't actually done many experiments with long context local models - I tend to hit the hosted API models for that kind of thing.

There are no comments on this comment yet.