News for hackers. Stuff that matters.

A comment on Many options for running Mistral models in your terminal using LLM. Parent comment

Re:Many options for running Mistral models in your terminal ... by all2 on Monday December 18, 2023 @11:03PM (#38691675)
Mistral 7b is serviceable for short contexts. If you have a longer conversation, token generation can start to lag a lot.
[ Parent | on HN ]

There are no comments on this comment yet.