News for hackers. Stuff that matters.

A comment on Many options for running Mistral models in your terminal using LLM. Parent comment

Re:Many options for running Mistral models in your terminal ... by eurekin on Monday December 18, 2023 @03:46PM (#38687985)
Why not both? :)

Bait aside, I'd love to read about how are you using those models. I'm mostly interested in code comprehension and meeting summarisation.

[ Parent | on HN ]
Re:Many options for running Mistral models in your terminal ... by simonw on Monday December 18, 2023 @03:50PM (#38688035)
I still mostly use GPT-4 to get actual work done, because until a Mixtral came along it felt like the local models were no competition.

I'm going to bump up my usage of Mixtral a bit now to see how it feels for that kind of stuff.

[ Parent | on HN ]
Re:Many options for running Mistral models in your terminal ... by eurekin on Monday December 18, 2023 @04:04PM (#38688247)
Ah, same here. Have been itching to make some use of those local llms for some time, always ending up in chatgpt as well.

Although for those napkin like ideas gpt4 (including the turbo variant) get costly quickly.

[ Parent | on HN ]