Am I using these wrong? I asked a couple git and python questions and it answered it about the same as GPT-4 Turbo (or whatever ChatGPT uses nowadays). The answer was slightly better than GPT-3.5 Turbo in the sense there was a lot of fluff in the GPT-3.5 Turbo's answer.

I tried it. Seems fine. What prompts gave you nonsense?

I tried what Google would call "long tail" queries. Chat GPT-4 gave me accurate answers, but Mistral gave me nonsensical answers. I can't share the exact prompts because they are personally identifying.

And you can't share them and replace the personal information with xxx?

Which size model are you using? Large isn't terribly good, but Next is alright. It's not close at all to GPT-4, but I can see some use cases I'd try it for (and will be).

I haven't tried this model yet (they seem to be under high load). Mistral's previous top model (Mixtral 8x7B) wasn't quite as good as GPT-4, but it seemed close. Clearly way better than GPT 3.5. Many Mixtral responses were better than the GPT-4 ones.