News for hackers. Stuff that matters.
Re:Mistral Large by onlyrealcuzzo on Monday February 26, 2024 @02:37PM (#39515889)
Which - importantly - is better than Mistral at 81.2% ...

Gemini Ultra scored 90% which is better than GPT-4.

This reads like a paid-for press release from Microsoft to pretend like they're almighty and Google is incompetent.

Re:Mistral Large by 7moritz7 on Monday February 26, 2024 @06:03PM (#39517906)
Didn't Gemini 1.0 Ultra turn out to be worse than GPT 4 Turbo in practice? Synthetic benchmarks aren't a perfect representation of anything.
Re:Mistral Large by maleldil on Tuesday February 27, 2024 @04:13AM (#39521889)
I think they're close enough that it depends on your use case. IME, which is mostly generating Python and shell code, Gemini Advanced is faster, less lazy and generates overall better solutions than GPT-4. It also seems to be more up-to-date with libraries and stuff. It can also directly go to URLs (e.g. summarise a paper), which GPT-4 refuses to do.