News for hackers. Stuff that matters.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model) by mythz on Saturday December 14, 2024 @10:04PM (#42421175)
Yeah I'm currently using Gemini 2 Flash (exp) free quota for a premium hosted model, it's a surprisingly great model, IMO Google has caught up with the leaders with their latest experimental models. I've also tested Nova's models, which are pretty high quality and exception value (lite/micro) for their performance.

Also worth shouting out you can get Meta's latest llama-3.3:70b (comparable to llama3.1:405b but must faster and cheaper) within GroqCloud's free quotas running at an impressive 276 tok/s.

There are no comments on this comment yet.