Re:Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearl...
by redlock on Saturday April 05, 2025 @02:50PM
(#43595793)
Doesn't OpenRouter ranking include pricing?
Not really a good measure of quality or performance but of cost effectiveness
Re:Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearl...
by mbesto on Saturday April 05, 2025 @03:38PM
(#43596234)
I mean it literally says on the page:
"Shown are the sum of prompt and completion tokens per model, normalized using the GPT-4 tokenizer."
Also, it ranks the use of Llama that is provided by cloud providers (for example, AWS Lamda).
I get that OpenRouter is imperfect but its a good proxy to objectively make a claim that an LLM is "the weakest ever"
Re:Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearl...
by kristianp on Saturday April 05, 2025 @08:23PM
(#43597941)
I've found the llama 3 served by meta.ai to be quite weak for coding prompts, it gets confused by more complex tasks. Maybe its a smaller model? I agree it's weaker than others of its generation.
1. Weakest ever LLM? This one is really making me scratch my head. For a period of time Llama was considered to THE best. Furthermore, it's the third most used on OpenRouter (in the past month): https://openrouter.ai/rankings?view=month
2. Ignoring DeepSeek for a moment, Llama 2 and 3 require a special license from Meta if the products or services using the models have more than 700 million monthly active users. OpenAI, Claude and Gemini are not only closed source, but require a license/subscription to even get started.