Command A: Max performance, minimal compute – 256k context window

Re:Command A: Max performance, minimal compute – 256k contex... by razemio on Sunday March 16, 2025 @06:05AM (#43377905)

I distrust those benchmarks after working with sonnet for half a year now. Many OpenAI models beat Sonnet on paper. This seems to be the case because it's strength (agent, visual, caching) aren't being used, I guess? Otherwise there is no explanation why it's not constantly on top. I have tried so many times to use other models for various tasks, not only coding. The only thing where OpenAI accelerates is analytic tasks at a much higher price. Everything else sonnet works for me the best and Gemini Flash 2.0 for cost effective and latency relevant tasks.

In practice this perception of mine seems to be valid: https://openrouter.ai/models?order=top-weekly

The same with this model. It claims to be good at coding but it seriously isn't compared to sonnet. Funny enough it isn't being tested against.

[ Parent | on HN ]

Re:Command A: Max performance, minimal compute – 256k contex... by esperent on Monday March 17, 2025 @05:16AM (#43386517)

> In practice this perception of mine seems to be valid: >https://openrouter.ai/models

According to your link, there's two providers (Chutes and Targon) offeri Deepseek R1 API access completely free of charge.

Is that true? Can't see any info about usage limits.

Is that

[ Parent | on HN ]

Re:Command A: Max performance, minimal compute – 256k contex... by razemio on Monday March 17, 2025 @11:35AM (#43389630)

That is true and it works. Response times however are worse compared to the paid ones. If this is not a concern it works really well.

[ Parent | on HN ]