News for hackers. Stuff that matters.

A comment on OpenAI declares 'code red' as Google catches up in AI race. Parent comment

Re:OpenAI declares 'code red' as Google catches up in AI race by HDThoreaun on Tuesday December 02, 2025 @10:51PM (#46130120)
The open models suck. AWS hosts them for less than closed models cost but no ones uses them, because they suck.
[ Parent | on HN ]
Re:OpenAI declares 'code red' as Google catches up in AI race by rglullis on Wednesday December 03, 2025 @05:01AM (#46132605)
It's not the open models that suck, it's the infrastructure around them. None of current "open weights providers" have:

   - good tools for agentic workflows
   - no tools for context management
   - infrastructure for input token caching
These are solvable without having to pay anything to OpenAI/Anthropic/Google.
[ Parent | on HN ]
Re:OpenAI declares 'code red' as Google catches up in AI race by threeducks on Wednesday December 03, 2025 @06:18AM (#46133175)
Why would the open weights providers need their own tools for agentic workflows when you can just plug their OpenAI-compatible API URL into existing tools?

Also, there are many providers of open source models with caching (Moonshot AI, Groq, DeepSeek, FireWorks AI, MiniMax): https://openrouter.ai/docs/guides/best-practices/prompt-cach...

[ Parent | on HN ]
Re:OpenAI declares 'code red' as Google catches up in AI race by rglullis on Wednesday December 03, 2025 @07:46AM (#46133869)
> when you can just plug their OpenAI-compatible API URL into existing tools?

Only the self-hosting diehards will bother with that. Those that want to compete with Claude Code, Gemini CLI, Codex et caterva will have to provide the whole package and do it a price point that is competitive even with low volumes - which is hard to do because the big LLM providers are all subsidizing their offerings.

[ Parent | on HN ]