News for hackers. Stuff that matters.

A comment on Google, Nvidia, and OpenAI – Stratechery by Ben Thompson. Parent comment

Re:Google, Nvidia, and OpenAI – Stratechery by Ben Thompson by everdrive on Monday December 01, 2025 @11:58AM (#46109773)
Outside of experience and experimentation, is there a good way to know what models are strong for what tasks?
[ Parent | on HN ]
Re:Google, Nvidia, and OpenAI – Stratechery by Ben Thompson by grahamplace on Monday December 01, 2025 @12:11PM (#46109943)
See: https://lmarena.ai/leaderboard
[ Parent | on HN ]
Re:Google, Nvidia, and OpenAI – Stratechery by Ben Thompson by jasonjmcghee on Monday December 01, 2025 @12:18PM (#46110049)
Unless you overfit to benchmark style scenarios and are worse for real-world use.
[ Parent | on HN ]
Re:Google, Nvidia, and OpenAI – Stratechery by Ben Thompson by jpollock on Monday December 01, 2025 @12:29PM (#46110199)
Not really, it's like asking which C compiler was best back in the 90s.

You had Watcom, Intel, GCC, Borland, Microsoft, etc.

They all had different optimizations and different target markets.

Best to make your tooling model agnostic. I understand that tuned prompts are model _version_ specific, so you will need this anyways.

[ Parent | on HN ]