Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Gemini 4 Hydrogen.
My use case benchmarks 37% more expensive per task but 40-60% of the total time per task (median and p90 had the same improvement).
Both models were smart enough to complete all eval tasks, speed was the main thing we were struggling with. Both models on medium reasoning.
Overall feels like a good upgrade.
There are no comments on this comment yet.
My use case benchmarks 37% more expensive per task but 40-60% of the total time per task (median and p90 had the same improvement).
Both models were smart enough to complete all eval tasks, speed was the main thing we were struggling with. Both models on medium reasoning.
Overall feels like a good upgrade.