Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Tell HN: A flood of reports of Opus 5.5 being nerfed.
Do you run evals as a matter of course? Everyone I know that does shows high levels of variance across them under the best case.
That’s not to say that the labs don’t downgrade models at times, just that without any measurement it’s a non-interesting assertion.
There are no comments on this comment yet.
Do you run evals as a matter of course? Everyone I know that does shows high levels of variance across them under the best case.
That’s not to say that the labs don’t downgrade models at times, just that without any measurement it’s a non-interesting assertion.