Re:Claude 3.7 Sonnet and Claude Code
by chvid on Tuesday February 25, 2025 @02:22AM
(#43169155)
They leak the second they are used on a model behind an API, don't they?
[ Parent
| on HN ]
As far as I can tell the only way of doing a comparison of two models, that cannot be easily gamed, is being having them in open weights form and then running them against a benchmark that was created after both of the two models were created.