Re:Amazon saves millions by replacing Sonnet 4.6 with Strand...
by heggy on Tuesday November 10, 2026 @03:57AM
(#50437737)
Isn't this just the Bitter Lesson over and over again? Specialised approaches get outperformed by more compute and a simpler general approach pretty much every time.
[ Parent
| on HN ]
Re:Amazon saves millions by replacing Sonnet 4.6 with Strand...
by try-working on Tuesday November 10, 2026 @05:17AM
(#50438253)
Bitter lesson is wrong. Large general models are outperformed by small specialized models.
Re:Amazon saves millions by replacing Sonnet 4.6 with Strand...
by 9rx on Tuesday November 10, 2026 @06:27AM
(#50438810)
The Bitter Lesson makes no distinction between large general models and small specialized models, assuming they are both trained from data.
The Bitter Lesson is that human-written rule models will always lose out to trained models in the end.