News for hackers. Stuff that matters.
Re:Amazon saves millions by replacing Sonnet 4.6 with Strand... by 9rx on Tuesday November 10, 2026 @04:17AM (#50437870)
> LLM's power comes with it being a monolith.

Does it? All the latest frontier models that have made technical details publicly available are using MoE; smaller specialized units that work together.

Re:Amazon saves millions by replacing Sonnet 4.6 with Strand... by nixon_why69 on Tuesday November 10, 2026 @05:48AM (#50438486)
Yeah but they're all trained together along with their gate tensor. Evaluating a moderate length prompt pulls in most/all of them.