Re:iPhone 17 Pro Demonstrated Running a 400B LLM
by QuantumNomad_ on Monday March 23, 2026 @04:14PM
(#47494508)
If I only use an LLM to ask questions about programming in one specific programming language, can I distill away other experts and get all the answers I need from a single expert? Or is it still different experts that end up handling the question depending on what else is in the question? For example, if I say “plan a static web server in Rust” it might use expert A for that, but if I say “implement a guessing game in Rust” it might use expert B, and so on?
[ Parent
| on HN ]
Re:iPhone 17 Pro Demonstrated Running a 400B LLM
by Snoozus on Tuesday March 24, 2026 @03:26AM
(#47499526)
Unfortunately no, experts are typically switched out for every token.
The way I understand it the idea was something like having each expert be good at one kind of task, but that's not how it panned out after training.