I’m a little skeptical of processes that seem to create more information than you had to start with. For a game like chess or Go, it makes sense, because winning strategies are implicit in the rules of the game, but it takes a lot of computation to discover the consequences. Similarly for math where theorems are non-obvious consequences of axioms. And computer code can be similar to math.

But how does that work for an LLM in general? They’re trained on everybody’s opinions all at once, both right and wrong answers. They’re trained to generate text supporting all sides of every argument. What does more training on derived text actually do?

The larger models generate high quality textbook-like synthetic data which is used to develop the model's reasoning skills. Microsoft's Phi series is a demonstration of this. These models do not have the ability to absorb and retain a lot of factual knowledge due to the low parameter count. However, they do have the ability to reason as well as larger models, which means these models perform best when most of the factual stuff is provided in context.

Sounds like you're describing mixture of experts, the architecture being used in openai's gpt-4 and mistral's mixtral series of models.

Not really, MoE is trained all at once and the 'experts' don't have pre-defined specializations. They end up being more like "punctuation expert" and "pronoun expert" than "math expert" and "french expert"

Haven't tried any yet, but it sounds like parent may be interested in an LLM router. https://github.com/lm-sys/RouteLLM

I have posited a similar idea with some of the people I work with. The issue of having complex, multi-step tasks be completed successfully has already been solved. You don't heavily invest in having one single expert for your business to solve all your problems. You build a team. Multiple specialized experts working in unison to achieve a shared outcome. Some people work on the task simultaneously, others sequentially. All with a specific purpose associated with the goal.

These assets are horizontally and vertically scalable based off skills, quality, or performance required. An efficiently designed AI architecture I believe could do the same. Its not mixture-of-experts as you aren't necessarily asking each model simultaneously but designing and/or having the system intelligently decide when it has completed its task and where the output should travel next.

Think of a platform where you had 'visual design' models, 'coding' models, 'requirements' models, 'testing' models, all wired together. The coding models you incorporate are trained specifically for the languages you use, testing the same. All interchangeable / modularized as your business evolves.

You feed in your required outcome at the front of your 'team' and it funnels through each 'member' before being spit out the other end.

I have yet to see anyone openly discussing this architecture pattern so if anyone could point me in that direction I would thoroughly appreciate it.