News for hackers. Stuff that matters.

A comment on Outperforming LLMs with less training data and smaller model sizes. Parent comment

Re:Outperforming LLMs with less training data and smaller mo... by sandpaper26 on Friday September 22, 2023 @08:01AM (#37610853)
After some reflection, it's maybe more accurate to visualize this in reverse: all expert models see the problem and attempt a solution, and then some "manager" model decides which expert model has the best solution and outputs it.
[ Parent | on HN ]
Re:Outperforming LLMs with less training data and smaller mo... by liquidpele on Friday September 22, 2023 @08:41AM (#37611245)
Until the manager model decides to outsource the expert models.
[ Parent | on HN ]