News for hackers. Stuff that matters.
Re:The Dual LLM pattern for building AI assistants that can ... by williamtrask on Sunday May 14, 2023 @09:08PM (#35942867)
I believe so - Narrow AI. It seems to be much easier to build than generalist models. Think all the protein folding, game playing, image classifying, machine translating, image captioning, super-intelligent AIs of the last decade. It’s not clear we really need super general models. Even LLMs can be topic specific.
Re:The Dual LLM pattern for building AI assistants that can ... by AaronFriel on Sunday May 14, 2023 @09:17PM (#35942920)
It's unclear if narrow AI is as powerful as multimodal models with tools, as of yet. Is an LLM which has access to narrow AI "tools" strictly more powerful, capable of running experiments or improving itself? See: AutoGPT, Langchain, et al.

I also don't see the basis for believing LLMs can be topic specific without neutering their capabilities. It's the general instruction & tool tuned LLMs which are currently changing our expectations of what these models can do. Is there any evidence for a "topic specific" LLM being useful?

Re:The Dual LLM pattern for building AI assistants that can ... by ShamelessC on Sunday May 14, 2023 @10:09PM (#35943146)
> It's unclear if narrow AI is as powerful as multimodal models with tools, as of yet. Is an LLM which has access to narrow AI "tools" strictly more powerful, capable of running experiments or improving itself? See: AutoGPT, Langchain, et al.

It's probably a spectrum in reality, but I'm quite certain that general LLM's (even when given access to tools) are still considered narrow AI. I can see how that feels pedantic at this point and I myself can think of counterexamples that strain that point of view.

> It's the general instruction & tool tuned LLMs which are currently changing our expectations of what these models can do.

This seems opinionated as well. Instruction tuning is very cool from a UX perspective - but the success of un/self-supervised deep learning is what changed expectations about these models. The ability of deep learning to successfully generalize, interpolate between data points, and even accurate predict compositions of data points it never saw mixed together (e.g. avocado armchair) is absolutely doing the bulk of the work here. That RLHF and tools/plugins even _work_ is because the base model is so robust.

> Is there any evidence for a "topic specific" LLM being useful?

That's a great question. In general, self-supervised learning works best when the distribution your dataset captures is massive (and you have enough data for the model to learn that underlying distribution). So the bottleneck for "topic specific" LLM's is data - and when your humongous web-scrape actually captures more of that data (although it's challenging to filter it out), then yeah - it makes more sense to train the general model and just use it/finetune it for your downstream task.

Distillation of models is relevant here though. If you need a small model that works on a phone, it might be prudent to treat your general model as a teacher for a much smaller student model. Much of that is still active research though.

Re:The Dual LLM pattern for building AI assistants that can ... by usrbinbash on Monday May 15, 2023 @03:39AM (#35944895)
> It’s not clear we really need super general models.

It's also not clear such models are even possible.

Every time I see "alignment" and that whole jazz coming up in any discussion, I can't but wonder if that discussion isn't getting much more attention than needed. Especially since there are very real, very proven, very immediate problems that AI technology poses, that actually need solving.