Re:Ask HN: How to get back into AI?
by steve_adams_86 on Saturday December 10, 2022 @10:11AM
(#33933244)
Is LLM even applicable to many things though? If we want more nuanced and contextual vision, does LLM help?
[ Parent
| on HN ]
Multimodal models are also a red hot area. The interesting thing might be to combine specialized instances of LLMs and other models together, where each runs a specific subtask or event processing loop.
I think it'd be fun to use vision models to pick up the interesting parts of an image, describe only the high-yield context as English text, and put them in a sort of Unix pipeline or node graph to connect it to other models that can input/output text. With fine-tuned or prompt-engineered LLMs as the intelligent centerpiece.
Fine tuning models is where the future will be, it doesn’t necessarily mean LLMs but I suspect that LLMs will shortly become multi modal and at that point they will be the ultimate models to fine tune for a given task
Thanks for the comment.
>Fine tuning models is where the future will be
Who would request fine tuning? Businesses?
Are you suggesting to build some sort of data set broker?
Businesses who have their own data fine tune trained models (this is already a thing). So you need model repositories (like hugging face) not dataset brokers.
Re:Ask HN: How to get back into AI?
by PartiallyTyped on Saturday December 10, 2022 @02:17PM
(#33935792)
The LLM component is almost correct, but not exactly. The whole point is the transformer architecture, which really is just graph neural networks. Once you start seeing things through these lenses, the possibilities are endless and it starts making sense.