News for hackers. Stuff that matters.
Re:Ask HN: How to get back into AI? by tux3 on Saturday December 10, 2022 @10:26AM (#33933373)
Multimodal models are also a red hot area. The interesting thing might be to combine specialized instances of LLMs and other models together, where each runs a specific subtask or event processing loop.

I think it'd be fun to use vision models to pick up the interesting parts of an image, describe only the high-yield context as English text, and put them in a sort of Unix pipeline or node graph to connect it to other models that can input/output text. With fine-tuned or prompt-engineered LLMs as the intelligent centerpiece.

There are no comments on this comment yet.