News for hackers. Stuff that matters.

A comment on MiniGPT-4. Parent comment

Re:MiniGPT-4 by eternauta3k on Monday April 17, 2023 @02:52PM (#35604897)
Interesting, so the LLM is "just" getting your question plus a normal text description of the image (as vectors)?
[ Parent | on HN ]
Re:MiniGPT-4 by thewarrior on Monday April 17, 2023 @06:59PM (#35607775)
At a high level yes.

More precisely - It gets the question After irs passed through a matrix that transforms the text description of the image so the LLM can “understand” it.

It maps from the space of one ML model to the other.

[ Parent | on HN ]