Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Multi-modal prompt injection image attacks against GPT-4V. Parent comment
I don't think it's accurate to think of the image processing as a separate pipeline here, similar to OCR on object detection.
My understanding is that the image is treated the same as the text - it's all input into the weird giant matrices of numbers that makes up the model.
GPT4-V isn't GPT4 plus tools for analyzing images: it's GPT4 with image processing built right into the model itself.
Is it even right to call it a "Large Language Model" at this point? I'm not sure.
I don't think it's accurate to think of the image processing as a separate pipeline here, similar to OCR on object detection.
My understanding is that the image is treated the same as the text - it's all input into the weird giant matrices of numbers that makes up the model.
GPT4-V isn't GPT4 plus tools for analyzing images: it's GPT4 with image processing built right into the model itself.
Is it even right to call it a "Large Language Model" at this point? I'm not sure.