News for hackers. Stuff that matters.
Re:Adept Open Sources 8B Multimodal Modal Fuyu by abrichr on Wednesday October 18, 2023 @08:24PM (#37936654)
Thank you for the release!

What can you tell us about this:

> Our internal models (based on Fuyu) have extra capabilities related to our product. In particular,

> 1. They can reliably perform OCR on high-resolution images

> 2. They can do fine-grained localization of text and UI elements within those images

> 3. They can answer questions about images of UIs

Is this just a matter of additional fine tuning, or are there architectural differences?

Re:Adept Open Sources 8B Multimodal Modal Fuyu by amks on Thursday October 19, 2023 @01:35AM (#37938880)
Even with experiments with just adding additional fine-tuning, we've seen models gain these capabilities!