News for hackers. Stuff that matters.

A comment on Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models. Parent comment

Re:Gemini in Reasoning: Unveiling Commonsense in Multimodal ... by a2128 on Wednesday January 03, 2024 @05:14PM (#38860593)
I don't think it would necessarily be embarrassing for Google because Gemini Pro is multimodal, while GPT-3.5 Turbo is text-only. Given this difference it wouldn't seem too unrealistic to me if Gemini Pro was bigger, but it seems like we just don't know.
[ Parent | on HN ]
Re:Gemini in Reasoning: Unveiling Commonsense in Multimodal ... by coder543 on Wednesday January 03, 2024 @05:27PM (#38860730)
Being multimodal doesn’t seem to require much of a size penalty: https://github.com/dlyuangod/TinyGPT-V

Even so, Google treats the Gemini Pro Vision model as a separate model from Gemini Pro, so it could have separate parameters that are dedicated to vision (like CogVLM does), and that wouldn’t impact the size of the model as far as text-tasks are concerned.

[ Parent | on HN ]