News for hackers. Stuff that matters.
Re:GPT-4 performs significantly worse on coding problems not... by jprete on Friday March 24, 2023 @11:36PM (#35299050)
I'm skeptical that multimodal input can help with programming or logic problems - or even most scientific problems.
Re:GPT-4 performs significantly worse on coding problems not... by mrbungie on Saturday March 25, 2023 @04:27AM (#35300623)
Having diagrams (think free body diagrams in static mechanics, or a T-s diagram in thermodynamics) make a lot of non-trivial problems a lot simpler to communicate. And correctly understanding an unambiguous definition of a problem is a major step towards solving it.

If language was enough (or a similar idea, that multimodal input is not useful), college math professors wouldn't use so much chalk making drawings and diagrams to explain their ideas.