News for hackers. Stuff that matters.
Re:GPT-4 performs significantly worse on coding problems not... by krackers on Friday March 24, 2023 @11:05PM (#35298867)
It's a good point for text input, but if you go multi-modal and somehow find a way to make good use of audio and video, there's practically unlimited data available.

Also considering that humans will probably still only publish the output that looks good, even that still provides a weak signal on quality.

Re:GPT-4 performs significantly worse on coding problems not... by jprete on Friday March 24, 2023 @11:36PM (#35299050)
I'm skeptical that multimodal input can help with programming or logic problems - or even most scientific problems.
Re:GPT-4 performs significantly worse on coding problems not... by mrbungie on Saturday March 25, 2023 @04:27AM (#35300623)
Having diagrams (think free body diagrams in static mechanics, or a T-s diagram in thermodynamics) make a lot of non-trivial problems a lot simpler to communicate. And correctly understanding an unambiguous definition of a problem is a major step towards solving it.

If language was enough (or a similar idea, that multimodal input is not useful), college math professors wouldn't use so much chalk making drawings and diagrams to explain their ideas.