Re:AGI Is Not Multimodal
by robwwilliams on Wednesday June 04, 2025 @03:25PM
(#44184525)
Interesting article but incomplete in important ways. Yes correct that embodiment and free-form interactions are critical to moving toward AGI, but what is likely much more important are supervisory meta-systems (yet another module) that enable self-control of attention with a balance integration of intrinsic goals with extrinsic perturbations. It is this nominally simple self-recursive control of attention that is what I regard as the missing ingredient.
Possibly. Meta's HPT work sidesteps that issue neatly. Will it lead to AGI? Who the heck knows, but it does not need a meta system for that control.
Re:AGI Is Not Multimodal
by robwwilliams on Saturday June 07, 2025 @01:55PM
(#44211307)
Yep good point. One could argue about whether this is more a terminological distinction or a difference architecture. Certain shared objectives.
Yeah, I found this article to be fascinating and there's a lot of important stuff in it. It really does feel like more people stopped at the title and missed the meat of it.
I know this is a very long article compared to a lot of things posted here, but it really is worth a thorough read.
Re:AGI Is Not Multimodal
by dirtyhippiefree on Wednesday June 04, 2025 @01:04PM
(#44182914)
Agreed, but most people are likely to look at the long title and say TL;DR…
Maybe a more descriptive but longer title would be: AGI will work with multimodal inputs and outputs embedded in a physical environment rather than a frankenstein combination of single-modal models (what today is called multimodal) and throwing more computational resources at the problem (scale maximalism) will be improved with thoughtful theoretical approaches to data and training.