Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by xen2xen1 on Wednesday May 31, 2023 @07:28AM
(#36137050)
John Conner, is that you?
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by ddalex on Thursday June 01, 2023 @04:29AM
(#36148735)
My understanding is that the image data used a decoder-only stage, i.e. mapping images to tokens, basically taking the image textual description instead of the actual pixels so it can't "see" but can understand the "narration of an image"
GPT-4 was trained on image data. Besides gaining understanding of image content it also showed improved language abilities over a GPT-4 trained with only text. Facebook is working on a smaller model with text, image, video, audio, lidar depth, infrared heat, and 6-axis motion data. If a GPT-4 was trained with data like that, what capabilities would it have? Rumor says we will know in a few months.