News for hackers. Stuff that matters.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by flangola7 on Wednesday May 31, 2023 @01:37AM (#36134848)
There is much more out there than text. Audio, visual, touch, smell. Text isn't something humans directly train on, but representations of text from our senses.

GPT-4 was trained on image data. Besides gaining understanding of image content it also showed improved language abilities over a GPT-4 trained with only text. Facebook is working on a smaller model with text, image, video, audio, lidar depth, infrared heat, and 6-axis motion data. If a GPT-4 was trained with data like that, what capabilities would it have? Rumor says we will know in a few months.

Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by xen2xen1 on Wednesday May 31, 2023 @07:28AM (#36137050)
John Conner, is that you?
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by ddalex on Thursday June 01, 2023 @04:29AM (#36148735)
My understanding is that the image data used a decoder-only stage, i.e. mapping images to tokens, basically taking the image textual description instead of the actual pixels so it can't "see" but can understand the "narration of an image"