News for hackers. Stuff that matters.
Re:Adept Open Sources 8B Multimodal Modal Fuyu by ekelsen on Wednesday October 18, 2023 @06:36PM (#37935722)
Image patches are projected directly into an embedding that goes into the decoder Transformer. The same thing could be done for audio.

There are no comments on this comment yet.