News for hackers. Stuff that matters.

A comment on Gemma 4 12B: A unified, encoder-free multimodal model. Parent comment

Re:Gemma 4 12B: A unified, encoder-free multimodal model by aesthesia on Wednesday June 03, 2026 @06:07PM (#48390796)
Audio is 1 dimensional so the usual RoPE position encoding should handle it like it does for text tokens. You only need extra position encoding for higher-dimensional stuff like images.
[ Parent | on HN ]

There are no comments on this comment yet.