News for hackers. Stuff that matters.

A comment on Gemini: Google's most capable AI model yet. Parent comment

Re:Gemini: Google's most capable AI model yet by TaylorAlexander on Wednesday December 06, 2023 @07:08PM (#38551207)
Ah that’s right. I guess my question is, is it a true multimodal model (able to produce arbitrary audio) or is it a speech to text system (OpenAI has a model called Whisper for this) feeding text to the model and then using text to speech to read it aloud.

Though now that I am reading the Gemini technical report, it can only receive audio as input, it can’t produce audio as output.

Still based on quickly glancing at their technical report it seems Gemini might have superior audio input capabilities. I am not sure of this though now that I think about it.

[ Parent | on HN ]
Re:Gemini: Google's most capable AI model yet by sho_hn on Wednesday December 06, 2023 @08:22PM (#38551717)
One of the demo videos explicitly addresses this point: https://youtu.be/D64QD7Swr3s?si=_bBa9aPmqGbo-Iej
[ Parent | on HN ]
Re:Gemini: Google's most capable AI model yet by TaylorAlexander on Wednesday December 06, 2023 @10:41PM (#38552579)
Oh that’s actually pretty good then. It also seems it does output audio despite the PDF from google I was reading saying otherwise. Hmm.
[ Parent | on HN ]