News for hackers. Stuff that matters.
Re:Omnio: First AI model that can natively reason over audio by lukax on Tuesday October 15, 2024 @10:55AM (#41849272)
We built Omnio to address the limitations we kept running into with existing audio AI models (we previously built an automatic speech recognition product). Most of them rely heavily on speech-to-text, which strips out a lot of the things like speaker roles, emotions and non-verbal cues that are critical in more complex scenarios. Omnio directly processes audio signals to capture that kind of context. It's designed to understand conversations in a way that feels more "human."
Re:Omnio: First AI model that can natively reason over audio by barrenko on Thursday October 17, 2024 @02:56AM (#41867097)
So this is speech-to what? You're kinda missing that in your info. Are you guys based in USA or Ljubljana?
Re:Omnio: First AI model that can natively reason over audio by sharpshadow on Tuesday October 15, 2024 @10:37AM (#41849080)
Can this get me the lyrics of rap songs or not?
Re:Omnio: First AI model that can natively reason over audio by overlord_tm on Tuesday October 15, 2024 @10:40AM (#41849108)
Try it out, you get free credits on signup. Worked surprisingly well for me on this example https://www.youtube.com/watch?v=DxkeOkaVRLo
Re:Omnio: First AI model that can natively reason over audio by sharpshadow on Tuesday October 15, 2024 @10:58AM (#41849302)
Yes I saw it thanks and will try it out. On the introduction blog post they said beta only for paid developers but seemingly it’s free for all.
Re:Omnio: First AI model that can natively reason over audio by lukax on Tuesday October 15, 2024 @11:46AM (#41849769)
Whoops. We've updated the website. Omnio is available to all developers and all accounts receive $5.00 in free credits.
Re:Omnio: First AI model that can natively reason over audio by easwee on Tuesday October 15, 2024 @11:11AM (#41849452)
I tried Eminem - Rap God with "transcribe word by word" prompt and it did quite good, I just had to set temperature to 0, else it can get creative.
Re:Omnio: First AI model that can natively reason over audio by LukaFurlan on Tuesday October 15, 2024 @01:20PM (#41850798)
insane release