News for hackers. Stuff that matters.

A comment on GPT-4o. Parent comment

Re:GPT-4o by pants2 on Monday May 13, 2024 @01:57PM (#40346198)
However, this looks like it only works with speech - i.e. you can't ask it, "What's the tune I'm humming?" or "Why is my car making this noise?"

I could be wrong but I haven't seen any non-speech demos.

[ Parent | on HN ]
Re:GPT-4o by cube2222 on Monday May 13, 2024 @01:59PM (#40346233)
Fwiw, the live demo[0] included different kinds of breathing, and getting feedback on it.

[0]: https://youtu.be/DQacCB9tDaw?t=557

[ Parent | on HN ]
Re:GPT-4o by throwaway11460 on Monday May 13, 2024 @02:00PM (#40346251)
What about the breath analysis?
[ Parent | on HN ]
Re:GPT-4o by pants2 on Monday May 13, 2024 @02:32PM (#40346625)
I did see that, though my interpretation is that breathing is included in its voice tokenizer which helps it understand emotions in speech (the AI can generate breath sounds after all). Other sounds, like bird songs or engine noises, may not work - but I could be wrong.
[ Parent | on HN ]
Re:GPT-4o by CooCooCaCha on Monday May 13, 2024 @05:41PM (#40348838)
I suspect that like images and video, their audio system is or will become more general purpose. For example it can generate the sound of coins falling onto a table.
[ Parent | on HN ]
Re:GPT-4o by genewitch on Monday May 13, 2024 @02:22PM (#40346512)
allegedly google assistant can do the "humming" one but i have never gotten it to work. I wish it would because sometimes i have a song stuck in my head that i know is sampled from another song.
[ Parent | on HN ]