Re:ChatGPT can now see, hear, and speak – openai.com
by gwd on Monday September 25, 2023 @08:46AM
(#37642853)
In retrospect, such startups should have been wary: they should have known that OpenAI had Whisper, and also that GPT-4 was designed with image modality. I wouldn't say that OpenAI "telegraphed" their intentions, but the very first strategic question should have been, "Why isn't OpenAI doing this already, and what do we do if they decide to start?"
[ Parent
| on HN ]
Re:ChatGPT can now see, hear, and speak – openai.com
by Tenoke on Monday September 25, 2023 @09:02AM
(#37643089)
>I wouldn't say that OpenAI "telegraphed" their intentions
They did telegraph it, they showed the multimodal capabilities back in the GPT4 Developer Livestream[0] right before first releasing it.
Re:ChatGPT can now see, hear, and speak – openai.com
by makestuff on Monday September 25, 2023 @09:45AM
(#37643724)
Yeah I remember watching that and thinking oh I know a cool app idea. What if you just take a video of what food is in your kitchen and Chat GPT will create a recipe for you. I go to the docs and that was literally the example they gave.
I think the only place where plugins will make sense are for realtime things like booking travel or searching for sports/stock market/etc type information.
Re:ChatGPT can now see, hear, and speak – openai.com
by tornato7 on Monday September 25, 2023 @07:25PM
(#37652157)
I have a home-spun version of ChatGPT that uses function calling to connect to my emails, calendar, and notes. This is really useful because I can say "Bob just emailed me to set up a call. Respond to Bob with some available times from my calendar."
That will be the real use case for plug ins.
Re:ChatGPT can now see, hear, and speak – openai.com
by gzer0 on Monday September 25, 2023 @09:36AM
(#37643586)
It is interesting that these startups did not recognize that the image modalities already existed, as evidenced by their initial GPT-4 announcement underneath “visual capabilities”
[1].
Re:ChatGPT can now see, hear, and speak – openai.com
by shanusmagnus on Monday September 25, 2023 @09:35AM
(#37643570)
It would hard to be more explicit than doing a demo of multi-modality in GPT-4, and having an audio API that is amazing and that you can use right now, for pennies.
It would be interesting to know if this really changed anything for anyone (competitors, VCs) for that reason. It's like the efficient market hypothesis applied to product roadmaps.