News for hackers. Stuff that matters.
Re:ChatGPT can now see, hear, and speak – openai.com by Tenoke on Monday September 25, 2023 @09:02AM (#37643089)
>I wouldn't say that OpenAI "telegraphed" their intentions

They did telegraph it, they showed the multimodal capabilities back in the GPT4 Developer Livestream[0] right before first releasing it.

0. https://youtu.be/outcGtbnMuQ?t=943

Re:ChatGPT can now see, hear, and speak – openai.com by makestuff on Monday September 25, 2023 @09:45AM (#37643724)
Yeah I remember watching that and thinking oh I know a cool app idea. What if you just take a video of what food is in your kitchen and Chat GPT will create a recipe for you. I go to the docs and that was literally the example they gave.

I think the only place where plugins will make sense are for realtime things like booking travel or searching for sports/stock market/etc type information.

Re:ChatGPT can now see, hear, and speak – openai.com by tornato7 on Monday September 25, 2023 @07:25PM (#37652157)
I have a home-spun version of ChatGPT that uses function calling to connect to my emails, calendar, and notes. This is really useful because I can say "Bob just emailed me to set up a call. Respond to Bob with some available times from my calendar."

That will be the real use case for plug ins.