Re:ChatGPT can now see, hear, and speak – openai.com
by makestuff on Monday September 25, 2023 @09:45AM
(#37643724)
Yeah I remember watching that and thinking oh I know a cool app idea. What if you just take a video of what food is in your kitchen and Chat GPT will create a recipe for you. I go to the docs and that was literally the example they gave.
I think the only place where plugins will make sense are for realtime things like booking travel or searching for sports/stock market/etc type information.
Re:ChatGPT can now see, hear, and speak – openai.com
by tornato7 on Monday September 25, 2023 @07:25PM
(#37652157)
I have a home-spun version of ChatGPT that uses function calling to connect to my emails, calendar, and notes. This is really useful because I can say "Bob just emailed me to set up a call. Respond to Bob with some available times from my calendar."
That will be the real use case for plug ins.
They did telegraph it, they showed the multimodal capabilities back in the GPT4 Developer Livestream[0] right before first releasing it.
0. https://youtu.be/outcGtbnMuQ?t=943