News for hackers. Stuff that matters.

A comment on ChatGPT can now see, hear, and speak – openai.com. Parent comment

Re:ChatGPT can now see, hear, and speak – openai.com by iandanforth on Monday September 25, 2023 @02:04PM (#37648060)
Correct, but it's functionally very different from how LLMs are implemented and deployed today. What you're highlighting is being experimented with and ties into ideas like scratch pads, world models, RAG, and progressive fine-tuning (if you're googling).

It's a bit like saying your computer has everything it needs to manipulate photos but doesn't yet have Photoshop installed.

[ Parent | on HN ]
Re:ChatGPT can now see, hear, and speak – openai.com by jameshart on Monday September 25, 2023 @03:02PM (#37648902)
No, I’m not talking about giving LLMs chain of thought prompts or augmenting them with scratchpads - I’m literally saying that in a multilayer neural network you don’t know what concepts activations on the inner layers mean. The result of ‘where I want this conversation to be in 100 tokens time’ could absolutely be in there somewhere.
[ Parent | on HN ]
Re:ChatGPT can now see, hear, and speak – openai.com by iandanforth on Tuesday September 26, 2023 @07:52AM (#37657948)
Ahh. That doesn't found falsifiable. So sure, "could be."
[ Parent | on HN ]