Re:Ask HN: Why Haven't Tech Giants Integrated LLMs in Their ...
by senttoschool on Friday June 16, 2023 @06:33AM
(#36354311)
I'd imagine that it's fairly straightforward for an advanced LLM to produce structured instructions from the user's requests? As long as the LLM knows what the available commands are.
I'm quite certain that Amazon and the others will be putting a lot of time into investigating this avenue, it's just not ready for rollout yet. I'm looking forward to it - I have an Echo and it definitely does use a lot of fuzzy matching to understand basic rewording of queries, but it's still very much a limit set of defined "functions", just with a fuzzy call site. The user has to handle the breaking down of their high-level intent into small requests from those primitives, and keep all the "variables" in their head and pass them to each "function call". Smarter assistants that can remember context is something that's been worked on and allegedly deployed almost since the start, but ChatGPT is the only thing I've seen that lives up to the promise in the real world
[1] https://news.ycombinator.com/item?id=36330972