Until NLP can create a short-term memory model to retain info on prior utterances, Alexa's comprehension will be limited to self-contained single phrases -- spells and incantations.
Transformers can fit about 4000 tokens in the context window. That's a lot of dialogue rounds. The problem is these models are too expensive to offer at scale.
We almost never get to see the latest AI in big corporation products. It is always AI from a couple generations ago that is cheaper to run. When we get the latest and greatest, like GPT-3 and DallE, then it's super expensive to use, not free.
Wonder what's blocking that from being applied to systems like Alexa.
You (Amazon) don't want your precious little bot say random things that land you in the press. And oh, GPT-3 will.
Point two is that models that can be goaded to a specific place. So you'll need to account for that too, or... oh look, press.
Point 3 is that they're trained on the Internet at large, and you don't want that in your house :)
It's a lot easier to converse gracefully than to add useful info to a conversation.
This is essentially what has made past intelligent assistants so dysfunctional (like Microsoft's Clippy). They couldn't model cognitive concepts like 'relevant', 'interesting', or 'necessary' relative to the active topic.
FSD's feasibility has been overhyped by Musk for years. It's not an impossible technology but it's also not one you can just bang together with some shitty webcams hoping AI will somehow make everything right.
Technology doesn't improve on its own. It's developed by people that have motivations and limited by engineering prowess and physics. Tesla's FSD is still hype because they're incentivized to get your check for FSD and hand you an IOU. Amazon's current offering is an advertising/surveillance vehicle that does those jobs so they're not incentivized to improve it.
"Doing the impossible behind schedule"
You input a full phrase and the search is processed, trying to guess what you exactly meant. Alexa apps only get more latitude by allowing series of phrases.
But looking at Google Search, we see that even with all the money research and devs in the world that model stays fundamentally limited and only properly works for the simplest tasks.
Beyond that you’d need precise feedback on what Alexa is doing, and ability to micro adjust accordingly. Like when talking to someone and adjusting our sentences mid-speech as we realize the person in front of us isn’t properly understanding what we’re saying.