(This is why a non-native speaker can do this job well, you don't need to know a lot of the language to parse orders like 芥兰牛肉)
I think this would lead to a lot of really frustrating errors in a food ordering context. In my experience LLM speech recognition is really prone to inserting or removing negation words, which can really shift the meaning. This is a problem in any speech recog use case but there's often sufficient context to understand when the error has occurred. In a list of what a customer does / doesn't want, there is no additional context to fill the gap.
"Cheeseburger with ketchup mustard onion no tomato" -> "Cheeseburger with ketchup mustard onion tomato" or the inversion
You can correct this to some degree with an order confirmation step but the error rate would mean a lot of customers need to make a correction, which adds time to the process and increases customer frustration.
At that point I'd rather the drive thru have a touchscreen and just let me input the order directly, versus having to argue with an LLM about which ingredients i want included or excluded.
Speaking of which, we stopped going to fast food burger places because 75% of them can’t make things like “a hamburger with no cheese or any other toppings except ketchup”, or “a cheeseburger with no other toppings”.
I suspect an LLM that supports audio input would outperform most drive through window attendants.
Oddly, I’ve noticed there is no correlation between speaking english as a first language and being able to understand those orders.