The problem is .. what flows don't need determinism? Search results / recommendation engine / ad targeting ?
Arguably the majority of companies & corporate users are using these tools in cases they expect determinism. Email inbox summaries. Search summaries. What is the value of x queries. You'd be shocked.
My favorite Google AI summary bug/quirk that seems to persist (I just tested it again) - "are Lillies OK for cats". The summary starts with "Yes, lilies are extremely toxic to cats. "
I first hit this with another plant (lavender) where the response was much longer and on an iPhone looked like this:
Yes, lavender (both the plant and its essential oils) [line break]
is considered toxic to cats.
That's not the relevant question, because the actual answer to what you asked is "all flows where human judgement is used".
The thing we need to not blindly use current generation AI for is "things where we accept the combination of an untrained (or barely trained) human with no QA".
IMO, the drive to use AI is not only fully automating a lot of things that shouldn't be so, but also revealing how some of them never should have been in the first place. If your human customer support agent makes stuff up and that got your business a penalty fine, you might discipline or fire them; not so easy when it's an AI that replaced a whole call centre in one go, even when the incident frequency is the same.
You can't put an AI in a flow which requires reliable results. I don't think people who are used to determinism have coped with that.