I work in a company that sells chatbots. We use LLMs to understand the intention of the user: start a flow, set a slot value, cancel a current flow...

After that, all the logic to handle the identified action and the response is implemented using normal backend code.

We sometimes use an LLM for the response when the user asks for a FAQ or maybe for rephrasing an output sentence.