There are frameworks out there for doing that kind of thing, see https://rasa.com/ for example. It's not using any LLMs at the moment, just BERT and DIET mostly but it's highly customizable and you could likely bring in an LLM for doing some interesting things to handle more complex messages from users.