We are finding that strict, rule-based approaches are actually essential in an LLM-enabled architecture. Right now, we are looking at putting something like Watson in front of GPT4 in order to filter, route & contextualize our system.

Generative AI architectures get a lot of attention, but classification is the real magic for making something that looks as polished as ChatGPT. The determinism you get with something like an SVM is much more certain than adjusting a spiciness slider between 0 and 1.