VoiceAI builders can replay production calls (or) create voice test data set and replay those calls to your VoiceAI. With this(https://app.shortloop.dev/) you can now test end to end flows frequently and in an automated way.We have been tinkering with LLMs and building voice applications for the past few months. As we were trying to improve our voice bots performance (interruptions, latency of...
There are a lot of Eval frameworks, which work on the premise of <Question, Answer, Context> and give a score to LLM response. They work pretty well with cases where we expect a response to a query, and a context(ground truth) is provided in form of RAG.How can I use this paradigm for chatBot evaluation? Reason being that conversational bots also have chatHistory apart from the last...
How are you making sure your sensitive data & PII doesn't become part of LLM training data. When training data is small, manual verification is possible. But when data size is huge, is there a way to mask/filter out PII/sensitive data.