Quality assurance for conversational AI systems with Christoph Börner, CEO, Botium

Picture of Kane Simms
Kane Simms

More ways to listen and watch

About this episode

Christoph Börner, CEO, Botium, joins us on our podcast to talk about quality assurance for conversational AI systems.

Presented by Deepgram

Presented by DeepgramDeepgram is a Speech Company whose goal is to have every voice heard and understood. We have revolutionized speech-to-text (STT) with an End-to-End Deep Learning platform. This AI architectural advantage means you don’t have to compromise on speed, accuracy, scalability, or cost to build the next big idea in voice. Our easy-to-use SDKs and APIs allow developers to quickly test and embed our STT solution into their voice products. For more information, visit:

<

Quality assurance for digital assistants

One thing is for sure; conversational AI systems are a challenge to test and maintain. Yet, without robust testing, there’s no way of guaranteeing quality. And high quality interactions are all that matter. Without assuring the quality of your assistant, it won’t achieve the results you hope it will, rendering your whole strategy pointless.

To share the importance of quality assurance, and to walk you through the core steps and activities in your QA pipeline, we’re joined by Christoph Börner, CEO, Botium.

00:00 Introduction and presenting Deepgram
Register for ‘The irony of big tech: why your speech recognition is probably a load of tosh’: https://vux.la/3ySe8n8
04:30 Welcome Christoph Börner
07:04 What is Botium?
09:20 Botium founding story
13:22 Challenges with conversational AI quality control
18:32 Benchmarking quality and testing
22:10 Is there privacy hurdles to overcome?
24:30 Gaps in AI practitioner knowledge
28:37 Removing complexity from quality control
31:17 Common issues found while training chatbots
35:00 Large language models
37:21 Training data best practice
40:00 Best practice for NLU selection
47:05 Monitoring the performance of digital assistants
52:55 Automated QA: the ultimate insurance policy
55:10 Team maturity
1:00:45 Outro

Links

Visit https://www.botium.ai/
Register for ‘The irony of big tech: why your speech recognition is probably a load of tosh’: https://vux.la/3ySe8n8

Share

A customer's AI agent just called. Now what?

This research looks at how businesses are responding to personal AI agents.

Take the 5-minute survey

Everyone who takes part gets first access to the results

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Host

Kane Simms

A strategic AI advisor who, for the past decade, has helped business leaders and product owners transform customer experience using conversational and generative AI.

Share

✓   Link copied

A customer's AI agent just called. Now what?

This research looks at how businesses are responding to personal AI agents.

Take the 5-minute survey

Everyone who takes part gets first access to the results

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Top articles and podcasts

Related content

Why voice AI agents pass in the lab and fail on real calls: Liam Dunne (Klearcom)
Liam Dunne, Co-founder and CEO of Klearcom, joins me to talk about why voice AI agents can pass every lab test and still fail on real calls, and why testing the whole journey is becoming mandatory for global deployments.
Brands are split on personal AI agents. Where does yours stand?
Personal AI agents can now phone businesses and pay on a customer's behalf, but some brands are already blocking them. I'm running research to find out where businesses stand.
AI is stripping brand value: Matt Clare (UJET)
Matt Clare, VP Product Marketing at UJET, joins me to explore what happens when your customer's AI agent is the one calling, and why AI is stripping away the brand and experience value businesses have relied on to stand out.
How Sling TV’s AI agent converts 25% of sales conversations
Sling TV's AI agent converts nearly 25% of sales conversations and the team behind it shared how it grew from answering simple questions to selling at scale.

AI Breakfast: Keeping Control of Enterprise AI Agents. London. 26th November.

Meet VUX at CCW Europe, Amsterdam, October 5-7

Register now: Why your contact centre playbook is obsolete