The mad genius of using LLMs as classifiers with Katherine Munro, Swisscom

Picture of Kane Simms
Kane Simms

More ways to listen and watch

About this episode

In this episode, Kane Simms is joined by Katherine Munro, Conversational AI Engineer at Swisscom, for a deep dive into what might sound like an odd pairing: using LLMs to classify customer intents.

Presented by NLX

NLX is a conversational AI platform enabling brands to build and manage chat, voice and multimodal applications. NLX’s patented Voice+ technology synchronizes voice with digital channels, making it possible to automate complex use cases typically handled by a human agent.

When a customer calls, the voice AI guides them to resolve their inquiry through self-service using the brand’s digital asset, resulting in automation and CSAT scores well above industry average. Just ask United Airlines.

Large Language Models (LLMs) are powerful, multi-purpose tools. But would you trust one to handle the precision of a classification task?

It’s an unlikely fit for an LLM. Classifiers typically need to be fast, accurate, and interpretable. LLMs are slow, random black-boxes. Classifiers need to output a single label. LLMs never stop talking.

And yet, there are good reasons to use LLMs for such tasks, and emerging architectures and techniques. Many real-world use cases need a classifier, and many data and product development teams will soon find themselves wondering: could GPT handle that?

If that sounds like you, then check out this extended episode to explore how Switzerland’s largest telecommunications provider tackles this issue while building a next-generation AI assistant.

Show notes

“The Handbook of Data Science and AI: Generate Value from Data with Machine Learning and Data Analytics” – Available on Amazon.

Katherine’s website. 

Subscribe to VUX World.

Subscribe to The AI Ultimatum Substack.

Share

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Host

Kane Simms

A strategic AI advisor who, for the past decade, has helped business leaders and product owners transform customer experience using conversational and generative AI.

Share

✓   Link copied

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Top articles and podcasts

Related content

AI is stripping brand value: Matt Clare (UJET)
Matt Clare, VP Product Marketing at UJET, joins Kane Simms to explore what happens when your customer's AI agent is the one calling, and why AI is stripping away the brand and experience value businesses have relied on to stand out.
How Sling TV’s AI agent converts 25% of sales conversations
Sling TV's AI agent converts nearly 25% of sales conversations and the team behind it shared how it grew from answering simple questions to selling at scale.
24 reasons why giving your chatbot a voice isn’t as simple as it sounds
Teams giving their chatbot a voice soon find that time, attention, latency, messy language and handoffs change the whole design job.
You built AI agents. How do you keep them under control?
What happens when AI agents spread across your business, each using different models, tools and data? I spoke with Anirudh (Ani) Narayan, co-founder and CGO of Lyzr AI, about taking agents into everyday operations and keeping them under control.

AI Breakfast: Keeping Control of Enterprise AI Agents. London. 26th November.

Meet VUX at CCW Europe, Amsterdam, October 5-7

Register now: Why your contact centre playbook is obsolete