The mad genius of using LLMs as classifiers with Katherine Munro, Swisscom

Picture of Kane Simms
Kane Simms

More ways to listen and watch

About this episode

In this episode, Kane Simms is joined by Katherine Munro, Conversational AI Engineer at Swisscom, for a deep dive into what might sound like an odd pairing: using LLMs to classify customer intents.

Presented by NLX

NLX is a conversational AI platform enabling brands to build and manage chat, voice and multimodal applications. NLX’s patented Voice+ technology synchronizes voice with digital channels, making it possible to automate complex use cases typically handled by a human agent.

When a customer calls, the voice AI guides them to resolve their inquiry through self-service using the brand’s digital asset, resulting in automation and CSAT scores well above industry average. Just ask United Airlines.

Large Language Models (LLMs) are powerful, multi-purpose tools. But would you trust one to handle the precision of a classification task?

It’s an unlikely fit for an LLM. Classifiers typically need to be fast, accurate, and interpretable. LLMs are slow, random black-boxes. Classifiers need to output a single label. LLMs never stop talking.

And yet, there are good reasons to use LLMs for such tasks, and emerging architectures and techniques. Many real-world use cases need a classifier, and many data and product development teams will soon find themselves wondering: could GPT handle that?

If that sounds like you, then check out this extended episode to explore how Switzerland’s largest telecommunications provider tackles this issue while building a next-generation AI assistant.

Show notes

“The Handbook of Data Science and AI: Generate Value from Data with Machine Learning and Data Analytics” – Available on Amazon.

Katherine’s website. 

Subscribe to VUX World.

Subscribe to The AI Ultimatum Substack.

Share

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Host

Kane Simms

A strategic AI advisor who, for the past decade, has helped business leaders and product owners transform customer experience using conversational and generative AI.

Share

✓   Link copied

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Top articles and podcasts

Related content

Cobus Greyling: why intents, graphs and conversation design have come full circle
Cobus Greyling on where enterprise AI is really heading: data, security, forward-deployed engineers and conversation design.
From answers to actions: building better government AI
Pete Kowalczyk on knowledge graphs, goal detection and moving AI from answering questions to taking action.
What’s really breaking your AI agents?
Discover where conversational AI projects actually break: contradictory source data, manual process and weak testing.
How Simplyhealth scaled voice AI to resolve 30% of calls
Paul Atkins, Head of Business Optimisation at Simplyhealth, breaks down how they scaled voice AI to resolve almost a third of calls, and what it took to get there.