How Salesforce are using LLMs with Greg Bennett

Picture of Kane Simms
Kane Simms

More ways to listen and watch

About this episode

Greg Bennett’s the final Conversations2 interviewee focused on large language models!

When I heard that Salesforce have adopted LLMs at scale (and also heard that they had started to design and build this prior to ChatGPT’s release) I wanted to know more!

I’ve known Greg for years and have always found him to be warm, knowledgeable and an expert at making complex subjects understandable. He didn’t disappoint here – we spoke about thinking in systems and how that relates to conversational AI, how LLMs affect conversation design (and how conversation designers are key to the best usage of LLMs), how his team of designers work with the wider team, and Salesforce’s recent push into Generative Conversational AI.

So listen up to Greg’s thoughts on the best ways to use LLMs in conversational AI! Salesforce have gone all-in on generative conversational AI and Greg’s team have made that possible.

In this episode

Contents:
00:00 Start
00:29 Greg’s introduction
03:55 What’s your favourite bot?
05:11 What’s the most useful thing you use at work?
06:21 Which conversation designer should we all know about?
08:15 Conversations are systematic, and design should be too
10:17 What does ‘generative conversational AI’ mean to you?
11:38 How have you been incoporating generative conversational AI into your work at Salesforce?
16:05 We need expertise when writing prompts for LLMs
17:45 How does your team collaborate with the wider Salesforce team?
20:50 What benefits did you envision and how close are you now?
24:23 How has this affected the day to day work of conversation designers?
27:46 Now we need to be able to educate people about how to do conversational AI well
29:52 We’re thinking conceptually about language
32:43 Is this a new phase of conversation design?
36:32 How do you minimise the risks?
39:49 Do you continue to iterate together with engineering?
41:37 The model has a risk of learning from bad behaviour
42:46 How do you stay up to date with generative AI?
44:05 Researching attempts to break LLMs on social media gives great REAL data
45:49 When will you next speak live?
46:46 Outro

Share

A customer's AI agent just called. Now what?

This research looks at how businesses are responding to personal AI agents.

Take the 5-minute survey

Everyone who takes part gets first access to the results

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Host

Kane Simms

A strategic AI advisor who, for the past decade, has helped business leaders and product owners transform customer experience using conversational and generative AI.

Share

✓   Link copied

A customer's AI agent just called. Now what?

This research looks at how businesses are responding to personal AI agents.

Take the 5-minute survey

Everyone who takes part gets first access to the results

Weekly newsletter

The latest in AI-powered customer experience. Make better strategic decisions with the help of our weekly newsletter.

Top articles and podcasts

Related content

Why voice AI agents pass in the lab and fail on real calls: Liam Dunne (Klearcom)
Liam Dunne, Co-founder and CEO of Klearcom, joins me to talk about why voice AI agents can pass every lab test and still fail on real calls, and why testing the whole journey is becoming mandatory for global deployments.
Brands are split on personal AI agents. Where does yours stand?
Personal AI agents can now phone businesses and pay on a customer's behalf, but some brands are already blocking them. I'm running research to find out where businesses stand.
AI is stripping brand value: Matt Clare (UJET)
Matt Clare, VP Product Marketing at UJET, joins me to explore what happens when your customer's AI agent is the one calling, and why AI is stripping away the brand and experience value businesses have relied on to stand out.
How Sling TV’s AI agent converts 25% of sales conversations
Sling TV's AI agent converts nearly 25% of sales conversations and the team behind it shared how it grew from answering simple questions to selling at scale.

AI Breakfast: Keeping Control of Enterprise AI Agents. London. 26th November.

Meet VUX at CCW Europe, Amsterdam, October 5-7

Register now: Why your contact centre playbook is obsolete