<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom"><title>Todd Schiller - llm</title><link href="https://toddschiller.com/" rel="alternate"></link><link href="https://toddschiller.com/feeds/tag/llm.atom.xml" rel="self"></link><id>https://toddschiller.com/</id><updated>2024-09-02T00:00:00-04:00</updated><subtitle>Human ✘ Artificial Intelligence</subtitle><entry><title>Co-pilots, not chatbots: highlights from a TaskUs Forward webinar</title><link href="https://toddschiller.com/blog/operationalizing-ai-at-scale-highlights.html" rel="alternate"></link><published>2024-09-02T00:00:00-04:00</published><updated>2024-09-02T00:00:00-04:00</updated><author><name>Todd Schiller</name></author><id>tag:toddschiller.com,2024-09-02:/blog/operationalizing-ai-at-scale-highlights.html</id><summary type="html">Highlights from the September 2024 TaskUs Forward webinar with Manish Pandya and host Alp Uguray on what it takes to operationalize generative AI in CX.</summary><content type="html">&lt;p&gt;I joined Manish Pandya (SVP of Digital at TaskUs) and host Alp
Uguray (Masters of Automation) for a &lt;a href="https://www.youtube.com/watch?v=G03VU4w5ixc"&gt;TaskUs Forward webinar&lt;/a&gt;
on operationalizing generative AI in customer experience. A few
moments from the conversation worth pulling out — the &lt;a href="/transcripts/operationalizing-ai-at-scale-transcript.html"&gt;full
transcript is here&lt;/a&gt;.&lt;/p&gt;
&lt;h2&gt;On AI looking like the early days of the internet&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Todd:&lt;/strong&gt; I think in a lot of ways AI looks like the early days of
the internet. It's subsidized by an ample wave of investment from
the venture capitalists. You have providers like Google, Amazon,
and Facebook fighting to create this excess amount of
infrastructure and capacity due to competitive pressure. We also
see a very low barrier to entry to build prototypes. So ultimately
I think AI is the future, but definitely not all the ideas and the
companies and the headlines that you see are going to stick.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On human-driven AI&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Manish:&lt;/strong&gt; At TaskUs we believe in the power of human-driven AI,
or human-in-the-loop, where the technology is amplifying the
capabilities of the human as they deliver — not necessarily
replacing them. This has potential to deliver empathetic,
personalized, and nuanced responses that only a human can deliver,
and not necessarily something that an AI can replicate, although
AI can assist.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On chatbots vs. the natural flow of work&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Todd:&lt;/strong&gt; Chatbots are the fastest way to deliver AI to everyone
at your company — and if you remember, ChatGPT was actually the
fastest-growing consumer product of all time — but there's
actually little consistency with outcomes when you just roll out a
chatbot. […] What we're really seeing is companies figuring out
how to embed AI into the natural flow of work, and as Manish said,
it's really about making AI a true co-pilot for teammates.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On a true co-pilot, not just chatbots and search&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Manish:&lt;/strong&gt; What we're seeing is that clients are expecting the
generative AI solutions to complement our teams so they can be
freed up to perform high-value tasks. Essentially what they're
looking for is a true co-pilot for our teams, not just chatbots
and search.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On systems thinking and second-order effects&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Todd:&lt;/strong&gt; We've seen a lot of companies deploying, for example,
customer-facing chatbots, and then running around with their
deflection rate metrics saying, &amp;quot;hey, we did a great job,&amp;quot; but
then they see drops in their customer loyalty and lifetime
customer value. So for me the key is to think holistically about
your company and value chain — try to apply what a lot of people
call systems thinking — and really try to understand what is
unique about AI as a technology and therefore where it can best be
applied.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On agentic AI and the next few quarters&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Manish:&lt;/strong&gt; Rather than talking about the next few years, let's
talk about the next few months and next few quarters. […] You will
also see that not just one-shot question and response with some
follow-up queries, but being able to form a chain — which is what
is called agentic AI — will emerge, where you provide a task and
the generative AI solution is able to string together multiple
automation capabilities together.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On building trust between humans and AI&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Alp:&lt;/strong&gt; We're introducing more automation to remove the mundane
tasks that people hate to do, while bringing explainable AI — why
AI does certain things and what the impact is, the transparency in
execution. […] It's going to build a new trust between humans and
AI. That trust is going to be really important and has its own
requirements, and of course it has to bring business value —
measuring the ROI where it needs to be, while we are driving
meaningful work of the future.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;hr /&gt;
&lt;p&gt;The full webinar is on &lt;a href="https://www.youtube.com/watch?v=G03VU4w5ixc"&gt;YouTube&lt;/a&gt;. A lightly edited
&lt;a href="/transcripts/operationalizing-ai-at-scale-transcript.html"&gt;transcript is on this site&lt;/a&gt;.&lt;/p&gt;
</content><category term="Machine Learning"></category><category term="webinar"></category><category term="pixiebrix"></category><category term="generative ai"></category><category term="llm"></category><category term="customer experience"></category><category term="taskus"></category></entry><entry><title>AI frees humans to be more human: highlights from Success League Radio</title><link href="https://toddschiller.com/blog/generative-ai-customer-success-highlights.html" rel="alternate"></link><published>2023-09-19T00:00:00-04:00</published><updated>2023-09-19T00:00:00-04:00</updated><author><name>Todd Schiller</name></author><id>tag:toddschiller.com,2023-09-19:/blog/generative-ai-customer-success-highlights.html</id><summary type="html">A few moments from my conversation with Kristen Hayer on Success League Radio about where generative AI fits in customer success.</summary><content type="html">&lt;p&gt;I joined Kristen Hayer on &lt;a href="https://open.spotify.com/episode/6CKWkeleNyadeMNoKjrqYH?si=dda355fc83ec4537"&gt;&lt;em&gt;Innovations in Leadership&lt;/em&gt;, the Success
League Radio podcast&lt;/a&gt;, to talk through where generative AI
fits in customer success. A few moments from the conversation worth
pulling out — the &lt;a href="/transcripts/generative-ai-customer-success-transcript.html"&gt;full transcript is here&lt;/a&gt;.&lt;/p&gt;
&lt;h2&gt;On AI freeing humans to be more human&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;We think that AI frees humans to be more human. There are three
areas. First, with AI you can automate a lot of the low-value
activities… The second area is that AI can also be your personal
trainer or coach… And then beyond that, there's the pure power to
have AI upskill workers. It's a bit akin to that scene in &lt;em&gt;The
Matrix&lt;/em&gt; where Keanu plugs in, connects to the desk, and then
suddenly downloads all the kung-fu knowledge.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On treating ChatGPT like an intern&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;The way I like to frame it is: let's say you were to hire an intern.
What would you have them do? I say &amp;quot;intern&amp;quot; because interns require
instruction. They're not experts in customer support. And they're
not always perfect — sometimes you're going to have to check their
work, or you might have to make some corrections.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On defusing hallucinations&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;Instead of saying &amp;quot;ChatGPT, go generate a response for me,&amp;quot; what
you instead do is you give it a list of things to choose from, or
you give it some content and you say &amp;quot;summarize this content.&amp;quot; When
you're giving it those sorts of tasks, it's much better able to
identify that it's only supposed to be using &lt;em&gt;that&lt;/em&gt; as the source
material, versus giving it all human knowledge and saying &amp;quot;what's
relevant out of this entire space of human knowledge?&amp;quot;&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On capabilities, not maturity&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;A maturity model is a model that looks at what sort of level of
tools or processes you have in place — level one, two, three, or
four. A capability model looks at specific capabilities and
outcomes. When an agent picks up a ticket, do they have the context
of prior interactions? Do we have alerting in place to make sure
we're actually able to meet our SLAs about response times, even
when someone's on vacation?&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h2&gt;On the disclosure bright line&lt;/h2&gt;
&lt;blockquote&gt;
&lt;p&gt;If it's fully automated, you should definitely be disclosing — not
even just for ethical reasons, but for expectation-setting and
maintaining trust with your customer. And then really, it's the
&lt;em&gt;assistant&lt;/em&gt; that becomes more of a gray area. We wouldn't disclose
if I was using grammar check to write an email. I wouldn't
necessarily disclose if I was using Google Translate to help
translate a message to you. So that's kind of my bright line: if
there is a human involved, I don't think you necessarily need to
disclose. But if it's fully automated, it's probably both ethical
and also just best practice to disclose there.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;hr /&gt;
&lt;p&gt;The full episode is on &lt;a href="https://open.spotify.com/episode/6CKWkeleNyadeMNoKjrqYH?si=dda355fc83ec4537"&gt;Spotify&lt;/a&gt; and &lt;a href="https://www.buzzsprout.com/1900538/episodes/13579815-innovations-in-leadership-todd-schiller-generative-ai-in-customer-success"&gt;Buzzsprout&lt;/a&gt;. A
lightly edited &lt;a href="/transcripts/generative-ai-customer-success-transcript.html"&gt;transcript is on this site&lt;/a&gt;.&lt;/p&gt;
</content><category term="Machine Learning"></category><category term="podcast"></category><category term="pixiebrix"></category><category term="generative ai"></category><category term="llm"></category><category term="customer success"></category></entry></feed>