At the start of ITV's Lorraine, viewers saw the Scottish presenter appear standing on screen as a voice-over played into the studio.
However, it was her own voice introducing the show as it said: "Good Morning, I'm Lorraine Kelly and on today's show we're talking about the rise in AI fakes."
As her voice was speaking, the 64-year-old was seen looking around the room, somewhat confused.
When the introduction stopped, she confessed the person talking wasn't her despite sounding identical.
She said: "That wasn't me! That's really frightening that wasn't actually my voice. We've got an AI scam warning in just a moment because they're using our voices."
READ MORE: Married At First Sight UK star's reality TV past 'exposed' after appearing on huge show
READ MORE: Loose Women's Coleen Nolan fumes 'don't care' as Huw Edwards called 'vulnerable' by co-star
During the programme, Lorraine spoke to actor James Nesbitt who is leading a new campaign to show how easy it is to fall victim to AI scams involving people's voices.
A clip was then played showing James holding a phone and listening to a cloned version of himself asking someone for their PIN number.
Shocked, the actor commented: "That's not me! I've never said it"
James continued to listen to other scams involving his own voice asking people for money in disbelief.
When the short film ended, Lorraine replied: "James, that's terrifying! That is terrifying because that really did sound like you.
"The way that that is trying to get people's details, their card details and all of that. Scary stuff!"
Questioning how people are able to tell what is real and what's not, James highlighted that AI has found new ways to target people.
He said: "They (AI) can replicate someone's voice from about three seconds of audio, which they can get very easily if someone uploads it online."
Partnering with Starling Bank, James informed Lorraine they're encouraging people to create a safe phrase they use with their loved ones.
This will allow people to know they're not speaking to a robot, which Lorraine admitted was a great idea to help people not get scammed as easily.
He said: "To me, I've got a very distinctive voice and it's gone to the core of my career in a way, so when I heard this, which I knew very little about, it's shocking and it's scary."
Agreeing, she replied: "It's shocking and it's not just people in the public eye this is happening to. This can happen to anybody because we've all left messages and they don't need much of your voice like you said, just snippets."
Lorraine continues weekdays on ITV from 9am.
