Skip to content

What Is AI Voice Cloning?

AI voice cloning is a computer tool that copies a person’s speaking voice from a short recording. Learn how it works and what to do if a caller sounds like family.

Phone Call ScamsNovember 11, 20264 min read

AI voice cloning is a way for a computer program to copy how a real person sounds when they speak. AI stands for artificial intelligence, which means software that learns patterns from examples. Once the program learns the sound of a voice from a recording, someone at a keyboard can type any words they want, and the computer will read those words out loud in that copied voice.

How a computer copies a voice

Older computer voices sounded stiff and robotic. Newer voice-cloning programs study recordings of real people talking to learn what makes one voice different from another.

How a voice clone is made
  1. A short recording is collected

    Someone feeds a recording of a person speaking into a voice-cloning program.

  2. The software studies the voice

    The program measures pitch, speed, accent, and breathing pauses to build a voice model.

  3. New words are typed in

    The user types a script, and the program reads it out loud in the copied voice.

Different programs need different amounts of recorded speech to work:

  • A few seconds to a minute: The Federal Trade Commission (FTC) warns that a voice can be copied from a recording that is under 30 seconds long1. Many instant voice-cloning tools ask for 10 seconds to a couple of minutes of clear speech.

  • Thirty minutes to a few hours: Companies that make professional voice clones for audiobooks or movies use 30 minutes to 3 hours of studio audio so the copy holds up over long sentences2.

A short clip does not produce a flawless copy, but over a noisy phone line, even a rough match can sound convincing for a sentence or two.

Why it matters

Voice cloning has helpful everyday uses. Doctors use it to save a patient’s real voice before a medical treatment that might take their speech away. Authors and actors use it to read audiobooks or dub movies into other languages.

It matters for your security because these programs are cheap and easy to find online. Anyone can take a short clip of someone talking—such as a public video on social media or a voicemail greeting—and make a voice copy.

In some phone call scams, a caller plays a short clip of a crying or panicked voice to make you think a child or grandchild is in trouble. That is what happened when a mother lost money to a fake kidnapping call after hearing a voice that sounded like her daughter. Scammers also pair cloned voices with fake celebrity videos on social media to pitch phony investments.

What the caller says

Grandma, it is me, please help!

I was in a car accident and I am at the police station.

My phone broke. Do not call my parents, just wire bail money now!

Incoming call

Unknown Caller

phone number removed

Red flags on this call

Because caller ID can be faked using virtual phone numbers, you cannot rely on the sound of a voice or the name on your screen alone when a caller asks for money.

What to do

You do not need to spot a computer-made voice by ear. Instead, rely on a few steady habits whenever an urgent call comes in.

  1. Hang up and call the person back. If someone who sounds like a relative calls with an emergency and asks for money, end the call. Call them back using the phone number you already have saved for them in your contacts or address book.

  2. Check with another family member. If you cannot reach the person right away, call another relative, such as their spouse or parent, to ask where they are.

  3. Set up a family safe word. Agree on a secret word or phrase with your close family ahead of time. Pick something random that is not in your social media posts, such as the name of a first pet’s street or a favorite childhood dish. If someone calls claiming to be family in trouble, ask for the safe word.

  4. Keep your voicemail greeting simple. You do not need to record a long personal message on your phone. Using the phone company’s built-in greeting—the one that reads out your phone number—leaves strangers with no recording of your voice.

Common questions

Can someone copy my voice from my voicemail greeting?

Yes, if you recorded a personal greeting in your own voice, anyone who calls your number and reaches voicemail could record it. Switching to your phone carrier’s standard automated greeting prevents this.

How much audio does a computer need to copy a voice?

Some voice-cloning tools claim to need only 3 to 15 seconds of clear speech to make a basic copy. To make a smooth, high-quality clone that holds up over a long conversation, programs usually need several minutes to a few hours of recording.

Can someone clone a voice from a social media video?

Yes. If a video on Facebook, Instagram, or TikTok is public, anyone can download the audio track and feed it into a voice-cloning program. Setting social media accounts to private so only friends and family can see videos helps limit who can get recordings of your voice.

For more information

  1. Scammers use AI to enhance their family emergency schemesconsumer.ftc.gov
  2. What is voice cloning and how does AI voice cloning work?elevenlabs.io

This happens to real people

Keep reading

More in Phone Call Scams