Digital Literacy

Deepfakes Explained: How They Work and How to Spot Them

AI can now create convincing fake images, videos, and audio. Here's how deepfake technology actually works, where the real risks are, and simple ways to protect yourself.

By the NoAIFear Team  ·  11 min read
The key insight: Deepfakes range from harmless novelty (a celebrity face-swap meme) to serious harm (fabricated evidence, intimate image abuse, financial fraud). Understanding how they work helps you evaluate media more critically — and spot the red flags before you share something fake.

What Is a Deepfake?

The word "deepfake" combines "deep learning" — the AI technique behind it — and "fake." It refers to any AI-generated or AI-manipulated media that depicts something that didn't actually happen: a person saying words they never said, appearing in places they never visited, or doing things they never did.

The technology first gained wide attention around 2017–2018 when hobbyists began using it to swap celebrities' faces into movies. Since then, the tools have become dramatically more powerful, cheaper, and easier to use. What once required a research lab can now be done by an average person on a laptop — or even a smartphone.

It's important to note that not all synthetic media is malicious. AI-generated content has legitimate uses: special effects in films, dubbing actors into other languages, preserving the voices of people with speech disabilities, creating educational simulations. The same technology that enables harm also enables genuine creative and accessibility benefits. Context and intent matter enormously.

The Different Types of Deepfakes

🎭

Face Swap Video

One person's face is digitally grafted onto another's body in video. The most technically challenging type — quality varies widely, but top tools are remarkably convincing.

🎙️

Voice Cloning

AI replicates someone's voice from a small sample (sometimes just 3–10 seconds). Can make the cloned voice say anything. Used in grandparent scams and CEO fraud.

🖼️

Synthetic Images

Entirely AI-generated images of people who don't exist, or photorealistic images of real people in fake scenarios. Tools like Midjourney and DALL-E power this category.

💬

Lip Sync / Talking Head

A still image or existing video is manipulated so the subject's lips move to match new audio — making it appear they're saying something they never said.

🎬

Full Body Puppet

The most sophisticated type — a person's entire body movements are controlled by a performer, then mapped onto the target. Requires significant processing power.

📝

Text-Based Fakes

AI-generated text attributed to real people — fake quotes, fake social media posts, fabricated interviews. Lower technical barrier, often just as damaging.

How Deepfake AI Actually Works

You don't need to understand every technical detail, but a basic mental model helps you appreciate both why deepfakes can be convincing and why they still have telltale flaws.

Most video deepfakes use a type of AI called a Generative Adversarial Network (GAN) — two neural networks competing against each other. One network generates fake images. The other evaluates them and tries to spot the fakes. Over thousands of training rounds, the generator gets better at creating convincing fakes, and the discriminator gets better at spotting them. The generator "wins" when its fakes consistently fool the discriminator.

The result is a model that has learned, at a deep level, what a particular face looks like from different angles, with different lighting, making different expressions. When asked to swap that face onto a new body, it can synthesize a plausible version for each frame of video.

For voice cloning, a different approach called a vocoder or diffusion model learns the unique characteristics of someone's voice — their pitch, rhythm, accent, and speaking quirks — from audio samples. Once trained, it can generate new speech in that voice from any text input.

Why deepfakes still have flaws: Even the best deepfakes today struggle with highly detailed elements — hair strands, teeth edges, complex backgrounds, the exact physics of skin texture under changing light. These are the areas where careful inspection most often reveals manipulation.

How to Spot a Deepfake

No single tell is foolproof, but a combination of visual and contextual checks goes a long way. Here are the most reliable indicators:

Visual Red Flags

Unnatural eye movement Eyes blink too infrequently or at wrong times. Gaze doesn't track naturally with head movement.

Skin texture anomalies Skin looks too smooth, too plastic, or weirdly blotchy. Pores and fine wrinkles may disappear or jump around.

Lighting inconsistency The face is lit differently from the background or body — shadows fall the wrong direction.

Blurry edges The boundary between the face and hair, or face and neck, looks soft, smeared, or flickering frame-to-frame.

Audio-visual mismatch Lip movements don't perfectly sync with speech. Teeth may look wrong during open-mouth sounds.

Jewelry and accessories Earrings, glasses, and hair can distort, flicker, or transform strangely as the face moves.

Contextual Red Flags (Often More Reliable)

Visual inspection is getting harder as technology improves. Context checks are often more reliable:

For important content, use dedicated detection tools. MIT's DetectFakes project and Microsoft's Video Authenticator are among the academic and industry resources designed specifically to analyze media for manipulation signs.

Real-World Harm: The Threat Spectrum

Not all deepfake harm is equal. Here's a realistic assessment of where the greatest risks lie today:

HIGH HARM
Non-consensual intimate images (NCII): The vast majority of deepfakes online fall into this category — AI-generated sexual images of real people without their consent. Overwhelming victims tend to be women. Illegal in many jurisdictions and devastating to victims.
HIGH HARM
Financial fraud: Voice-cloned calls impersonating family members in distress, or executives authorizing wire transfers. One documented case involved a UK energy company losing €220,000 to a CEO voice clone (Wall Street Journal).
MEDIUM
Political disinformation: Fabricated videos of politicians saying inflammatory things. While actual deepfakes haven't yet swung a major election, they add noise to an already difficult media environment and erode trust in authentic video.
MEDIUM
Harassment and reputation damage: Fake compromising images used to blackmail, bully, or discredit individuals. Increasingly targeting private citizens, not just public figures.
LOWER
Misinformation amplification: Real videos taken out of context are often more damaging than deepfakes. Deepfakes add another layer, but "cheapfakes" (edited authentic footage) remain more common.

What Laws Exist?

The legal landscape is evolving rapidly. Here's where things stand as of 2026:

United States: Multiple states have laws specifically against non-consensual deepfake intimate images — including California, Virginia, Texas, and Georgia. At the federal level, the DEFIANCE Act (2024) created a federal civil cause of action for victims of non-consensual intimate deepfakes. Using deepfakes for fraud or election interference can trigger existing criminal statutes.

European Union: The EU AI Act (2024) requires that AI-generated content — including deepfakes — be clearly labeled as synthetic. The Digital Services Act adds obligations on large platforms to address harmful synthetic media.

United Kingdom: The Online Safety Act (2023) included provisions to criminalize sharing non-consensual intimate deepfakes.

Important gap: Creating a deepfake and keeping it privately is often not yet illegal in many places. Laws typically focus on distribution or specific harmful uses. If you're a victim of a deepfake, document everything and consult a lawyer about civil remedies even if criminal options are limited.

How to Protect Yourself

  1. Limit your public photo and video presence. Every image you share publicly can become training data. Tighter privacy settings on social media reduce the amount of material available.
  2. Establish a family code word. Agree on a word or phrase only your immediate family knows. If someone calls claiming to be a family member in crisis, ask for the code word before acting.
  3. Be skeptical of sensational video content. Especially near elections, major legal events, or corporate announcements. Pause before sharing. Check multiple news sources.
  4. Use reverse image search on suspicious photos. Google Images and TinEye can reveal whether a photo was taken in a different context than claimed.
  5. Know how to report. If you or someone you know is victimized by a deepfake, report to the platform immediately, contact local law enforcement, and reach out to organizations like the Cyber Civil Rights Initiative (cybercivilrights.org).
  6. Enable two-factor authentication everywhere. Deepfakes are sometimes used to bypass identity verification. Stronger authentication reduces your overall vulnerability.

Frequently Asked Questions

What exactly is a deepfake?

A deepfake is any AI-generated or AI-manipulated media — image, video, or audio — that depicts something that didn't happen. The term comes from combining "deep learning" (the AI technology) and "fake." Today deepfakes range from harmless fun (celebrity face-swaps in memes) to serious harms (non-consensual intimate images or political disinformation).

How can I tell if a video is a deepfake?

Warning signs include: unnatural blinking or eye movement, skin texture that looks too smooth or waxy, inconsistent lighting between the face and background, audio that doesn't quite sync with lip movements, and hair or glasses edges that look blurry. For important content, use detection tools from MIT or Microsoft, reverse image search the thumbnail, and check whether credible news outlets have covered the event shown.

Are deepfakes illegal?

Laws vary by country and use case. Non-consensual intimate deepfakes are illegal in many US states and increasingly at the federal level. Using deepfakes for fraud, defamation, or election interference carries additional criminal exposure. The EU AI Act requires labeling AI-generated content. However, parody and satire deepfakes (clearly labeled) typically retain free speech protections.

Can deepfake audio fake a phone call from someone I know?

Yes — this is a growing scam. AI voice cloning can replicate someone's voice from just a few seconds of audio. Fraudsters have used cloned voices to impersonate family members in "grandparent scams" and to fake CEO voices in wire-transfer fraud. Establish a family code word that only real family members know, and always call back on a known number if someone unexpected asks for money or urgent help.

Keep Learning