5 min read

Deepfake: How altered videos make people say what they never said

Published Updated

The idea in 30 seconds

A deepfake is computer-generated media (commonly known as synthetic media)—most often video or audio—created using artificial intelligence to convincingly depict a person saying or doing something that never actually occurred. By studying source images, video clips, or spoken recordings, smart pattern-learning programs track facial landmark points, mimic speech rhythms, and blend realistic expressions onto a target subject.

When seeing is no longer believing on your screen

You are scrolling through your feed when a short video stops your thumb. A well-known news presenter or tech executive looks directly into the lens, clears their throat, and announces an exclusive investment opportunity with guaranteed returns. The voice carries their signature cadence, their mouth shapes every syllable cleanly, and their brow wrinkles with urgent conviction. A few years ago, capturing someone on video saying those words was indisputable proof that they spoke them. Today, that entire sequence can be generated on an everyday laptop in minutes.

This fabricated footage is called a deepfake, combining advanced pattern-learning software (known in technology as deep learning) with computer-manipulated media. Instead of human animators drawing scenes frame by frame, modern programs analyze video recordings to reconstruct and animate human faces automatically. The technology produces convincing results, but the computer has no conscious understanding of who a person is. It operates entirely through mathematical pattern matching, tracking dot coordinates, and assembling colors on screen (pixel synthesis).

How software reconstructs faces frame by frame

The process begins with facial landmark tracking. When video clips enter the system, step-by-step calculation formulas (algorithms) scan each frame to map dozens of pinpoint reference coordinates across the face: the corners of the eyes, the bridge of the nose, the jawline, and the contours of the lips. Connecting these coordinates creates a flexible wireframe net (known as a digital mesh). When an actor turns their head, blinks, or smiles, the mesh flexes in real time, recording the exact geometry of that motion.

Next, an image-creating computer network (known as a generative neural network) draws new imagery over that shifting framework. The model studies sample pictures of the target person, learning how light reflects across their cheekbones, how skin folds near their eyes, and how their teeth appear during speech. Frame by frame, the software paints a face that matches the driving movement, blends lighting tones, and softens the outer boundaries (known as feathering edges) so the synthetic patch merges smoothly into the surrounding skin and hair.

In audio-driven systems, the software skips human actors altogether. Computer programs analyze recorded voice soundwaves (speech waveforms), estimate the mouth shapes needed to pronounce each syllable, and reshape the target face to match. Spoken sound and visual lip motion assemble together into a synthetic video that never happened in real life.

Casual impressions versus verified facts

Consider how two people evaluate the exact same viral clip:

  • The casual viewer: Watches a ten-second vertical video on a smartphone in a noisy room. The dramatic statement sparks immediate surprise, and the familiar face looks authentic enough. They share the video immediately, assuming camera footage cannot lie.
  • The verified viewer: Pauses to check basic context. They notice the clip lacks a timestamp, names no reputable broadcaster, and originates from an unverified profile. Searching news databases reveals no matching speech or press coverage, exposing the clip as an isolated fabrication.

The trap of spot-the-glitch detection

Early deepfakes suffered from obvious defects like irregular blinking, unnatural teeth, or warped ears. While spotting these flaws was once reliable advice, searching purely for visual glitches is no longer enough for two reasons.

First, creative image models improve continuously, rendering realistic eye reflections, teeth, and skin textures. Second, social media compression complicates inspection. When videos are uploaded to messaging apps or social networks, aggressive data shrinking blurs sharp boundaries and adds digital grain (compression artifacts). A fuzzy hairline or pixelated mouth is often just routine file shrinking, not evidence of manipulation. Conversely, compression can wash out the subtle edge flaws that forensic software tracks.

Research from the National Institute of Standards and Technology through the Open Media Forensics Challenge shows that media manipulation detection is an evolving technical contest. Automated detection tools analyze tiny electronic camera sensor fingerprints (sensor noise) and physical lighting consistency, but casual human viewers cannot rely on visual inspection alone.

Practical habits for an era of synthetic video

Because looking at pixels cannot guarantee authenticity, real safety comes from examining the surrounding context:

  • Check the origin and publishing record: Authentic announcements from public figures and organizations are documented across official websites and credible news agencies, never solely on isolated social accounts.
  • Verify urgent personal appeals through a separate line: If a video or voice message shows a family member begging for emergency money, never transfer funds in a hurry. Hang up and dial their saved phone number directly to confirm their safety.
  • Recognize manufactured urgency as a warning sign: Deceptive videos depend on sudden panic or excitement to bypass your critical judgment. An artificial deadline is your cue to slow down, step back, and verify.

Synthetic video technology brings creative potential to filmmaking and language dubbing, but it also alters how we handle digital evidence. You do not need complex forensic tools to protect yourself. By replacing instant emotional reactions with calm verification, you stay grounded and confident in what you choose to believe.

Sources to explore
  1. NIST Open Media Forensics ChallengeNIST