Face2Face: Real-time Face Capture and Reenactment of RGB Videos




Matthias Niessner: “We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.”
Read more: popularmechanics.com & stanford.edu
Facial Recognition
Visual Recognition
Computer Vision
Real-time Face Reenactment, Matthias Niessner, Face2Face, Real-time Face Capture, RGB Videos, Facial Recognition

Real-time Face Reenactment, Matthias Niessner, Face2Face, Real-time Face Capture, RGB Videos, Facial Recognition

Real-time Face Reenactment, Matthias Niessner, Face2Face, Real-time Face Capture, RGB Videos, Facial Recognition

Donate BTC: 1DUUZbiqjbJvzjuRZEwTS47bqgmnhEJ4XG

Donate ETH: 0x981FcEAAa895C6cee76D2876e9AfC649Dc0C4c75

More Posts:

Extra Quality Cooking
Small Spacecraft Technology Program by NASA
First Human Brain Hacked By Researchers
The ViSi Mobile Monitor Checks A Patient's Vital Signs (+VIDEO)
Hyundai’s Connectivity Concept Uses NFC System
Tactile Sensation: Breakthrough In The Entertainment Industry (+VIDEO)
4-Gigapixel Mars Panorama Created Using 407 Photos Taken by Curiosity Rover (Martian Solar Days...
Alvin Toffler On How Tomorrow's Wealth Will Be Created
Poland’s Future Stealth Tank Has Infrared Camouflage
Nicholas Negroponte: Satellites Could Bring Everyone Online