Face2Face: Real-time Face Capture and Reenactment of RGB Videos




Matthias Niessner: “We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.”
Read more: popularmechanics.com & stanford.edu
Facial Recognition
Visual Recognition
Computer Vision
Real-time Face Reenactment, Matthias Niessner, Face2Face, Real-time Face Capture, RGB Videos, Facial Recognition

Real-time Face Reenactment, Matthias Niessner, Face2Face, Real-time Face Capture, RGB Videos, Facial Recognition

Real-time Face Reenactment, Matthias Niessner, Face2Face, Real-time Face Capture, RGB Videos, Facial Recognition

Donate BTC: 1DUUZbiqjbJvzjuRZEwTS47bqgmnhEJ4XG

Donate ETH: 0x981FcEAAa895C6cee76D2876e9AfC649Dc0C4c75

More Posts:

Lingerie Model Wanders The Shop At Night (+VIDEO)
Russia’s Nuclear Powered Scientific Museum-On-Train
Future Green Concept For Fresh Air
Worried About Global Warming? Artificial Clouds May Cool The Planet.
ReFIT Algorithm Will Lead To Mind Controlled Robotic Limbs
Multi-purpose Unmanned Copter Concept
Levitating Graphite Disks Will Lead To A New Light Energy Conversion System (+VIDEO)
A Smartphone App Analyzes Any Urine Sample
Carbyne - New Hardest Material Is Double The Strength Of Graphene
Deus Ex's Bionic Limbs Are Being Made For Real: 3D Print Yourself A Hand