University of Surrey

Test tubes in the lab Research in the ATI Dance Research

FaceDirector: Continuous Control of Facial Performance in Video

Malleson, Charles, Bazin, Jean-Charles, Wang, Oliver, Bradley, Derek, Beeler, Thabo, Hilton, Adrian and Sorkine-Hornung, Alexander (2016) FaceDirector: Continuous Control of Facial Performance in Video In: 2015 IEEE International Conference on Computer Vision (ICCV 2015), 13-16 Dec 2015, Santiago, Chile.

FaceDirector.pdf - Accepted version Manuscript

Download (2MB) | Preview


We present a method to continuously blend between multiple facial performances of an actor, which can contain different facial expressions or emotional states. As an example, given sad and angry video takes of a scene, our method empowers the movie director to specify arbitrary weighted combinations and smooth transitions between the two takes in post-production. Our contributions include (1) a robust nonlinear audio-visual synchronization technique that exploits complementary properties of audio and visual cues to automatically determine robust, dense spatiotemporal correspondences between takes, and (2) a seamless facial blending approach that provides the director full control to interpolate timing, facial expression, and local appearance, in order to generate novel performances after filming. In contrast to most previous works, our approach operates entirely in image space, avoiding the need of 3D facial reconstruction. We demonstrate that our method can synthesize visually believable performances with applications in emotion transition, performance correction, and timing control.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Bazin, Jean-Charles
Wang, Oliver
Bradley, Derek
Beeler, Thabo
Sorkine-Hornung, Alexander
Date : May 2016
DOI : 10.1109/ICCV.2015.453
Copyright Disclaimer : © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Related URLs :
Additional Information : Printed proceedings published by Curran Associates, Inc. ISBN: 978-1-467-38392-9. Available at
Depositing User : Clive Harris
Date Deposited : 12 Mar 2019 14:22
Last Modified : 12 Mar 2019 14:22

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800