Real-time 3D Face Fitting and Texture Fusion on In-the-wild Videos

Huber, P, Christmas, W, Kittler, JV, Kopp, P and Ratsch, M (2016) Real-time 3D Face Fitting and Texture Fusion on In-the-wild Videos IEEE Signal Processing Letters.

Preview	Text Paper_08122016_SPL_CR_v0.pdf - Accepted version Manuscript Available under License : See the attached licence file. Download (10MB) | Preview
Preview	Text (licence) SRI_deposit_agreement.pdf Available under License : See the attached licence file. Download (33kB) | Preview

Abstract

We present a fully automatic approach to real-time 3D face reconstruction from monocular in-the-wild videos. With the use of a cascaded-regressor based face tracking and a 3D Morphable Face Model shape fitting, we obtain a semi-dense 3D face shape. We further use the texture information from multiple frames to build a holistic 3D face representation from the video footage. Our system is able to capture facial expressions and does not require any person-specific training. We demonstrate the robustness of our approach on the challenging 300 Videos in the Wild (300-VW) dataset. Our real-time fitting framework is available as an open source library at http://4dface.org.

Item Type:	Article
Subjects :	Electronic Engineering
Divisions :	Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :	Name Email ORCID Huber, P Christmas, W Kittler, JV Kopp, P Ratsch, M
Date :	21 December 2016
DOI :	10.1109/LSP.2016.2643284
Copyright Disclaimer :	IEEE Signal Processing Letters
Depositing User :	Symplectic Elements
Date Deposited :	22 Dec 2016 15:26
Last Modified :	31 Oct 2017 19:02
URI:	http://epubs.surrey.ac.uk/id/eprint/813170

Actions (login required)

View Item

Downloads