University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Real-time 3D Face Fitting and Texture Fusion on In-the-wild Videos

Huber, P, Christmas, W, Kittler, JV, Kopp, P and Ratsch, M (2016) Real-time 3D Face Fitting and Texture Fusion on In-the-wild Videos IEEE Signal Processing Letters.

[img]
Preview
Text
Paper_08122016_SPL_CR_v0.pdf - Accepted version Manuscript
Available under License : See the attached licence file.

Download (10MB) | Preview
[img]
Preview
Text (licence)
SRI_deposit_agreement.pdf
Available under License : See the attached licence file.

Download (33kB) | Preview

Abstract

We present a fully automatic approach to real-time 3D face reconstruction from monocular in-the-wild videos. With the use of a cascaded-regressor based face tracking and a 3D Morphable Face Model shape fitting, we obtain a semi-dense 3D face shape. We further use the texture information from multiple frames to build a holistic 3D face representation from the video footage. Our system is able to capture facial expressions and does not require any person-specific training. We demonstrate the robustness of our approach on the challenging 300 Videos in the Wild (300-VW) dataset. Our real-time fitting framework is available as an open source library at http://4dface.org.

Item Type: Article
Subjects : Electronic Engineering
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
NameEmailORCID
Huber, PUNSPECIFIEDUNSPECIFIED
Christmas, WUNSPECIFIEDUNSPECIFIED
Kittler, JVUNSPECIFIEDUNSPECIFIED
Kopp, PUNSPECIFIEDUNSPECIFIED
Ratsch, MUNSPECIFIEDUNSPECIFIED
Date : 21 December 2016
Identification Number : 10.1109/LSP.2016.2643284
Copyright Disclaimer : IEEE Signal Processing Letters
Depositing User : Symplectic Elements
Date Deposited : 22 Dec 2016 15:26
Last Modified : 31 Oct 2017 19:02
URI: http://epubs.surrey.ac.uk/id/eprint/813170

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800