University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Robust Facial Feature Tracking Using Shape-Constrained Multi-Resolution Selected Linear Predictors.

Ong, EJ and Bowden, R (2011) Robust Facial Feature Tracking Using Shape-Constrained Multi-Resolution Selected Linear Predictors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33 (9). pp. 1844-1859.

ongPAMIprePrint.pdf - Accepted version Manuscript
Available under License : See the attached licence file.

Download (1MB)
Text (licence)

Download (33kB)


This paper proposes a learnt {\em data-driven} approach for accurate, real-time tracking of facial features using only intensity information, a non-trivial task since the face is a highly deformable object with large textural variations and motion in certain regions. The framework proposed here largely avoids the need for apriori design of feature trackers by automatically identifying the optimal visual support required for tracking a single facial feature point. This is essentially equivalent to automatically determining the visual context required for tracking. Tracking is achieved via biased linear predictors which provide a fast and effective method for mapping pixel-intensities into tracked feature position displacements. Multiple linear predictors are grouped into a rigid flock to increase robustness. To further improve tracking accuracy, a novel probabilistic selection method is used to identify relevant visual areas for tracking a feature point. These selected flocks are then combined into a hierarchical multi-resolution LP model. Finally, we also exploit a simple shape constraint for correcting the occasional tracking failure of a minority of feature points. Experimental results also show that this method performs more robustly and accurately than AAMs, on example sequences that range from SD quality to Youtube quality.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
Ong, EJ
Bowden, R
Date : 2011
DOI : 10.1109/TPAMI.2010.205
Additional Information : © 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Depositing User : Symplectic Elements
Date Deposited : 12 Dec 2012 14:08
Last Modified : 31 Oct 2017 14:33

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800