University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Learning sequential patterns for lipreading

Ong, EJ and Bowden, R (2011) Learning sequential patterns for lipreading BMVC 2011 - Proceedings of the British Machine Vision Conference 2011.

[img]
Preview
Text
Ong_paper55.pdf - ["content_typename_Submitted version (pre-print)" not defined]
Available under License : See the attached licence file.

Download (181kB) | Preview
[img]
Preview
PDF (licence)
SRI_deposit_agreement.pdf
Available under License : See the attached licence file.

Download (33kB) | Preview

Abstract

This paper proposes a novel machine learning algorithm (SP-Boosting) to tackle the problem of lipreading by building visual sequence classifiers based on sequential patterns. We show that an exhaustive search of optimal sequential patterns is not possible due to the immense search space, and tackle this with a novel, efficient tree-search method with a set of pruning criteria. Crucially, the pruning strategies preserve our ability to locate the optimal sequential pattern. Additionally, the tree-based search method accounts for the training set's boosting weight distribution. This temporal search method is then integrated into the boosting framework resulting in the SP-Boosting algorithm. We also propose a novel constrained set of strong classifiers that further improves recognition accuracy. The resulting learnt classifiers are applied to lipreading by performing multi-class recognition on the OuluVS database. Experimental results show that our method achieves state of the art recognition performane, using only a small set of sequential patterns. © 2011. The copyright of this document resides with its authors.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
AuthorsEmailORCID
Ong, EJUNSPECIFIEDUNSPECIFIED
Bowden, RUNSPECIFIEDUNSPECIFIED
Date : 1 January 2011
Identification Number : 10.5244/C25.55
Additional Information : Copyright 2011. The copyright of this document resides with its authors. It may be distributed unchanged freely in print or electronic forms.
Depositing User : Symplectic Elements
Date Deposited : 18 Nov 2015 09:47
Last Modified : 18 Nov 2015 09:47
URI: http://epubs.surrey.ac.uk/id/eprint/808985

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800