University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Sign Spotting using Hierarchical Sequential Patterns with Temporal Intervals

Ong, EJ, Koller, O, Pugeault, N and Bowden, R (2014) Sign Spotting using Hierarchical Sequential Patterns with Temporal Intervals In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR'2014), 2014-06-23 - 2014-06-28, Columbus, OH.

Ong_CVPR_2014pp.pdf - ["content_typename_Submitted version (pre-print)" not defined]
Available under License : See the attached licence file.

Download (635kB) | Preview
PDF (licence)
Available under License : See the attached licence file.

Download (33kB) | Preview


This paper tackles the problem of spotting a set of signs occuring in videos with sequences of signs. To achieve this, we propose to model the spatio-temporal signatures of a sign using an extension of sequential patterns that contain temporal intervals called Sequential Interval Patterns (SIP). We then propose a novel multi-class classifier that organises different sequential interval patterns in a hierarchical tree structure called a Hierarchical SIP Tree (HSP-Tree). This allows one to exploit any subsequence sharing that exists between different SIPs of different classes. Multiple trees are then combined together into a forest of HSP-Trees resulting in a strong classifier that can be used to spot signs. We then show how the HSP-Forest can be used to spot sequences of signs that occur in an input video. We have evaluated the method on both concatenated sequences of isolated signs and continuous sign sequences. We also show that the proposed method is superior in robustness and accuracy to a state of the art sign recogniser when applied to spotting a sequence of signs.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
Date : 24 June 2014
Identification Number : 10.1109/CVPR.2014.248
Related URLs :
Additional Information : © 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Depositing User : Symplectic Elements
Date Deposited : 27 Oct 2015 16:52
Last Modified : 27 Oct 2015 16:52

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800