University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Particle Filter based Probabilistic Forced Alignment for Continuous Gesture Recognition

Camgöz, Necati Cihan, Hadfield, Simon and Bowden, Richard (2017) Particle Filter based Probabilistic Forced Alignment for Continuous Gesture Recognition In: IEEE International Conference on Computer Vision Workshops (ICCVW) 2017, 22-29 Oct 2017, Venice, Italy.

camgoz2017iccvw.pdf - Accepted version Manuscript

Download (1MB) | Preview


In this paper, we propose a novel particle filter based probabilistic forced alignment approach for training spatiotemporal deep neural networks using weak border level annotations. The proposed method jointly learns to localize and recognize isolated instances in continuous streams. This is done by drawing training volumes from a prior distribution of likely regions and training a discriminative 3D-CNN from this data. The classifier is then used to calculate the posterior distribution by scoring the training examples and using this as the prior for the next sampling stage. We apply the proposed approach to the challenging task of large-scale user-independent continuous gesture recognition. We evaluate the performance on the popular ChaLearn 2016 Continuous Gesture Recognition (ConGD) dataset. Our method surpasses state-of-the-art results by obtaining 0:3646 and 0:3744 Mean Jaccard Index Score on the validation and test sets of ConGD, respectively. Furthermore, we participated in the ChaLearn 2017 Continuous Gesture Recognition Challenge and was ranked 3rd. It should be noted that our method is learner independent, it can be easily combined with other approaches.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Camgöz, Necati
Date : 29 October 2017
Copyright Disclaimer : © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Related URLs :
Depositing User : Clive Harris
Date Deposited : 25 Aug 2017 08:31
Last Modified : 16 Jan 2019 18:55

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800