University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Particle Filter based Probabilistic Forced Alignment for Continuous Gesture Recognition

Camgöz, Necati Cihan, Hadfield, Simon and Bowden, Richard (2017) Particle Filter based Probabilistic Forced Alignment for Continuous Gesture Recognition In: IEEE International Conference on Computer Vision Workshops (ICCVW) 2017, 22-29 Oct 2017, Venice, Italy.

[img]
Preview
Text
Particle Filter based Probabilistic Forced Alignment for Continuous Gesture Recognition.pdf - Accepted version Manuscript

Download (1MB) | Preview

Abstract

In this paper, we propose a novel particle filter based probabilistic forced alignment approach for training spatiotemporal deep neural networks using weak border level annotations. The proposed method jointly learns to localize and recognize isolated instances in continuous streams. This is done by drawing training volumes from a prior distribution of likely regions and training a discriminative 3D-CNN from this data. The classifier is then used to calculate the posterior distribution by scoring the training examples and using this as the prior for the next sampling stage. We apply the proposed approach to the challenging task of large-scale user-independent continuous gesture recognition. We evaluate the performance on the popular ChaLearn 2016 Continuous Gesture Recognition (ConGD) dataset. Our method surpasses state-of-the-art results by obtaining 0:3646 and 0:3744 Mean Jaccard Index Score on the validation and test sets of ConGD, respectively. Furthermore, we participated in the ChaLearn 2017 Continuous Gesture Recognition Challenge and was ranked 3rd. It should be noted that our method is learner independent, it can be easily combined with other approaches.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
NameEmailORCID
Camgöz, Necati Cihann.camgoz@surrey.ac.ukUNSPECIFIED
Hadfield, Simons.hadfield@surrey.ac.ukUNSPECIFIED
Bowden, RichardR.Bowden@surrey.ac.ukUNSPECIFIED
Date : 2017
Copyright Disclaimer : © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Depositing User : Clive Harris
Date Deposited : 25 Aug 2017 08:31
Last Modified : 29 Oct 2017 02:08
URI: http://epubs.surrey.ac.uk/id/eprint/842037

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800