University of Surrey

Test tubes in the lab Research in the ATI Dance Research

May the force be with you: Force-aligned signwriting for automatic subunit annotation of corpora

Koller, O, Koller, O, Ney, H and Bowden, R (2013) May the force be with you: Force-aligned signwriting for automatic subunit annotation of corpora 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013. pp. 1-6.

[img]
Preview
Text
Koller_FG2013.pdf - ["content_typename_Submitted version (pre-print)" not defined]
Available under License : See the attached licence file.

Download (256kB) | Preview
[img]
Preview
PDF (licence)
SRI_deposit_agreement.pdf
Available under License : See the attached licence file.

Download (33kB) | Preview

Abstract

We propose a method to generate linguistically meaningful subunits in a fully automated fashion for sign language corpora. The ability to automate the process of subunit annotation has profound effects on the data available for training sign language recognition systems. The approach is based on the idea that subunits are shared among different signs. With sufficient data and knowledge of possible signing variants, accurate automatic subunit sequences are produced, matching the specific characteristics of given sign language data. Specifically we demonstrate how an iterative forced alignment algorithm can be used to transfer the knowledge of a user-edited open sign language dictionary to the task of annotating a challenging, large vocabulary, multi-signer corpus recorded from public TV. Existing approaches focus on labour intensive manual subunit annotations or on data-driven approaches. Our method yields an average precision and recall of 15% under the maximum achievable accuracy with little user intervention beyond providing a simple word gloss. © 2013 IEEE.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
AuthorsEmailORCID
Koller, OUNSPECIFIEDUNSPECIFIED
Koller, OUNSPECIFIEDUNSPECIFIED
Ney, HUNSPECIFIEDUNSPECIFIED
Bowden, RUNSPECIFIEDUNSPECIFIED
Date : 20 August 2013
Identification Number : 10.1109/FG.2013.6553777
Additional Information : © 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Depositing User : Symplectic Elements
Date Deposited : 17 Nov 2015 17:07
Last Modified : 17 Nov 2015 17:07
URI: http://epubs.surrey.ac.uk/id/eprint/808961

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800