University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Spelling It Out: Real–Time ASL Fingerspelling Recognition

Pugeault, N and Bowden, R (2011) Spelling It Out: Real–Time ASL Fingerspelling Recognition In: ICCV 2011: 1st IEEE Workshop on Consumer Depth Cameras for Computer Vision, 2011-11-06 - 2011-11-13, Barcelona, Spain.

[img]
Preview
PDF
PugeaultBowden2011b.pdf
Available under License : See the attached licence file.

Download (5MB)
[img]
Preview
PDF (licence)
SRI_deposit_agreement.pdf

Download (33kB)

Abstract

This article presents an interactive hand shape recognition user interface for American Sign Language (ASL) finger-spelling. The system makes use of a Microsoft Kinect device to collect appearance and depth images, and of the OpenNI+NITE framework for hand detection and tracking. Hand-shapes corresponding to letters of the alphabet are characterized using appearance and depth images and classified using random forests. We compare classification using appearance and depth images, and show a combination of both lead to best results, and validate on a dataset of four different users. This hand shape detection works in real-time and is integrated in an interactive user interface allowing the signer to select between ambiguous detections and integrated with an English dictionary for efficient writing.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Copyright 2011 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Divisions: Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Depositing User: Symplectic Elements
Date Deposited: 22 May 2012 08:22
Last Modified: 09 Jun 2014 13:36
URI: http://epubs.surrey.ac.uk/id/eprint/531435

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800