Multimodal Emotion Recognition

Haq, S and Jackson, PJB (2010) Multimodal Emotion Recognition In: Machine Audition: Principles, Algorithms and Systems. IGI Global, 398 - 423. ISBN 1615209190

	Plain Text (licence) licence.txt Download (1kB)
Preview	PDF jackson_chapter_wang_book.pdf - Published Version Download (961kB)

Abstract

Recent advances in human-computer interaction technology go beyond the successful transfer of data between human and machine by seeking to improve the naturalness and friendliness of user interactions. An important augmentation, and potential source of feedback, comes from recognizing the user‘s expressed emotion or affect. This chapter presents an overview of research efforts to classify emotion using different modalities: audio, visual and audio-visual combined. Theories of emotion provide a framework for defining emotional categories or classes. The first step, then, in the study of human affect recognition involves the construction of suitable databases. The authorsdescribe fifteen audio, visual and audio-visual data sets, and the types of feature that researchers have used to represent the emotional content. They discuss data-driven methods of feature selection and reduction, which discard noise and irrelevant information to maximize the concentration of useful information. They focus on the popular types of classifier that are used to decide to which emotion class a given example belongs, and methods of fusing information from multiple modalities. Finally, the authors point to some interesting areas for future investigation in this field, and conclude.

Item Type:	Book Section
Additional Information:	Posted with the publisher's permission. Copyright © 2011 by IGI Global. All rights reserved. No part of this publication may be reproduced, stored or distributed in any form or by any means, electronic or mechanical, including photocopying, without written permission from the publisher. Product or company names used in this set are for identification purposes only. Inclusion of the names of the products or companies does not indicate a claim of ownership by IGI Global of the trademark or registered trademark.
Uncontrolled Keywords:	Computers
Divisions:	Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Depositing User:	Symplectic Elements
Date Deposited:	03 May 2012 09:18
Last Modified:	23 Sep 2013 18:50
URI:	http://epubs.surrey.ac.uk/id/eprint/7730

Actions (login required)

View Item

Downloads