University of Surrey

Test tubes in the lab Research in the ATI Dance Research

MIMiC: Multimodal Interactive Motion Controller

Okwechime, D, Ong, E-J, Bowden, R and Member, S (2011) MIMiC: Multimodal Interactive Motion Controller IEEE Transactions on Multimedia, 13 (2). pp. 255-265.

OkwechimeTMMprePrint.pdf - Accepted version Manuscript
Available under License : See the attached licence file.

Download (3MB)
Text (licence)

Download (33kB)


We introduce a new algorithm for real-time interactive motion control and demonstrate its application to motion captured data, prerecorded videos, and HCI. Firstly, a data set of frames are projected into a lower dimensional space. An appearance model is learnt using a multivariate probability distribution. A novel approach to determining transition points is presented based on k-medoids, whereby appropriate points of intersection in the motion trajectory are derived as cluster centers. These points are used to segment the data into smaller subsequences. A transition matrix combined with a kernel density estimation is used to determine suitable transitions between the subsequences to develop novel motion. To facilitate real-time interactive control, conditional probabilities are used to derive motion given user commands. The user commands can come from any modality including auditory, touch, and gesture. The system is also extended to HCI using audio signals of speech in a conversation to trigger nonverbal responses from a synthetic listener in real-time. We demonstrate the flexibility of the model by presenting results ranging from data sets composed of vectorized images, 2-D, and 3-D point representations. Results show real-time interaction and plausible motion generation between different types of movement.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
Okwechime, D
Ong, E-J
Bowden, R
Member, S
Date : 2011
DOI : 10.1109/TMM.2010.2096410
Related URLs :
Additional Information : Copyright 2011 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Depositing User : Symplectic Elements
Date Deposited : 22 May 2012 15:51
Last Modified : 31 Oct 2017 14:33

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800