University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Social interactive human video synthesis

Okwechime, D, Ong, Eng-Jon, Gilbert, Andrew and Bowden, Richard (2011) Social interactive human video synthesis In: 10th Asian Conference on Computer Vision, 2010-11-08 - 2010-11-12, Queenstown, New Zealand.

[img] Text
Restricted to Repository staff only
Available under License : See the attached licence file.

Download (209kB)
[img] Text (licence)
Restricted to Repository staff only

Download (33kB)


In this paper, we propose a computational model for social interaction between three people in a conversation, and demonstrate results using human video motion synthesis. We utilised semi-supervised computer vision techniques to label social signals between the people, like laughing, head nod and gaze direction. Data mining is used to deduce frequently occurring patterns of social signals between a speaker and a listener in both interested and not interested social scenarios, and the mined confidence values are used as conditional probabilities to animate social responses. The human video motion synthesis is done using an appearance model to learn a multivariate probability distribution, combined with a transition matrix to derive the likelihood of motion given a pose configuration. Our system uses social labels to more accurately define motion transitions and build a texture motion graph. Traditional motion synthesis algorithms are best suited to large human movements like walking and running, where motion variations are large and prominent. Our method focuses on generating more subtle human movement like head nods. The user can then control who speaks and the interest level of the individual listeners resulting in social interactive conversational agents.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Surrey research (other units)
Authors :
Okwechime, D
Date : 2011
DOI : 10.1007/978-3-642-19315-6_20
Copyright Disclaimer : Copyright Springer-Verlag 2011
Contributors :
Uncontrolled Keywords : Association Rule; Mining Association Rule; Texture Synthesis; Video Texture; Interested Scenario
Depositing User : Symplectic Elements
Date Deposited : 28 Mar 2017 14:42
Last Modified : 23 Jan 2020 12:46

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800