University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Audio-visual Convolutive Blind Source Separation

Liu, Q, Wang, W and Jackson, PJB (2010) Audio-visual Convolutive Blind Source Separation

Available under License : See the attached licence file.

Download (281kB)
[img] Text (licence)

Download (1kB)


We present a novel method for speech separation from their audio mixtures using the audio-visual coherence. It consists of two stages: in the off-line training process, we use the Gaussian mixture model to characterise statistically the audiovisual coherence with features obtained from the training set; at the separation stage, likelihood maximization is performed on the independent component analysis (ICA)-separated spectral components. To address the permutation and scaling indeterminacies of the frequency-domain blind source separation (BSS), a new sorting and rescaling scheme using the bimodal coherence is proposed.We tested our algorithm on the XM2VTS database, and the results show that our algorithm can address the permutation problem with high accuracy, and mitigate the scaling problem effectively.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors : Liu, Q, Wang, W and Jackson, PJB
Date : 30 September 2010
Contributors :
ContributionNameEmailORCID of Engineering and Technology,
Depositing User : Symplectic Elements
Date Deposited : 09 Dec 2011 15:55
Last Modified : 06 Jul 2019 05:08

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800