Audio-visual Convolutive Blind Source Separation
Liu, Q, Wang, W and Jackson, PJB (2010) Audio-visual Convolutive Blind Source Separation
Available under License : See the attached licence file.
|Plain Text (licence)|
We present a novel method for speech separation from their audio mixtures using the audio-visual coherence. It consists of two stages: in the off-line training process, we use the Gaussian mixture model to characterise statistically the audiovisual coherence with features obtained from the training set; at the separation stage, likelihood maximization is performed on the independent component analysis (ICA)-separated spectral components. To address the permutation and scaling indeterminacies of the frequency-domain blind source separation (BSS), a new sorting and rescaling scheme using the bimodal coherence is proposed.We tested our algorithm on the XM2VTS database, and the results show that our algorithm can address the permutation problem with high accuracy, and mitigate the scaling problem effectively.
|Item Type:||Conference or Workshop Item (Paper)|
|Divisions:||Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing|
|Deposited By:||Symplectic Elements|
|Deposited On:||09 Dec 2011 15:55|
|Last Modified:||19 May 2013 02:34|
Repository Staff Only: item control page