University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Deep learning for speech separation.

Zermini, Alfredo (2020) Deep learning for speech separation. Doctoral thesis, University of Surrey.

[img]
Preview
Text
thesis_revision.pdf
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (16MB) | Preview

Abstract

Speech source separation aims to estimate one or more individual sources from mixtures of multiple sound sources, e.g. speech, noise and music. While humans have an innate ability to separate sources in a sound mixture, this is not a trivial task for computers. In this thesis, we study the problem of speech separation, with a varying degree of complexity with respect to room reverberation, the number of speech sources and the number of microphones available for capturing the sources. We focus on the stateof- the-art deep learning techniques, and investigate the problem of separating speech sources from binaural and B-format mixtures obtained in real reverberant rooms. First, we evaluate a baseline system for binaural speech separation, where fullyconnected Deep Neural Networks (DNNs) and spatial features, such as Interaural Level Difference (ILD) and Interaural Phase Difference (IPD), are used. We further extend this baseline by using the dropout technique to mitigate the overfitting problem and adding spectral features, such as the Log-Power Spectrogram (LPS), to improve the separation performance. Second, we develop a Convolutional Neural Networks (CNNs)-based binaural speech separation system. We then study the potential of using data augmentation techniques to improve speech separation quality. In particular, we introduce contextual frames expansion, by including the information from neighbouring time frames, before and after a given time frame. Finally, we study the use of deep learning methods for B-format recordings. This allows the pressure gradient information to be exploited, in addition to the widely used acoustic pressure information, for deriving the angular features for source separation. Extensive experiments have been performed on two datasets captured in five different rooms in the University of Surrey. The proposed methods are shown to offer improved performance over the state-of-the-art, in terms of separation quality and intelligibility.

Item Type: Thesis (Doctoral)
Divisions : Theses
Authors : Zermini, Alfredo
Date : 30 April 2020
Funders : Marie Curie Initial Training Fellowship of the European Community
DOI : 10.15126/thesis.00854147
Contributors :
ContributionNameEmailORCID
http://www.loc.gov/loc.terms/relators/THSWang, WenwuW.Wang@surrey.ac.uk
http://www.loc.gov/loc.terms/relators/THSPlumbley, Markm.plumbley@surrey.ac.uk
Uncontrolled Keywords : speech separation, deep neural networks, convolutional neural networks, dropout, B-format
Depositing User : Alfredo Zermini
Date Deposited : 19 May 2020 12:23
Last Modified : 20 May 2020 07:31
URI: http://epubs.surrey.ac.uk/id/eprint/854147

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800