University of Surrey

Test tubes in the lab Research in the ATI Dance Research

A joint separation-classification model for sound event detection of weakly labelled data

Kong, Qiuqiang, Xu, Yong, Wang, Wenwu and Plumbley, Mark D (2018) A joint separation-classification model for sound event detection of weakly labelled data In: ICASSP 2018 - 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 15 - 20 Apr 2018, Calgary, Canada.

[img]
Preview
Text
ICASSP_2018_weak_separation.pdf - Accepted version Manuscript

Download (1MB) | Preview

Abstract

Source separation (SS) aims to separate individual sources from an audio recording. Sound event detection (SED) aims to detect sound events from an audio recording. We propose a joint separation-classification (JSC) model trained only on weakly labelled audio data, that is, only the tags of an audio recording are known but the time of the events are unknown. First, we propose a separation mapping from the time-frequency (T-F) representation of an audio to the T-F segmentation masks of the audio events. Second, a classification mapping is built from each T-F segmentation mask to the presence probability of each audio event. In the source separation stage, sources of audio events and time of sound events can be obtained from the T-F segmentation masks. The proposed method achieves an equal error rate (EER) of 0.14 in SED, outperforming deep neural network baseline of 0.29. Source separation SDR of 8.08 dB is obtained by using global weighted rank pooling (GWRP) as probability mapping, outperforming the global max pooling (GMP) based probability mapping giving SDR at 0.03 dB. Source code of our work is published.

Item Type: Conference or Workshop Item (Conference Poster)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
NameEmailORCID
Kong, Qiuqiangq.kong@surrey.ac.uk
Xu, Yongyong.xu@surrey.ac.uk
Wang, WenwuW.Wang@surrey.ac.uk
Plumbley, Mark Dm.plumbley@surrey.ac.uk
Date : 2018
Funders : EPSRC
Copyright Disclaimer : © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Uncontrolled Keywords : Sound event detection, source separation, weakly labelled data.
Depositing User : Melanie Hughes
Date Deposited : 13 Mar 2018 09:11
Last Modified : 18 Apr 2018 15:09
URI: http://epubs.surrey.ac.uk/id/eprint/845985

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800