University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Environmental Sound Classification with Parallel Temporal-spectral Attention

Wang, Helin, Zou, Yuexian, Chong, Dading and Wang, Wenwu (2020) Environmental Sound Classification with Parallel Temporal-spectral Attention In: INTERSPEECH 2020, 25-29 Oct 2020, Shanghai, China.

[img] Text
Environmental Sound Classification with Parallel Temporal-spectral Attention - AAM.pdf - Accepted version Manuscript
Restricted to Repository staff only until 25 October 2020.

Download (1MB)

Abstract

Convolutional neural networks (CNN) are one of the best-performing neural network architectures for environmental sound classification (ESC). Recently, temporal attention mechanisms have been used in CNN to capture the useful information from the relevant time frames for audio classification, especially for weakly labelled data where the onset and offset times of the sound events are not applied. In these methods, however, the inherent spectral characteristics and variations are not explicitly exploited when obtaining the deep features. In this paper, we propose a novel parallel temporal-spectral attention mechanism for CNN to learn discriminative sound representations, which enhances the temporal and spectral features by capturing the importance of different time frames and frequency bands. Parallel branches are constructed to allow temporal attention and spectral attention to be applied respectively in order to mitigate interference from the segments without the presence of sound events. The experiments on three environmental sound classification (ESC) datasets and two acoustic scene classification (ASC) datasets show that our method improves the classification performance and also exhibits robustness to noise.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
NameEmailORCID
Wang, Helin
Zou, Yuexian
Chong, Dading
Wang, WenwuW.Wang@surrey.ac.uk
Date : 25 October 2020
Copyright Disclaimer : © The authors 2020
Uncontrolled Keywords : Environmental sound classification; Convolutional neural networks; Attention mechanism; Sound event
Related URLs :
Depositing User : Clive Harris
Date Deposited : 03 Aug 2020 14:18
Last Modified : 03 Aug 2020 14:18
URI: http://epubs.surrey.ac.uk/id/eprint/858343

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800