University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Environmental Sound Classification with Parallel Temporal-spectral Attention

Wang, Helin, Zou, Yuexian, Chong, Dading and Wang, Wenwu (2020) Environmental Sound Classification with Parallel Temporal-spectral Attention In: INTERSPEECH 2020, 25-29 Oct 2020, Shanghai, China.

Environmental Sound Classification with Parallel Temporal-spectral Attention - AAM.pdf - Accepted version Manuscript

Download (1MB) | Preview


Convolutional neural networks (CNN) are one of the best-performing neural network architectures for environmental sound classification (ESC). Recently, temporal attention mechanisms have been used in CNN to capture the useful information from the relevant time frames for audio classification, especially for weakly labelled data where the onset and offset times of the sound events are not applied. In these methods, however, the inherent spectral characteristics and variations are not explicitly exploited when obtaining the deep features. In this paper, we propose a novel parallel temporal-spectral attention mechanism for CNN to learn discriminative sound representations, which enhances the temporal and spectral features by capturing the importance of different time frames and frequency bands. Parallel branches are constructed to allow temporal attention and spectral attention to be applied respectively in order to mitigate interference from the segments without the presence of sound events. The experiments on three environmental sound classification (ESC) datasets and two acoustic scene classification (ASC) datasets show that our method improves the classification performance and also exhibits robustness to noise.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Wang, Helin
Zou, Yuexian
Chong, Dading
Date : 25 October 2020
Copyright Disclaimer : © The authors 2020
Uncontrolled Keywords : Environmental sound classification; Convolutional neural networks; Attention mechanism; Sound event
Related URLs :
Depositing User : Clive Harris
Date Deposited : 03 Aug 2020 14:18
Last Modified : 25 Oct 2020 02:08

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800