University of Surrey

Test tubes in the lab Research in the ATI Dance Research

An Audio-Visual Method for Room Boundary Estimation and Material Recognition

Remaggi, Luca, Jackson, Philip J. B., Kim, Hansung and Hilton, Adrian (2018) An Audio-Visual Method for Room Boundary Estimation and Material Recognition In: 2018 Workshop on Audio-Visual Scene Understanding for Immersive Multimedia (AVSU’18), 22-26 Oct 2018, Seoul, Korea.

An Audio-Visual Method for Room Boundary Estimation and Material Recognition.pdf - Accepted version Manuscript

Download (1MB) | Preview


In applications such as virtual and augmented reality, a plausible and coherent audio-visual reproduction can be achieved by deeply understanding the reference scene acoustics. This requires knowledge of the scene geometry and related materials. In this paper, we present an audio-visual approach for acoustic scene understanding. We propose a novel material recognition algorithm, that exploits information carried by acoustic signals. The acoustic absorption coefficients are selected as features. The training dataset was constructed by combining information available in the literature, and additional labeled data that we recorded in a small room having short reverberation time (RT60). Classic machine learning methods are used to validate the model, by employing data recorded in five rooms, having different sizes and RT60s. The estimated materials are utilized to label room boundaries, reconstructed by a visionbased method. Results show 89 % and 80 % agreement between the estimated and reference room volumes and materials, respectively.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Jackson, Philip J.
Date : 2018
DOI : 10.1145/3264869.3264876
Copyright Disclaimer : © 2018 Association for Computing Machinery. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from
Uncontrolled Keywords : Audio-Visual; Material Recognition; Room Boundary Estimation; KNN; Acoustic Absorption Coefficient
Related URLs :
Depositing User : Clive Harris
Date Deposited : 13 Aug 2018 14:24
Last Modified : 16 Nov 2018 10:18

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800