University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Reproducing Real World Acoustics in Virtual Reality Using Spherical Cameras

Remaggi, Luca, Kim, Hansung, Jackson, Philip J. B. and Hilton, Adrian (2019) Reproducing Real World Acoustics in Virtual Reality Using Spherical Cameras In: 2019 AES International Conference on Immersive and Interactive Audio, 27-29 Mar 2019, York, UK.

[img] Text
Remaggietal_AESConference.pdf - Accepted version Manuscript
Restricted to Repository staff only until 27 September 2019.

Download (3MB)

Abstract

Virtual Reality (VR) systems have been intensely explored, with several research communities investigating the different modalities involved. Regarding the audio modality, one of the main issues is the generation of sound that is perceptually coherent with the visual reproduction. Here, we propose a pipeline for creating plausible interactive reverb using visual information: first, we characterize real environment acoustics given a pair of spherical cameras; then, we reproduce reverberant spatial sound, by using the estimated acoustics, within a VR scene. The evaluation is made by extracting the room impulse responses (RIRs) of four virtually rendered rooms. Results show agreement, in terms of objective metrics, between the synthesized acoustics and the ones calculated from RIRs recorded within the respective real rooms.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
NameEmailORCID
Remaggi, Lucal.remaggi@surrey.ac.uk
Kim, HansungH.Kim@surrey.ac.uk
Jackson, Philip J. B.P.Jackson@surrey.ac.uk
Hilton, AdrianA.Hilton@surrey.ac.uk
Date : 27 March 2019
Funders : Engineering and Physical Sciences Research Council (EPSRC)
Copyright Disclaimer : © 2019 Audio Engineering Society. This paper was peer-reviewed as a complete manuscript for presentation at this conference. This paper is available in the AES E-Library (http://www.aes.org/e-lib) all rights reserved. Reproduction of this paper, or any portion thereof, is not permitted without direct permission from the Journal of the Audio Engineering Society.
Related URLs :
Depositing User : Clive Harris
Date Deposited : 01 Feb 2019 13:56
Last Modified : 08 May 2019 11:42
URI: http://epubs.surrey.ac.uk/id/eprint/850342

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800