University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Spatial synchronization of audiovisual objects by 3D audio object coding

Günel, B, Ekmekcioglu, E and Kondoz, AM (2010) Spatial synchronization of audiovisual objects by 3D audio object coding In: IEEE MMSP 2010, 2010-10-04 - 2010-10-06, Saint Malo, France.

Full text not available from this repository.


Free viewpoint video enables the visualisation of a scene from arbitrary viewpoints and directions. However, this flexibility in video rendering provides a challenge in 3D media for achieving spatial synchronicity between the audio and video objects. When the viewpoint is changed, its effect on the perceived audio scene should be considered to avoid mismatches in the perceived positions of audiovisual objects. Spatial audio coding with such flexibility requires decomposing the sound scene into audio objects initially, and then synthesizing the new scene according to the geometric relations between the A/V capturing setup, selected viewpoint and the rendering system. This paper proposes a free viewpoint audio coding framework for 3D media systems utilising multiview cameras and a microphone array. A real-time source separation technique is used for object decomposition followed by spatial audio coding. Binaural, multichannel sound systems and wave field synthesis systems are addressed. Subjective test results shows that the method achieves spatial synchronicity for various viewpoints consistently, which is not possible by conventional recording techniques.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Divisions : Surrey research (other units)
Authors :
Günel, B
Ekmekcioglu, E
Date : 2010
DOI : 10.1109/MMSP.2010.5662065
Depositing User : Symplectic Elements
Date Deposited : 17 May 2017 11:59
Last Modified : 23 Jan 2020 17:28

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800