University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Improved Detection of Ball Hit Events in a Tennis Game Using Multimodal Information

Huang, Q, Cox, S, Yan, F, deCampos, TE, Windridge, D, Kittler, J and Christmas, W (2011) Improved Detection of Ball Hit Events in a Tennis Game Using Multimodal Information In: International Conference on Auditory-Visual Speech Processing, 2011-08-31 - 2011-09-03, Volterra, Italy.

Available under License : See the attached licence file.

Download (264kB)
Text (licence)

Download (33kB)


We describe a novel framework to detect ball hits in a tennis game by combining audio and visual information. Ball hit detection is a key step in understanding a game such as tennis, but single-mode approaches are not very successful: audio detection suffers from interfering noise and acoustic mismatch, video detection is made difficult by the small size of the ball and the complex background of the surrounding environment. Our goal in this paper is to improve detection performance by focusing on high-level information (rather than low-level features), including the detected audio events, the ball’s trajectory, and inter-event timing information. Visual information supplies coarse detection of the ball-hits events. This information is used as a constraint for audio detection. In addition, useful gains in detection performance can be obtained by using and inter-ballhit timing information, which aids prediction of the next ball hit. This method seems to be very effective in reducing the interference present in low-level features. After applying this method to a women’s doubles tennis game, we obtained improvements in the F-score of about 30% (absolute) for audio detection and about 10% for video detection.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
Huang, Q
Cox, S
Yan, F
deCampos, TE
Windridge, D
Kittler, J
Christmas, W
Date : September 2011
Contributors :
ContributionNameEmailORCID Computer Science and Communication,
Depositing User : Symplectic Elements
Date Deposited : 27 Feb 2012 12:52
Last Modified : 31 Oct 2017 14:20

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800