University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Capturing relative motion and finding modes for action recognition in the wild

Oshin, O, Gilbert, A and Bowden, R (2014) Capturing relative motion and finding modes for action recognition in the wild Computer Vision and Image Understanding, 125. pp. 155-171.


Download (8MB) | Preview


"Actions in the wild" is the term given to examples of human motion that are performed in natural settings, such as those harvested from movies [1] or Internet databases [2]. This paper presents an approach to the categorisation of such activity in video, which is based solely on the relative distribution of spatio-temporal interest points. Presenting the Relative Motion Descriptor, we show that the distribution of interest points alone (without explicitly encoding their neighbourhoods) effectively describes actions. Furthermore, given the huge variability of examples within action classes in natural settings, we propose to further improve recognition by automatically detecting outliers, and breaking complex action categories into multiple modes. This is achieved using a variant of Random Sampling Consensus (RANSAC), which identifies and separates the modes. We employ a novel reweighting scheme within the RANSAC procedure to iteratively reweight training examples, ensuring their inclusion in the final classification model. We demonstrate state-of-the-art performance on five human action datasets. © 2014 Elsevier Inc. All rights reserved.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
Oshin, O
Gilbert, A
Bowden, R
Date : 1 January 2014
DOI : 10.1016/j.cviu.2014.04.005
Additional Information : © 2014. This manuscript version is made available under the CC-BY-NC-ND 4.0 license
Depositing User : Symplectic Elements
Date Deposited : 28 Oct 2015 10:21
Last Modified : 31 Oct 2017 17:46

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800