University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Images as Sets of Locally Weighted Features

deCampos, TE, Csurka, G and Perronnin, F (2012) Images as Sets of Locally Weighted Features Computer Vision and Image Understanding (CVIU), 116 (1). pp. 68-85.

Full text not available from this repository.


This paper presents a generic framework in which images are modelled as order-less sets of weighted visual features. Each visual feature is associated with a weight factor that may inform its relevance. This framework can be applied to various bag-of-features approaches such as the bag-of-visual-word or the Fisher kernel representations. We suggest that if dense sampling is used, different schemes to weight local features can be evaluated, leading to results that are often better than the combination of multiple sampling schemes, at a much lower computational cost, because the features are extracted only once. This allows our framework to be a test-bed for saliency estimation methods in image categorisation tasks. We explored two main possibilities for the estimation of local feature relevance. The first one is based on the use of saliency maps obtained from human feedback, either by gaze tracking or by mouse clicks. The method is able to profit from such maps, leading to a significant improvement in categorisation performance. The second possibility is based on automatic saliency estimation methods, including Itti & Koch’s method and SIFT’s DoG. We evaluated the proposed framework and saliency estimation methods using an in house dataset and the PASCAL VOC 2008/2007 dataset, showing that some of the saliency estimation methods lead to a significant performance improvement in comparison to the standard unweighted representation.

Item Type: Article
Divisions : Surrey research (other units)
Authors : deCampos, TE, Csurka, G and Perronnin, F
Date : 2012
DOI : 10.1016/j.cviu.2011.07.011
Depositing User : Symplectic Elements
Date Deposited : 17 May 2017 12:12
Last Modified : 24 Jan 2020 21:53

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800