University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Multiple Riemannian Manifold-valued Descriptors based Image Set Classification with Multi-Kernel Metric Learning

Wang, Rui, Wu, Xiao-Jun, Chen, Kai-Xuan and Kittler, Josef (2020) Multiple Riemannian Manifold-valued Descriptors based Image Set Classification with Multi-Kernel Metric Learning IEEE Transactions on Big Data.

Final-version-IEEE-TBD.pdf - Accepted version Manuscript

Download (4MB) | Preview


The importance of wild video based image set recognition is becoming monotonically increasing. However, the contents of these collected videos are often complicated, and how to efficiently perform set modeling and feature extraction is a big challenge in CV community. Recently, some proposed image set classification methods have made a considerable advance by modeling the original image set with covariance matrix, linear subspace, or Gaussian distribution. Moreover, the distinctive geometry spanned by them are three types of Riemannian manifolds. As a matter of fact, most of them just adopt a single geometric model to describe each set data, which may lose some information for classification. To tackle this, we propose a novel algorithm to model each image set from a multi-geometric perspective. Specifically, the covariance matrix, linear subspace, and Gaussian distribution are applied for set representation simultaneously. In order to fuse these multiple heterogeneous features, the well-equipped Riemannian kernel functions are first utilized to map them into high dimensional Hilbert spaces. Then, a multi-kernel metric learning framework is devised to embed the learned hybrid kernels into a lower dimensional common subspace for classification. We conduct experiments on four widely used datasets. Extensive experimental results justify its superiority over the state-of-the-art.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Wang, Rui
Wu, Xiao-Jun
Chen, Kai-Xuan
Date : 20 March 2020
Funders : National Key Research and Development Program of China, National Natural Science Foundation of China, 111 Project of Ministry of Education of China, U.K. Engineering and Physical Sciences Research Council
DOI : 10.1109/TBDATA.2020.2982146
Grant Title : National Key Research and Development Program of China
Copyright Disclaimer : Copyright © 1969, IEEE
Depositing User : James Marshall
Date Deposited : 03 Jul 2020 13:48
Last Modified : 03 Jul 2020 13:48

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800