University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Non-Sparse Multiple Kernel Fisher Discriminant Analysis

Yan, F, Kittler, J, Mikolajczyk, K and Tahir, A (2011) Non-Sparse Multiple Kernel Fisher Discriminant Analysis Journal of Machine Learning Research, 13. 607 - 642. ISSN 1532-4435

[img]
Preview
PDF
Yan-JMLR-2012(1).pdf
Available under License : See the attached licence file.

Download (542Kb)
[img]
Preview
PDF (licence)
SRI_deposit_agreement.pdf

Download (32Kb)

Abstract

Sparsity-inducing multiple kernel Fisher discriminant analysis (MK-FDA) has been studied in the literature. Building on recent advances in non-sparse multiple kernel learning (MKL), we propose a non-sparse version of MK-FDA, which imposes a general `p norm regularisation on the kernel weights. We formulate the associated optimisation problem as a semi-infinite program (SIP), and adapt an iterative wrapper algorithm to solve it. We then discuss, in light of latest advances inMKL optimisation techniques, several reformulations and optimisation strategies that can potentially lead to significant improvements in the efficiency and scalability of MK-FDA. We carry out extensive experiments on six datasets from various application areas, and compare closely the performance of `p MK-FDA, fixed norm MK-FDA, and several variants of SVM-based MKL (MK-SVM). Our results demonstrate that `p MK-FDA improves upon sparse MK-FDA in many practical situations. The results also show that on image categorisation problems, `p MK-FDA tends to outperform its SVM counterpart. Finally, we also discuss the connection between (MK-)FDA and (MK-)SVM, under the unified framework of regularised kernel machines.

Item Type: Article
Divisions: Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Depositing User: Symplectic Elements
Date Deposited: 12 Oct 2012 10:49
Last Modified: 23 Sep 2013 19:37
URI: http://epubs.surrey.ac.uk/id/eprint/714107

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800