Improve the Spoofing Resistance of Multimodal Verification with Representation-Based Measures

Huang, Zengxi, Feng, Zhenhua, Kittler, Josef and Liu, Yiguang (2018) Improve the Spoofing Resistance of Multimodal Verification with Representation-Based Measures In: Pattern Recognition and Computer Vision. PRCV 2018. Lecture Notes in Computer Science, 11258 . Springer, pp. 388-399. ISBN 978-3-030-03337-8 Online ISBN: 978-3-030-03338-5

Preview

Text PRCV_2018.pdf - Accepted version Manuscript Download (407kB) | Preview

Abstract

Recently, the security of multimodal verification has become a grow-ing concern since many fusion systems have been known to be easily deceived by partial spoof attacks, i.e. only a subset of modalities is spoofed. In this paper, we verify such a vulnerability and propose to use two representation-based met-rics to close this gap. Firstly, we use the collaborative representation fidelity with non-target subjects to measure the affinity of a query sample to the claimed client. We further consider sparse coding as a competing comparison among the client and the non-target subjects, and hence explore two sparsity-based measures for recognition. Last, we select the representation-based measure, and assemble its score and the affinity score of each modality to train a support vector machine classifier. Our experimental results on a chimeric multimodal database with face and ear traits demonstrate that in both regular verification and partial spoof at-tacks, the proposed method significant

Item Type:	Book Section
Divisions :	Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :	Name Email ORCID Huang, Zengxi Feng, Zhenhua z.feng@surrey.ac.uk Kittler, Josef J.Kittler@surrey.ac.uk Liu, Yiguang
Editors :	Name Email ORCID Lai, Jian-Huang Liu, Cheng-Lin Chen, Xilin Zhou, Jie Tan, Tieniu Zheng, Nanning Zha, Hongbin
Date :	3 November 2018
Funders :	EPSRC; EPSRC/dstl/MURI
Copyright Disclaimer :	© Springer Nature Switzerland AG 2018
Uncontrolled Keywords :	Multimodal Verification, Spoof Attacks, Representation-based Measure, Support Vector Machine.
Additional Information :	First Chinese Conference, PRCV 2018, Guangzhou, China, November 23-26, 2018, Proceedings, Part III. Also part of the Image Processing, Computer Vision, Pattern Recognition, and Graphics book sub series (LNIP, volume 11258)
Depositing User :	Melanie Hughes
Date Deposited :	21 Nov 2018 09:55
Last Modified :	11 Dec 2018 11:24
URI:	http://epubs.surrey.ac.uk/id/eprint/849918

Actions (login required)

View Item

Downloads