University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Deep factorised inverse-sketching

Pang, K., Li, D., Song, J., Song, Yi-Zhe, Xiang, T. and Hospedales, T.M. (2018) Deep factorised inverse-sketching In: 15th European Conference on Computer Vision (ECCV 2018), 08-14 Sep 2018, Munich, Germany.

Full text not available from this repository.

Abstract

Modelling human free-hand sketches has become topical recently, driven by practical applications such as fine-grained sketch based image retrieval (FG-SBIR). Sketches are clearly related to photo edge-maps, but a human free-hand sketch of a photo is not simply a clean rendering of that photo’s edge map. Instead there is a fundamental process of abstraction and iconic rendering, where overall geometry is warped and salient details are selectively included. In this paper we study this sketching process and attempt to invert it. We model this inversion by translating iconic free-hand sketches to contours that resemble more geometrically realistic projections of object boundaries, and separately factorise out the salient added details. This factorised re-representation makes it easier to match a free-hand sketch to a photo instance of an object. Specifically, we propose a novel unsupervised image style transfer model based on enforcing a cyclic embedding consistency constraint. A deep FG-SBIR model is then formulated to accommodate complementary discriminative detail from each factorised sketch for better matching with the corresponding photo. Our method is evaluated both qualitatively and quantitatively to demonstrate its superiority over a number of state-of-the-art alternatives for style transfer and FG-SBIR.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
NameEmailORCID
Pang, K.
Li, D.
Song, J.
Song, Yi-Zhey.song@surrey.ac.uk
Xiang, T.
Hospedales, T.M.
Date : 7 October 2018
DOI : 10.1007/978-3-030-01267-0_3
Related URLs :
Depositing User : Clive Harris
Date Deposited : 03 Jul 2019 13:45
Last Modified : 03 Jul 2019 13:45
URI: http://epubs.surrey.ac.uk/id/eprint/852112

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800