University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Inpainting of Wide-baseline Multiple Viewpoint Video

Gilbert, Andrew, Trumble, Matt, Hilton, Adrian and Collomosse, John (2018) Inpainting of Wide-baseline Multiple Viewpoint Video IEEE Transactions on Visualization and Computer Graphics.

[img]
Preview
Text
TVCG__Wide_baseline_Multiple_Viewpoint_Video_Inpainting_ResubmissionNov2018.pdf - Accepted version Manuscript

Download (26MB) | Preview

Abstract

We describe a non-parametric algorithm for multiple-viewpoint video inpainting. Uniquely, our algorithm addresses the domain of wide baseline multiple-viewpoint video (MVV) with no temporal look-ahead in near real time speed. A Dictionary of Patches (DoP) is built using multi-resolution texture patches reprojected from geometric proxies available in the alternate views. We dynamically update the DoP over time, and a Markov Random Field optimisation over depth and appearance is used to resolve and align a selection of multiple candidates for a given patch, this ensures the inpainting of large regions in a plausible manner conserving both spatial and temporal coherence. We demonstrate the removal of large objects (e.g. people) on challenging indoor and outdoor MVV exhibiting cluttered, dynamic backgrounds and moving cameras.

Item Type: Article
Divisions : Faculty of Arts and Social Sciences > Department of Music and Media
Authors :
NameEmailORCID
Gilbert, AndrewA.Gilbert@surrey.ac.uk
Trumble, Mattmatthew.trumble@surrey.ac.uk
Hilton, AdrianA.Hilton@surrey.ac.uk
Collomosse, JohnJ.Collomosse@surrey.ac.uk
Date : 24 December 2018
DOI : 10.1109/TVCG.2018.2889297
Copyright Disclaimer : © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Uncontrolled Keywords : Computer Graphics; Inpainting; Multiple Viewpoint Video; Cameras; Optimization; Three-dimensional displays; Coherence; Visualization; Dictionaries; Streaming media
Depositing User : Clive Harris
Date Deposited : 11 Jan 2019 11:05
Last Modified : 05 Mar 2019 10:13
URI: http://epubs.surrey.ac.uk/id/eprint/850123

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800