University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Intrinsic reflectance estimation from video and shape for natural dynamic scenes.

Imber, James (2016) Intrinsic reflectance estimation from video and shape for natural dynamic scenes. Doctoral thesis, University of Surrey.

[img]
Preview
Text
thesis_corrected.pdf - Version of Record
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (180MB) | Preview
[img] Text (Request for 6 months' restricted access)
james_imber_thesis_publication_restriction.pdf
Restricted to Repository staff only
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (80kB) | Request a copy
[img]
Preview
Text
Author_Deposit_Agreement.pdf
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (165kB) | Preview

Abstract

Shape information has been recognised as playing a role in intrinsic image estimation since its inception. However, it is only in recent years that hints of the importance of geometry have been found in decomposing surface appearance into albedo and shading estimates. This thesis establishes the central importance of shape in intrinsic surface property estimation for static and dynamic scenes, and introduces methods for the use of approximate shape in a wide range of related problems to provide high-level constraints on shading. A key contribution is intrinsic texture estimation. This is a generalisation of intrinsic image estimation, in which appearance is processed as a function of surface position rather than pixel position. This approach has numerous advantages, in that the shape can be used to resolve occlusion, inter-reflection and attached shading as a natural part of the method. Unlike previous bidirectional texture function estimation approaches, high-quality albedo and shading textures are produced without prior knowledge of materials or lighting. Many of the concepts in intrinsic texture estimation can be extended to single-viewpoint capture for which depth information is available. Depth information greatly reduces the ambiguity of the shading estimation problem, allowing online intrinsic video to be developed for the first time. The availability of a lighting function also allows high-level temporal constraints on shading to be applied over video sequences, which previously required per-pixel correspondence between frames to be established. A number of applications of intrinsic video are investigated, including augmented reality, video stylisation and relighting, all of which run at interactive framerates. The albedo distribution of the input video is preserved, even in the case of natural scenes with complex appearance, and a globally-consistent shading estimate is obtained which remains robust over dynamic sequences. Finally, an integrated framework bridging the gaps between intrinsic image, video and texture estimation is presented for the first time. Approximate scene geometry provides a convenient means of achieving this, and is used in establishing pixel constraints between adjacent cameras, reconstructing scene lighting, and removing cast shadows and inter-reflections. This introduces a unified geometry-based approach to intrinsic image estimation and related fields, which achieves high-quality results for complex natural scenes for a wide range of capture modalities.

Item Type: Thesis (Doctoral)
Divisions : Theses
Authors :
AuthorsEmailORCID
Imber, Jamesjames.imber@imgtec.comUNSPECIFIED
Date : 29 January 2016
Funders : Imagination Technologies Limited
Contributors :
ContributionNameEmailORCID
Thesis supervisorHilton, Adriana.hilton@surrey.ac.ukUNSPECIFIED
Thesis supervisorGuillemaut, Jean-Yvesj.guillemaut@surrey.ac.ukUNSPECIFIED
Uncontrolled Keywords : Intrinsic Images, Intrinsic Video, Bidirectional Texture Functions, Free-Viewpoint Video, Relighting, Augmented Reality, Lighting Reconstruction
Additional Information : Please note the six-month embargo on publication
Depositing User : James Imber
Date Deposited : 09 Feb 2016 10:37
Last Modified : 31 Jul 2016 01:08
URI: http://epubs.surrey.ac.uk/id/eprint/809623

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800