University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Example-based Reflectance Estimation for Capturing Relightable Models of People

Stroia-Williams, P and Hilton, A (2008) Example-based Reflectance Estimation for Capturing Relightable Models of People

[img]
Preview
PDF
williams08cvmp_submission.pdf
Available under License : See the attached licence file.

Download (7Mb)
[img]
Preview
PDF (licence)
SRI_deposit_agreement.pdf

Download (32Kb)

Abstract

We present a new approach to reflectance estimation for dynamic scenes. Non-parametric image statistics are used to transfer reflectance properties from a static example set to a dynamic image sequence. The approach allows reflectance estimation for surface materials with inhomogeneous appearance, such as those which commonly occur with patterned or textured clothing. Material reflectance properties are initially estimated from static images of the subject under multiple directional illuminations using photometric stereo. The estimated reflectance together with the corresponding image under uniform ambient illumination form a prior set of reference material observations. Material reflectance properties are then estimated for video sequences of a moving person captured under uniform ambient illumination by matching the observed local image statistics to the reference observations. Results demonstrate that the transfer of reflectance properties enables estimation of the dynamic surface normals and subsequent relighting. This approach overcomes limitations of previous work on material transfer and relighting of dynamic scenes which was limited to surfaces with regions of homogeneous reflectance. We evaluate for relighting 3D model sequences reconstructed from multiple view video. Comparison to previous model relighting demonstrates improved reproduction of detailed texture and shape dynamics.

Item Type: Conference or Workshop Item (Paper)
Additional Information:

Copyright 2008 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

Divisions: Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Depositing User: Symplectic Elements
Date Deposited: 03 Feb 2012 11:59
Last Modified: 23 Sep 2013 19:00
URI: http://epubs.surrey.ac.uk/id/eprint/110281

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800