University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Dynamic scene modelling and representation from video and depth.

Malleson, Charles D. (2016) Dynamic scene modelling and representation from video and depth. Doctoral thesis, University of Surrey.

[img]
Preview
Text (Thesis)
CD_Malleson_Thesis.pdf - Version of Record
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (89MB) | Preview
[img] Video (CD Malleson PhD Thesis - Supplementary Material)
CD_Malleson_Thesis_Supplementary_Video.zip
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (768MB)
[img]
Preview
Text (Author Deposit Agreement)
Author_Deposit_Agreement.pdf
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (165kB) | Preview
[img] Video
Supplementary_Video/03_Chapter_5.mp4
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (140MB)
[img] Video
Supplementary_Video/02_Chapter_4.mp4
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (188MB)
[img] Video
Supplementary_Video/04_Chapter_6.mp4
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (274MB)
[img] Video
Supplementary_Video/00_Summary.mp4
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (60MB)
[img] Video
Supplementary_Video/01_Chapter_3.mp4
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (130MB)

Abstract

Recent advances in sensor technology have introduced low-cost video+depth sensors, such as the Microsoft Kinect, which enable simultaneous acquisition of colour and depth images at video rates. The aim of this research is to investigate representations which support integration of noisy, partial surface measurements over time to form more complete, temporally coherent models of dynamic scenes with enhanced detail and reduced noise. The initial focus of this work is on the restricted case of rigid geometry for which online GPU-accelerated volumetric fusion is implemented and tested. An alternative fusion approach based on dense surface elements (surfels) is also explored and compared to the volumetric approach. As a first step towards handling non-rigid scenes, the static volumetric approach is extended to treat articulated (semi-rigid) geometry with a focus on humans. The human body is segmented into piece-wise rigid volumetric parts and part tracking is aided by depth-based skeletal motion data. To address scenes containing more general non-rigid geometry beyond people and isolated rigid shapes, a more flexible approach is required. A piece-wise modelling approach using a sparse surfel graph and repeated alternation between part segmentation, motion and shape estimation is proposed. The method is designed to incorporate methods for noise reduction and handling of missing data. Finally, a hybrid approach is proposed which leverages the advantages of the surfel graph segmentation and coarse surface modelling with the higher-resolution surface reconstruction capability of volumetric fusion. The hybrid method is able to produce a seamless skinned mesh structure to efficiently represent a temporally consistent dynamic scene. The hybrid framework can be considered a unification of rigid and non-rigid reconstruction techniques, for which static scenes are a special case. It allows arbitrary dynamic scenes to be efficiently represented with enhanced levels of detail and completeness where possible, but gracefully falls back to raw measurements where no structure can be inferred. The representation is shown to facilitate creative manipulation of real scene data which would previously require more complex capture setups or extensive manual processing.

Item Type: Thesis (Doctoral)
Subjects : Computer Vision, Computer Graphics
Divisions : Theses
Authors :
AuthorsEmailORCID
Malleson, Charles D.cmalleson@gmail.comUNSPECIFIED
Date : 29 February 2016
Funders : EU
Grant Title : SCENE
Contributors :
ContributionNameEmailORCID
Thesis supervisorHilton, A.D.UNSPECIFIEDUNSPECIFIED
Depositing User : Charles Malleson
Date Deposited : 01 Mar 2016 10:10
Last Modified : 01 Mar 2016 10:10
URI: http://epubs.surrey.ac.uk/id/eprint/809990

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800