University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Hybrid modelling of non-rigid scenes from RGBD cameras

Malleson, Charles, Guillemaut, Jean-Yves and Hilton, Adrian (2018) Hybrid modelling of non-rigid scenes from RGBD cameras IEEE Transactions on Circuits and Systems for Video Technology.

Text - Accepted version Manuscript

Download (9MB) | Preview


Recent advances in sensor technology have introduced low-cost RGB video plus depth sensors, such as the Kinect, which enable simultaneous acquisition of colour and depth images at video rates. This paper introduces a framework for representation of general dynamic scenes from video plus depth acquisition. A hybrid representation is proposed which combines the advantages of prior surfel graph surface segmentation and modelling work with the higher-resolution surface reconstruction capability of volumetric fusion techniques. The contributions are (1) extension of a prior piecewise surfel graph modelling approach for improved accuracy and completeness, (2) combination of this surfel graph modelling with TSDF surface fusion to generate dense geometry, and (3) proposal of means for validation of the reconstructed 4D scene model against the input data and efficient storage of any unmodelled regions via residual depth maps. The approach allows arbitrary dynamic scenes to be efficiently represented with temporally consistent structure and enhanced levels of detail and completeness where possible, but gracefully falls back to raw measurements where no structure can be inferred. The representation is shown to facilitate creative manipulation of real scene data which would previously require more complex capture setups or manual processing.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Date : 3 August 2018
Funders : EPSRC
DOI : 10.1109/TCSVT.2018.2863027
Copyright Disclaimer : Copyright 2018 IEEE. Personal use of this material is permitted. However, permission to use this material for any other purposes must be obtained from the IEEE by sending an email to
Uncontrolled Keywords : Dynamic scene modelling, 4D reconstruction, RGBD, video plus depth.
Depositing User : Melanie Hughes
Date Deposited : 07 Aug 2018 07:57
Last Modified : 11 Dec 2018 11:24

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800