University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Hybrid Skeleton Driven Surface Registration for Temporally Consistent Volumetric Video

Regateiro, Joao, Volino, Marco and Hilton, Adrian (2018) Hybrid Skeleton Driven Surface Registration for Temporally Consistent Volumetric Video In: 3DV 2018: 6th international conference on 3D Vision, 05-08 Sep 2018, Verona, Italy.

Hybrid Skeleton Driven Surface Registration for Temporally Consistent Volumetric Video.pdf - Accepted version Manuscript

Download (4MB) | Preview


This paper presents a hybrid skeleton-driven surface registration (HSDSR) approach to generate temporally consistent meshes from multiple view video of human subjects. 2D pose detections from multiple view video are used to estimate 3D skeletal pose on a per-frame basis. The 3D pose is embedded into a 3D surface reconstruction allowing any frame to be reposed into the shape from any other frame in the captured sequence. Skeletal motion transfer is performed by selecting a reference frame from the surface reconstruction data and reposing it to match the pose estimation of other frames in a sequence. This allows an initial coarse alignment to be performed prior to refinement by a patch-based non-rigid mesh deformation. The proposed approach overcomes limitations of previous work by reposing a reference mesh to match the pose of a target mesh reconstruction, providing a closer starting point for further non-rigid mesh deformation. It is shown that the proposed approach is able to achieve comparable results to existing model-based and model-free approaches. Finally, it is demonstrated that this framework provides an intuitive way for artists and animators to edit volumetric video.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Date : 15 October 2018
Funders : Engineering and Physical Sciences Research Council (EPSRC)
DOI : 10.1109/3DV.2018.00065
Copyright Disclaimer : © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Related URLs :
Depositing User : Clive Harris
Date Deposited : 23 Oct 2018 13:54
Last Modified : 18 Dec 2018 13:34

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800