Hybrid Skeleton Driven Surface Registration for Temporally Consistent Volumetric Video

Regateiro, Joao, Volino, Marco and Hilton, Adrian (2018) Hybrid Skeleton Driven Surface Registration for Temporally Consistent Volumetric Video In: 3DV 2018: 6th international conference on 3D Vision, 05-08 Sep 2018, Verona, Italy.

Preview

Text Hybrid Skeleton Driven Surface Registration for Temporally Consistent Volumetric Video.pdf - Accepted version Manuscript Download (4MB) | Preview

Abstract

This paper presents a hybrid skeleton-driven surface registration (HSDSR) approach to generate temporally consistent meshes from multiple view video of human subjects. 2D pose detections from multiple view video are used to estimate 3D skeletal pose on a per-frame basis. The 3D pose is embedded into a 3D surface reconstruction allowing any frame to be reposed into the shape from any other frame in the captured sequence. Skeletal motion transfer is performed by selecting a reference frame from the surface reconstruction data and reposing it to match the pose estimation of other frames in a sequence. This allows an initial coarse alignment to be performed prior to refinement by a patch-based non-rigid mesh deformation. The proposed approach overcomes limitations of previous work by reposing a reference mesh to match the pose of a target mesh reconstruction, providing a closer starting point for further non-rigid mesh deformation. It is shown that the proposed approach is able to achieve comparable results to existing model-based and model-free approaches. Finally, it is demonstrated that this framework provides an intuitive way for artists and animators to edit volumetric video.

Item Type:	Conference or Workshop Item (Conference Paper)
Divisions :	Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :	Name Email ORCID Regateiro, Joao j.regateiro@surrey.ac.uk Volino, Marco marco.volino@surrey.ac.uk Hilton, Adrian A.Hilton@surrey.ac.uk
Date :	15 October 2018
Funders :	Engineering and Physical Sciences Research Council (EPSRC)
DOI :	10.1109/3DV.2018.00065
Copyright Disclaimer :	© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Related URLs :	Organisation Publisher
Depositing User :	Clive Harris
Date Deposited :	23 Oct 2018 13:54
Last Modified :	18 Dec 2018 13:34
URI:	http://epubs.surrey.ac.uk/id/eprint/849761

Actions (login required)

View Item

Downloads