University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Rethinking Pose in 3D: Multi-stage Refinement and Recovery for Markerless Motion Capture

Tome, Denis, Toso, Matteo, Agapito, Lourdes and Russell, Christopher (2018) Rethinking Pose in 3D: Multi-stage Refinement and Recovery for Markerless Motion Capture In: 2018 International Conference on 3D Vision (3DV), 05-08 Sep 2018, Verona, Italy.

Rethinking Pose in 3D Multistage Refinement and Recovery for Markerless.pdf - Accepted version Manuscript
Available under License Creative Commons Attribution No Derivatives.

Download (712kB) | Preview


We propose a CNN-based approach for multi-camera markerless motion capture of the human body. Unlike existing methods that first perform pose estimation on individual cameras and generate 3D models as post-processing, our approach makes use of 3D reasoning throughout a multi-stage approach. This novelty allows us to use provisional 3D models of human pose to rethink where the joints should be located in the image and to recover from past mistakes. Our principled refinement of 3D human poses lets us make use of image cues, even from images where we previously misdetected joints, to refine our estimates as part of an end-to-end approach. Finally, we demonstrate how the high-quality output of our multi-camera setup can be used as an additional training source to improve the accuracy of existing single camera models.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Tome, Denis
Agapito, Lourdes
Date : 5 September 2018
DOI : 10.1109/3DV.2018.00061
Depositing User : Rebecca Cooper
Date Deposited : 15 Mar 2019 11:40
Last Modified : 15 Mar 2019 11:40

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800