University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Wide-Baseline Multi-View Video Segmentation For 3D Reconstruction

Sarim, M, Hilton, A, Guillemaut, J-Y, Kim, H and Takai, T (2010) Wide-Baseline Multi-View Video Segmentation For 3D Reconstruction In: 3DVP 2010 Workshop: MM '10 ACM Multimedia Conference, 2010-10-25 - 2010-10-29, Firenze, Italy.

[img]
Preview
PDF
sarim103dvp_sub.pdf
Available under License : See the attached licence file.

Download (4MB)
[img]
Preview
PDF (licence)
SRI_deposit_agreement.pdf

Download (33kB)

Abstract

Obtaining a foreground silhouette across multiple views is one of the fundamental steps in 3D reconstruction. In this paper we present a novel video segmentation approach, to obtain a foreground silhouette, for scenes captured by a wide-baseline camera rig given a sparse manual interaction in a single view. The algorithm is based on trimap propagation, a framework used in video matting. Bayesian inference coupled with camera calibration information are used to spatio-temporally propagate high confidence trimap labels across the multi-view video to obtain coarse silhouettes which are later refined using a matting algorithm. Recent techniques have been developed for foreground segmentation, based on image matting, in multiple views but they are limited to narrow baseline with low foreground variation. The proposed wide-baseline silhouette propagation is robust to inter-view foreground appearance changes, shadows and similarity in foreground/background appearance. The approach has demonstrated good performance in silhouette estimation for views up to 180 degree baseline (opposing views). The segmentation technique has been fully integrated in a multi-view reconstruction pipeline. The results obtained demonstrate the suitability of the technique for multi-view reconstruction with wide-baseline camera set-ups and natural background.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing
Authors :
AuthorsEmailORCID
Sarim, MUNSPECIFIEDUNSPECIFIED
Hilton, AUNSPECIFIEDUNSPECIFIED
Guillemaut, J-YUNSPECIFIEDUNSPECIFIED
Kim, HUNSPECIFIEDUNSPECIFIED
Takai, TUNSPECIFIEDUNSPECIFIED
Date : 25 October 2010
Identification Number : 10.1145/1877791.1877795
Contributors :
ContributionNameEmailORCID
PublisherACM, UNSPECIFIEDUNSPECIFIED
Additional Information : Copyright 2010 Association for Computing Machinery
Depositing User : Symplectic Elements
Date Deposited : 22 Dec 2015 11:52
Last Modified : 22 Dec 2015 11:52
URI: http://epubs.surrey.ac.uk/id/eprint/111072

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800