University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Stylized Ambient Displays of Digital Media Collections

Wang, T, Collomosse, John, Hu, R, Slatter, D, Cheatle, P and Greig, D (2011) Stylized Ambient Displays of Digital Media Collections Computers and Graphics, 35 (1). pp. 54-66.

[img]
Preview
Text
resCollomosse-CaG-2010.pdf
Available under License : See the attached licence file.

Download (901kB) | Preview
[img]
Preview
Text (licence)
SRI_deposit_agreement.pdf
Available under License : See the attached licence file.

Download (33kB) | Preview

Abstract

The falling cost of digital cameras and camcorders has encouraged the creation of massive collections of personal digital media. However, once captured, this media is infrequently accessed and often lies dormant on users' PCs. We present a system to breathe life into home digital media collections, drawing upon artistic stylization to create a “Digital Ambient Display” that automatically selects, stylizes and transitions between digital contents in a semantically meaningful sequence. We present a novel algorithm based on multi-label graph cut for segmenting video into temporally coherent region maps. These maps are used to both stylize video into cartoons and paintings, and measure visual similarity between frames for smooth sequence transitions. The system automatically structures the media collection into a hierarchical representation based on visual content and semantics. Graph optimization is applied to adaptively sequence content for display in a coarse-to-fine manner, driven by user attention level (detected in real-time by a webcam). Our system is deployed on embedded hardware in the form of a compact digital photo frame. We demonstrate coherent segmentation and stylization over a variety of home videos and photos. We evaluate our media sequencing algorithm via a small-scale user study, indicating that our adaptive display conveys a more compelling media consumption experience than simple linear “slide-shows”.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
NameEmailORCID
Wang, TUNSPECIFIEDUNSPECIFIED
Collomosse, JohnJ.Collomosse@surrey.ac.ukUNSPECIFIED
Hu, RUNSPECIFIEDUNSPECIFIED
Slatter, DUNSPECIFIEDUNSPECIFIED
Cheatle, PUNSPECIFIEDUNSPECIFIED
Greig, DUNSPECIFIEDUNSPECIFIED
Date : 1 March 2011
Funders : Hewlett Packard
Identification Number : 10.1016/j.cag.2010.11.004
Copyright Disclaimer : © 2011. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/
Projects : IRP Artistic Rendering of Consumer Media
Depositing User : Symplectic Elements
Date Deposited : 02 Jun 2014 08:56
Last Modified : 16 Aug 2017 11:05
URI: http://epubs.surrey.ac.uk/id/eprint/805254

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800