University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Joint Demosaicing and Chromatic Aberration Correction of Images Using Neural Networks.

Malleson, Charles and Hilton, Adrian (2019) Joint Demosaicing and Chromatic Aberration Correction of Images Using Neural Networks. In: Conference on Visual Media Production 2019, 17-18/12/2019.


Download (3MB) | Preview


Typical colour digital cameras have a single sensor with a colour filter array (CFA), each pixel capturing a single channel (red, green or blue). A full RGB colour output image is generated by demosaicing (DM), i.e. interpolating to infer the two unobserved channels for each pixel. The DM approach used can have a significant effect on the quality of the output image, particularly in the presence of common imaging artifacts such as chromatic aberration (CA). Small differences in the focal length for each channel (lateral CA) and the inability of the lens to bring all three channels simultaneously into focus (longitudinal CA) can cause objectionable colour fringing artifacts in edge regions. These artifacts can be particularly severe when using low-cost lenses. We propose to use a set of simple neural networks to learn to jointly perform DM and CA correction, producing high quality colour images subject to severe CA as well as image noise. The proposed neural network-based joint DM and CA correction produces a significant improvement in image quality metrics (PSNR and SSIM) compared the baseline edge-directed linear interpolation approach preserving image detail and reducing objectionable false colour and comb artifacts. The approach can be applied in the production of high quality images and video from machine vision cameras with low cost lenses, thus extending the viability of such hardware to visual media production.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Date : 8 November 2019
Funders : Leverhulme Trust
Grant Title : Leverhulme Trust Early Career Fellowship Scheme
Projects : Conference on Visual Media Production 2019
Depositing User : James Marshall
Date Deposited : 24 Jan 2020 10:12
Last Modified : 18 Feb 2020 10:09

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800