Simultaneous codeword optimization (SimCO) for dictionary update and learning
Dai, W, Xu, T and Wang, W (2012) Simultaneous codeword optimization (SimCO) for dictionary update and learning IEEE Transactions on Signal Processing, 60 (12). pp. 6340-6353.
DaiXW_TSP_2012_preprint.pdf - ["content_typename_UNSPECIFIED" not defined]
Download (1MB) | Preview
We consider the data-driven dictionary learning problem. The goal is to seek an over-complete dictionary from which every training signal can be best approximated by a linear combination of only a few codewords. This task is often achieved by iteratively executing two operations: sparse coding and dictionary update. The focus of this paper is on the dictionary update step, where the dictionary is optimized with a given sparsity pattern. We propose a novel framework where an arbitrary set of codewords and the corresponding sparse coefficients are simultaneously updated, hence the term simultaneous codeword optimization (SimCO). The SimCO formulation not only generalizes benchmark mechanisms MOD and K-SVD, but also allows the discovery that singular points, rather than local minima, are the major bottleneck of dictionary update. To mitigate the problem caused by the singular points, regularized SimCO is proposed. First and second order optimization procedures are designed to solve regularized SimCO. Simulations show that regularization substantially improves the performance of dictionary learning. © 1991-2012 IEEE.
|Divisions :||Faculty of Engineering and Physical Sciences > Electronic Engineering > Centre for Vision Speech and Signal Processing|
|Identification Number :||https://doi.org/10.1109/TSP.2012.2215026|
|Additional Information :||© 2012 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.|
|Depositing User :||Symplectic Elements|
|Date Deposited :||17 Dec 2013 15:28|
|Last Modified :||09 Jun 2014 13:46|
Actions (login required)
Downloads per month over past year