Hierarchical sparse coding from a Bayesian perspective

Yupei Zhang, Ming Xiang, Bo Yang

科研成果: 期刊稿件文章同行评审

10 引用 (Scopus)

摘要

We consider the problem of hierarchical sparse coding, where not only a few groups of atoms are active at a time but also each group enjoys internal sparsity. The current approaches are usually to achieve between-group sparsity using the ℓ1 penalty, such that many groups have small coefficients rather than being accurately zeroed out. The trivial groups may incur the proneness to overfitting of noise and are thereby harmful to interpretability of sparse representation. To this end, we in this paper reformulate the hierarchical sparse model from a Bayesian perspective employing twofold priors: the spike-and-slab prior and the Laplacian prior. The former is utilized to explicitly induce between-group sparsity, while the latter is adopted for both inducing within-group sparsity and obtaining a small reconstruction error. We propose a nest prior by integrating the both priors to result in hierarchical sparsity. The resultant optimization problem can be delivered a convergence solution in a few iterations via the proposed nested algorithm, corresponding to the nested prior. In experiments, we evaluate the performance of our method on signal recovery, image inpainting and sparse representation based classification, with simulated signals and two publicly available image databases. The results manifest that the proposed method, compared with the popular methods for sparse coding, can yield more concise representation and more reliable interpretation of data.

源语言英语
页(从-至)279-293
页数15
期刊Neurocomputing
272
DOI
出版状态已出版 - 10 1月 2018
已对外发布

指纹

探究 'Hierarchical sparse coding from a Bayesian perspective' 的科研主题。它们共同构成独一无二的指纹。

引用此