Algorithms for Nonnegative Matrix Factorization with the β-Divergence
Télécom Paris · Centre National de la Recherche Scientifique · +3 more institutions
Abstract
This letter describes algorithms for nonnegative matrix factorization (NMF) with the β-divergence (β-NMF). The β-divergence is a family of cost functions parameterized by a single shape parameter β that takes the Euclidean distance, the Kullback-Leibler divergence, and the Itakura-Saito divergence as special cases (β = 2, 1, 0 respectively). The proposed algorithms are based on a surrogate auxiliary function (a local majorization of the criterion function). We first describe a majorization-minimization algorithm that leads to multiplicative updates, which differ from standard heuristic multiplicative updates by a β-dependent power exponent. The monotonicity of the heuristic algorithm can, however, be proven…
Citation impact
- FWCI
- 23.39
- Percentile
- 100%
- References
- 58
Authors
2Topics & keywords
- Non-negative matrix factorization
- Divergence (linguistics)
- Mathematics
- Majorization
- Algorithm
- Multiplicative function
- Function (biology)
- Bregman divergence