论文标题

阳性半芬矿基质分解:与相位检索和仿射等级最小化的联系

Positive Semidefinite Matrix Factorization: A Connection with Phase Retrieval and Affine Rank Minimization

论文作者

Lahat, Dana, Lang, Yanbin, Tan, Vincent Y. F., Févotte, Cédric

论文摘要

阳性半金属基质分解(PSDMF)表示非负基质作为两个阳性半限定(PSD)矩阵的内部产物。当所有这些PSD矩阵被限制为对角线时,该模型等同于非负矩阵分解。应用程序包括组合优化,基于量子的统计模型和推荐系统等。但是,尽管对PSDMF的兴趣越来越高,但文献中仅提出了一些PSDMF算法。在这项工作中,我们通过证明可以基于相位检索(PR)和仿射等级最小化(ARM)算法设计PSDMF算法来为PSDMF提供一系列工具。此过程允许设计新的PSDMF算法的快捷方式,因为它允许利用现有PR和ARM方法的某些有用的数值属性到PSDMF框架。在这个想法的激励下,我们基于迭代硬阈值(IHT)引入了一个新的PSDMF算法系列。该家族属于先前提供的预测梯度PSDMF方法。我们表明,PSDMF优化问题之间存在很高的可变性,这使得尝试基于不同原理的多种方法来解决困难问题是有益的。在某些情况下,我们提出的方法是唯一能够找到解决方案的算法。在某些其他情况下,它们会收敛得更快。我们的结果支持我们的主张,即PSDMF框架可以从PR和ARM算法中继承所需的数值属性,从而导致更有效的PSDMF算法,并激励对这些模型之间的联系进一步研究。

Positive semidefinite matrix factorization (PSDMF) expresses each entry of a nonnegative matrix as the inner product of two positive semidefinite (psd) matrices. When all these psd matrices are constrained to be diagonal, this model is equivalent to nonnegative matrix factorization. Applications include combinatorial optimization, quantum-based statistical models, and recommender systems, among others. However, despite the increasing interest in PSDMF, only a few PSDMF algorithms were proposed in the literature. In this work, we provide a collection of tools for PSDMF, by showing that PSDMF algorithms can be designed based on phase retrieval (PR) and affine rank minimization (ARM) algorithms. This procedure allows a shortcut in designing new PSDMF algorithms, as it allows to leverage some of the useful numerical properties of existing PR and ARM methods to the PSDMF framework. Motivated by this idea, we introduce a new family of PSDMF algorithms based on iterative hard thresholding (IHT). This family subsumes previously-proposed projected gradient PSDMF methods. We show that there is high variability among PSDMF optimization problems that makes it beneficial to try a number of methods based on different principles to tackle difficult problems. In certain cases, our proposed methods are the only algorithms able to find a solution. In certain other cases, they converge faster. Our results support our claim that the PSDMF framework can inherit desired numerical properties from PR and ARM algorithms, leading to more efficient PSDMF algorithms, and motivate further study of the links between these models.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源