基于平滑l0范数正交子空间非负矩阵分解

为了能够提升分解矩阵的稀疏表达能力,提出了一种新的基于平滑l0范数的正交子空间非负矩阵分解方法。通过将分解矩阵的正交性及平滑l0范数约束同时引入矩阵分解的目标函数中一起进行优化,大大降低了计算复杂度,并提升了分解矩阵的稀疏表达能力。同时给出了分解矩阵的乘积更新迭代规则。通过在三个真实数据库(Iris,UCI,ORL)上的实验表明,该方法在分解所得矩阵的稀疏表示方面及将其应用于聚类问题所取得的聚类效果方面优于其他方法。     

基于投影梯度法的非负矩阵分解稀疏算法

文章提出了一种基于投影梯度法的非负矩阵分解稀疏算法,该算法通过引入基于投影梯度的迭代方法,来解决加向量1-范数约束以及加向量2-范数约束的非负矩阵分解问题,得到了局部最优解。通过实验表明该算法在分解时间以及基矩阵的稀疏度表达能力上优于NMF算法和SNMF算法。     

基于L1/2范数约束增量非负矩阵分解的SAR目标识别

增量非负矩阵分解(INMF)随目标样本增加逐渐更新分解模型,能够有效解决NMF算法的计算代价随样本增加而成倍增长的问题。然而INMF在使NMF具备增量学习能力的同时,并未考虑NMF分解矩阵的稀疏性对识别性能的提升作用。针对上述问题,提出基于L1/2范数约束的增量非负矩阵分解(L1/2-INMF)算法,并应用于SAR目标识别。L1/2-INMF采用L1/2范数实时约束增量过程中的NMF分解矩阵,能够在不增加计算复杂度的同时,提升识别性能。针对MSTAR数据集的仿真实验结果表明,提出的L1/2-INMF能够解决传统非负矩阵分解方法计算代价随样本增加而增加的问题。     

基于核技巧和超图正则的稀疏非负矩阵分解

针对传统的非负矩阵分解（NMF）应用于聚类时,没有同时考虑到鲁棒性和稀疏性,导致聚类性能较低的问题,提出了基于核技巧和超图正则的稀疏非负矩阵分解算法（KHGNMF）。首先,在继承核技巧的良好性能的基础上,用L_2,1范数改进标准非负矩阵分解中的F范数,并添加超图正则项以尽可能多地保留原始数据间的内在几何结构信息;其次,引入L_2,1/2伪范数和L_1/2正则项作为稀疏约束合并到NMF模型中;最后,提出新算法并将新算法应用于图像聚类。在6个标准的数据集上进行验证,实验结果表明,相对于非线性正交图正则非负矩阵分解方法,KHGNMF使聚类性能（精度和归一化互信息）成功地提升了39%~54%,有效地改善和提高了算法的稀疏性和鲁棒性,聚类效果更好。     

稀疏约束下非负矩阵分解的增量学习算法

非负矩阵分解(NMF)是一种有效的子空间降维方法。为了改善非负矩阵分解运算规模随训练样本增多而不断增大的现象,同时提高分解后数据的稀疏性,提出了一种稀疏约束下非负矩阵分解的增量学习算法,该算法在稀疏约束的条件下利用前一次分解的结果参与迭代运算,在节省大量运算时间的同时提高了分解后数据的稀疏性。在ORL和CBCL人脸数据库上的实验表明了该算法降维的有效性。     

双层非负矩阵分解的分形图像压缩算法

分形图像压缩作为一种基于结构的图像压缩技术,在许多图像处理中得到了应用。但是分形图像压缩的编码阶段非常耗时,且重建图像的质量效果不佳。针对这些问题,提出了一种基于双层非负矩阵分解的分形图像压缩编码算法。在传统的非负矩阵分解理论上,将投影非负矩阵分解与[L3/2]范数约束相结合,可以在较短的时间内提取具有代表性的图像特征。算法采用双层非负矩阵分解提取原始图像的特征,对图像的特征进行[K]均值聚类,根据对应索引得到分类的图像块,在相应类别块里进行正交稀疏分解得到分形码,最后重建图像。实验结果表明,与快速稀疏分形图像压缩理论重建的图像相比,双层非负矩阵分解的分形压缩算法提高了重建图像的质量,同时缩短了编码时间。     

基于邻近交替线性化的稀疏非负矩阵分解算法

结合稀疏约束与邻近交替线性化(PALM),提出稀疏非负矩阵分解算法(SNMF_PALM)。将非凸的平滑剪切绝对偏差函数作为稀疏正则项,获得逼近L0范数的最佳凸松弛,并利用PALM算法对非凸问题进行求解,得到SNMF_PALM算法的局部稳定最优解。在人脸数据库上将SNMF_PALM算法与SNMF、NMF算法进行实验对比,结果表明SNMF_PALM算法具有更好的聚类性能。     

基于稀疏约束非负矩阵分解的K-Ｍeans聚类算法

为了提高Ｋ-Ｍeans聚类算法在高维数据下的聚类效果,提出一种基于稀疏约束非负矩阵分解的Ｋ-Ｍeans聚类算法。该算法在最优保持原始数据本质的前提下,通过在非负矩阵分解过程中对基矩阵列向量施加l1与l2范数稀疏约束,首先挖掘嵌入在高维数据中的低维数据结构,实现高维数据的低维表示,然后利用在低维数据聚类中性能良好的Ｋ-Ｍeans算法对稀疏降维后的数据进行聚类。实验结果表明提出的算法可行,并且在处理高维数据上有效。     

基于约束NMF的欠定盲信号分离算法*

提出一种约束非负矩阵分解方法用于解决欠定盲信号分离问题。非负矩阵分解直接用于求解欠定盲信号分离时,分解结果不唯一,无法正确分离源信号。本文在基本非负矩阵分解算法基础上,对分解得到的混合矩阵施加行列式约束,保证分解结果的唯一性;对分解得到的源信号同时施加稀疏性约束和最小相关约束,实现混合信号的唯一分解,提高源信号分离性能。仿真实验证明了本文算法的有效性。     

线性投影非负矩阵分解方法及应用

针对线性投影结构非负矩阵分解迭代方法比较复杂的问题,提出了一种线性投影非负矩阵分解方法.从投影和线性变换角度出发,将Frobenius范数作为目标函数,利用泰勒展开式,严格导出基矩阵和线性变换矩阵的迭代算法,并证明了算法的收敛性.实验结果表明:该算法是收敛的;相对于非负矩阵分解等方法,该方法的基矩阵具有更好的正交性和稀疏性;人脸识别结果说明该方法具有较高的识别率.线性投影非负矩阵分解方法是有效的.     

基于L21范数的非负低秩图嵌入算法

现有的非负矩阵分解方法直接在原始高维图像数据集上计算低维表示,同时存在对噪声数据、噪声标签、不可靠图敏感及鲁棒性较差的缺点.为了解决上述问题,文中提出基于L21范数的非负低秩图嵌入算法(NLGEL21),同时考虑原始数据集的有效低秩结构和几何信息.在图嵌入和数据重构函数中引入L21范数,进一步提高鲁棒性,并给出求解NLGEL21的乘性迭代公式和收敛性证明.在ORL、CMU PIE、YaleB人脸数据库上的实验验证NLGEL21的优越性.     

利用正则化矩阵分解技术的多视图聚类方法

为了解决具有多种特征属性的多媒体数据（多视图数据）挖掘问题,在非负矩阵分解（NMF）算法的基础上,提出了一种多视图正则化矩阵分解算法（MRMF）,该算法使用了多元非负矩阵分解技术,同时使用[L2,1]范数描述矩阵分解的损失函数,并采用多视图流形正则化对矩阵分解进行正则化约束。与现有的一些数据聚类或多视图聚类算法相比,提出的MRMF算法不易受到原始数据中噪声的影响,而且能够充分考虑到不同视图在聚类中所具有不同权重的问题,能够对多视图数据进行较为准确的聚类。MRMF算法的有效性在一些经典的公开数据集上进行了验证,并取得了较好的聚类精度。     

基于超像素的流形正则化稀疏约束NMF混合像元分解算法

针对传统非负矩阵分解（NMF）法用于高光谱图像混合像元分解时产生的分解结果精度不高、对噪声敏感等问题，提出一种基于超像素的流形正则化稀疏约束NMF混合像元分解算法——MRS-NMF。首先，通过基于熵率的超像素分割来构造高光谱图像的流形结构，把原图像分割为k个超像素块并把每个超像素块中具有相似性质的数据点标上相同的标签，定义像素块内有相同标签的任意两个数据点之间的权重矩阵，然后将权重矩阵应用于NMF的目标函数中以构造出流形正则化约束项；第二，在目标函数中添加二次抛物线函数以完成稀疏约束；最后，采用乘法迭代更新法则求解目标函数以得到端元矩阵和丰度矩阵的求解公式，同时设置最大迭代次数和容忍误差阈值，迭代运算得到最终结果。该方法有效利用了高光谱图像的光谱和空间信息。实验结果表明，在模拟的高光谱数据中，与传统的流形稀疏约束的非负矩阵分解（GLNMF）、L1/2-NMF和顶点成分分析-全约束最小二乘法（VCA-FCLS）等方法相比，MRS-NMF可以提高0.016~0.063的端元分解精度和0.01~0.05的丰度分解精度；而在真实的高光谱图像中，MRS-NMF较传统的GLNMF、顶点成分分析法（VCA）、最小体积约束的非负矩阵分解（MVCNMF）等方法可以平均提高0.001~0.0437的端元分解精度。所提MRS-NMF算法有效地提高了混合像元分解的精度，同时具有较好的抗噪性能。     

基于Hessian图正则稀疏NMF的高光谱解混

基于非负矩阵分解(Nonnegative Matrix Factorization, NMF)的高光谱解混(Hyperspectral Unmixing,HU)方法引起了大家的关注,因为可以将一个非负高光谱图像(Hyperspectral Imagery, HSI)数据矩阵分解为两个非负矩阵的乘积,分别对应于端元矩阵和丰度系数矩阵。目前,图约束的NMF算法已经被证明对高光谱解混是有效的,因为它们可以捕获HSI的几何特性。为了挖掘数据在混合过程中的几何结构和稀疏性,提出了一种稀疏的Hessian图正则化NMF(SHGNMF)算法。SHGNMF算法是将丰度矩阵的L1/2正则化器和Hessian图正则化项都添加到每个NMF模型中,同时采用乘法更新规则。最后用模拟数据和真实数据进行实验,验证了所提出的SHGNMF算法相对于其他NMF算法的优越性。     

Robust embedded projective nonnegative matrix factorization for image analysis and feature extraction

Nonnegative matrix factorization (NMF) is an unsupervised learning method for decomposing high-dimensional nonnegative data matrices and extracting basic and intrinsic features. Since image data are described and stored as nonnegative matrices, the mining and analysis process usually involves the use of various NMF strategies. NMF methods have well-known applications in face recognition, image reconstruction, handwritten digit recognition, image denoising and feature extraction. Recently, several projective NMF (P-NMF) methods based on positively constrained projections have been proposed and were found to perform better than the standard NMF approach in some aspects. However, some drawbacks still affect the existing NMF and P-NMF algorithms; these include dense factors, slow convergence, learning poor local features, and low reconstruction accuracy. The aim of this paper is to design algorithms that address the aforementioned issues. In particular, we propose two embedded P-NMF algorithms: the first method combines the alternating least squares (ALS) algorithm with the P-NMF update rules of the Frobenius norm and the second one embeds ALS with the P-NMF update rule of the Kullback–Leibler divergence. To assess the performances of the proposed methods, we conducted various experiments on four well-known data sets of faces. The experimental results reveal that the proposed algorithms outperform other related methods by providing very sparse factors and extracting better localized features. In addition, the empirical studies show that the new methods provide highly orthogonal factors that possess small entropy values.     

Non-negative matrix factorization based unmixing for principal component transformed hyperspectral data

Non-negative matrix factorization (NMF) has been widely used in mixture analysis for hyperspectral remote sensing. When used for spectral unmixing analysis, however, it has two main shortcomings: (1) since the dimensionality of hyperspectral data is usually very large, NMF tends to suffer from large computational complexity for the popular multiplicative iteration rule; (2) NMF is sensitive to noise (outliers), and thus the corrupted data will make the results of NMF meaningless. Although principal component analysis (PCA) can be used to mitigate these two problems, the transformed data will contain negative numbers, hindering the direct use of the multiplicative iteration rule of NMF. In this paper, we analyze the impact of PCA on NMF, and find that multiplicative NMF can also be applicable to data after principal component transformation. Based on this conclusion, we present a method to perform NMF in the principal component space, named ‘principal component NMF’ (PCNMF). Experimental results show that PCNMF is both accurate and time-saving.     

Nonnegative matrix factorization in polynomial feature space

Plenty of methods have been proposed in order to discover latent variables (features) in data sets. Such approaches include the principal component analysis (PCA), independent component analysis (ICA), factor analysis (FA), etc., to mention only a few. A recently investigated approach to decompose a data set with a given dimensionality into a lower dimensional space is the so-called nonnegative matrix factorization (NMF). Its only requirement is that both decomposition factors are nonnegative. To approximate the original data, the minimization of the NMF objective function is performed in the Euclidean space, where the difference between the original data and the factors can be minimized by employing L(2)-norm. In this paper, we propose a generalization of the NMF algorithm by translating the objective function into a Hilbert space (also called feature space) under nonnegativity constraints. With the help of kernel functions, we developed an approach that allows high-order dependencies between the basis images while keeping the nonnegativity constraints on both basis images and coefficients. Two practical applications, namely, facial expression and face recognition, show the potential of the proposed approach.     

Combined new nonnegative matrix factorization algorithms with two-dimensional nonnegative matrix factorization for image processing

In recent years, nonnegative matrix factorization (NMF) has attracted significant amount of attentions in image processing, text mining, speech processing and related fields. Although NMF has been applied in several application successfully, its simple application on image processing has a few caveats. For example, NMF costs considerable computational resources when performing on large databases. In this paper, we propose two enhanced NMF algorithms for image processing to save the computational costs. One is modified rank-one residue iteration (MRRI) algorithm , the other is element-wisely residue iteration (ERI) algorithm. Here we combine CAPG (a NMF algorithm proposed by Lin), MRRI and ERI with two-dimensional nonnegative matrix factorization (2DNMF) for image processing. The main difference between NMF and 2DNMF is that the former first aligns images into one-dimensional (1D) vectors and then represents them with a set of 1D bases, while the latter regards images as 2D matrices and represents them with a set of 2D bases. The three combined algorithms are named CAPG-2DNMF, MRRI-2DNMF and ERI-2DNMF. The computational complexity and convergence analyses of proposed algorithms are also presented in this paper. Three public databases are used to test the three NMF algorithms and the three combinations, the results of which show the enhancement performance of our proposed algorithms (MRRI and ERI algorithms) over the CAPG algorithm. MRRI and ERI have similar performance. The three combined algorithms have better image reconstruction quality and less running time than their corresponding 1DNMF algorithms under the same compression ratio. We also do some experiments on a real-captured image database and get similar conclusions.