基于核正则化Fisher判据的故障诊断

Fisher判据分析(FDA)是工业过程故障诊断的常用降维算法,但其无法提取数据中的非线性关系。基于核的FDA(KFDA)是对FDA的非线性推广,但在FDA和KFDA小样本情况下都会面临矩阵的病态问题,正则化技术是解决该问题的有效途径。推导一种转化为方程组求解并表示成对偶形式的核正则化FDA算法,给出其用于故障诊断的流程,并针对TE过程的故障数据进行仿真。     

基于低密度分割几何距离的半监督KFDA算法

提出了一种基于低密度分割几何距离的半监督KFDA（kernel Fisher discriminant analysis）算法（semisupervised KFDA based on low density separation geometry distance，简称SemiGKFDA）.该算法以低密度分割几何距离作为相似性度量，通过大量无标签样本，提高KFDA算法的泛化能力.首先，利用核函数将原始空间样本数据映射到高维特征空间中；然后，通过有标签样本和无标签样本构建低密度分割几何距离测度上的内蕴结构一致性假设，使其作为正则化项整合到费舍尔判别分析的目标函数中；最后，通过求解最小化目标函数获得最优投影矩阵.人工数据集和UCI数据集上的实验表明，该算法与KFDA及其改进算法相比，在分类性能上有显著提高.此外，将该算法与其他算法应用到人脸识别问题中进行对比，实验结果表明，该算法具有更高的识别精度.     

L1范数正则化SVM聚类算法

提出L1范数正则化支持向量机(SVM)聚类算法。该算法能够同时实现聚类和特征选择功能。给出L1范数正则化SVM聚类原问题和对偶问题形式,采用类似迭代坐标下降的方法求解困难的混合整数规划问题。在多组数据集上的实验结果表明,L1范数正则化SVM聚类算法聚类准确率与L2范数正则化SVM聚类算法相近,而且能够实现特征选择。     

Ll-norm Regularized SVM Clustering Algorithm

提出L1范数正则化支持向量机(SVM)聚类算法.该算法能够同时实现聚类和特征选择功能.给出LI范数正则化SVM聚类原问题和对偶问题形式,采用类似迭代坐标下降的方法求解困难的混合整数规划问题.在多组数据集上的实验结果表明,L1范数正则化SVM聚类算法聚类准确率与L2范数正则化SVM聚类算法相近,而且能够实现特征选择.     

改进的核费舍判别分析法应用于故障诊断

化工过程采样数据具有强非线性和噪声,针对化工过程状态监控的问题,提出一种改进的核费舍判别分析法（KFDA）的故障诊断算法。首先采样数据经过小波变换方法去除噪声,去除噪声后的数据进行KFDA建模,然后在建模同时采用特征向量选择（FVS）算法降低复杂性。Tennessee Eastman process实验结果表明了该算法的有效性,同时该算法加强了KFDA故障诊断的准确性,并明显地减少了存储空间和运算时间。     

基于主曲线的多输入多输出支持向量机算法

针对传统多输入多输出(MIMO)支持向量机(SVM)没有考虑多个输出端之间依赖关系的问题,提出了一种新的基于主曲线的MIMO SVM算法。该算法基于所有输出端的模型参数位于一个流形上的假设,首先在现有的多维支持向量回归机(M-SVR)的基础上,构建一个流形正则化的优化目标,其中正则项为输出端模型参数到通过所有参数集合中间的主曲线的投影距离;其次,由于该优化目标为非凸,采用交替优化的方法,交替计算模型参数和参数集合的主曲线,直至收敛。采用仿真数据和实际的载荷识别工程数据进行验证,结果表明,与M-SVR和SVM单独建模方法相比,该算法可有效提高预测精度和数值稳定性。     

灵敏度正则化极限学习机及其在数字识别中的应用

针对正则化极限学习机（RELM）中隐节点数影响分类准确性问题,提出一种灵敏度正则化极限学习机（SRELM）算法.首先根据隐含层激活函数的输出及其相对应的输出层权重系数,推导实际值与隐节点输出值残差相对于隐节点的灵敏度计算公式,然后根据不同隐节点的灵敏度进行排序,利用优化样本的分类准确率删减次要隐节点,从而有效提高SRELM的分类准确率.MNIST手写体数字库实验结果表明,相比于传统的SVM和RELM, SRELM方法的耗时与RELM相差不大,均明显低于SVM, SRELM对手写数字的识别准确率最高.     

基于稀疏表示的多正则优化图像复原

由于单正则化图像复原算法所利用的先验信息有限,影响了复原图像的质量。为克服此类算法的不足,融入更多的先验信息,改善图像复原的效果。在稀疏表示的理论框架下,提出了一种多正则优化图像复原算法。该算法将图像复原表示为含多正则项的全局优化问题,为有效处理这一复杂的图像复原问题,采用交替优化策略并借助变量分裂将其分解为若干优化子问题。其中,[uj+1]子问题可微,可直接得到其解析解。不可微的[wj+1]和[vj+1]子问题,则通过邻近映射求解。实验过程中对三种不同类型的退化图像进行了复原,所得结果验证了该算法的有效性。与FISTA（Fast Iterative Shrinkage-Thresholding Algorithm）和Split Bregman等单正则化图像复原算法相比,所提算法的复原效果和时间性能更优。     

迭代再权q范数正则化LS SVM分类算法

提出一种迭代再权q范数正则化最小二乘支持向量机(LS SVM)分类算法。该算法通过交叉校验过程选择正则化范数的阶次q (0相似文献   

图像复原的Bregman迭代双正则化方法

正则化图像复原最终会导致一个大规模优化问题,提出了一种基于Bregman迭代双正则化的图像复原方法。该方法中目标函数同时考虑总变分正则化和小波域稀疏正则化,在Bregman框架下解决图像复原问题,并且给出了用于解该问题的分裂Bregman迭代算法。该算法将复杂的优化问题转化为几十次简单的迭代加以解决,每次迭代只需几次快速傅里叶变换和收缩操作即可。实验结果表明,提出的复原算法不论从客观改善信噪比还是主观视觉,都能取得很好的效果。同时与目前的复原算法相比,该算法有更快的收敛速度。     

Fuzzy discriminant analysis with kernel methods

A novel fuzzy nonlinear classifier, called kernel fuzzy discriminant analysis (KFDA), is proposed to deal with linear non-separable problem. With kernel methods KFDA can perform efficient classification in kernel feature space. Through some nonlinear mapping the input data can be mapped implicitly into a high-dimensional kernel feature space where nonlinear pattern now appears linear. Different from fuzzy discriminant analysis (FDA) which is based on Euclidean distance, KFDA uses kernel-induced distance. Theoretical analysis and experimental results show that the proposed classifier compares favorably with FDA.     

核规则化最小体积覆盖椭球认知模型

提出了基于最小体积覆盖椭球(MVEE)的类别认知模型,提出的核规则化自适应最小体积覆盖椭球认知模型可以在机器学习、鲁棒多元统计、奇异值检测、聚类等众多领域得到应用。以奇异值检测标准数据库为例,与一类支持向量机(OCSVM)、线性规划奇异值检测算法(LPND)进行了比较,结果表明,该模型准确度总体要高于一类支持向量机和线性规划奇异值检测算法。     

Nonlinear feature extraction and classification of multivariate data in kernel feature space

Batch processes have played an essential role in the production of high value-added product of chemical, pharmaceutical, food, bio-chemical, and semi-conductor industries. For productivity and quality improvement, several multivariate statistical techniques such as principal component analysis (PCA) and Fisher discriminant analysis (FDA) have been developed to solve a fault diagnosis problem of batch processes. Fisher discriminant analysis, as a traditional statistical technique for feature extraction and classification, has been shown to be a good linear technique for fault diagnosis and outperform PCA based diagnosis methods. This paper proposes a more efficient nonlinear diagnosis method for batch processes using a kernel version of Fisher discriminant analysis (KFDA). A case study on two batch processes has been conducted. In addition, the diagnosis performance of the proposed method was compared with that of an existing diagnosis method based on linear FDA. The diagnosis results showed that the proposed KFDA based diagnosis method outperforms the linear FDA based method.     

稀疏Tikhonov正则化多分类支持向量机

Tikhonov正则化多分类支持向量机是一种将多分类问题简化为单个优化问题的新型支持向量机.由于Tikhonov正则化多分类支持向量机利用全部类别数据样本构建核函数矩阵,因此不适合大规模数据集的模式分类问题,鉴于该原因,一种稀疏Tikhonov正则化多分类支持量机被建立,其训练算法首先构建样本重要性评价标准,在标准下通过迭代学习获取约简集,最后利用约简集构建核函数矩阵并训练支持向量机.仿真实验结果表明稀疏Tikhonov正则化多分类支持向量机在训练速度和稀疏性方面具有很大的优越性.     

Ridgelet kernel regression

A ridgelet kernel regression method is presented in this paper to approximate multi-dimensional functions, especially those with certain kinds of spatial inhomogeneities. This method is based on ridgelet theory, kernel and regularization techniques from which we can deduce a regularized kernel regression form. By representing this form with quadratic programming and taking the obtained solution to define a fitness function, we use particle swarm optimization to optimize the directions of ridgelets. The properties of ridgelet can guarantee the stability of this method in approximating multi-dimensional functions, as well as its superiority for functions with linear singularities. Additionally, the regularized technique employed in this model leads to smaller generalization error. Experiments in the tasks of regression and classification show its effectiveness.     

Fault diagnosis of nonlinear and large-scale processes using novel modified kernel Fisher discriminant analysis approach

It is pretty significant for fault diagnosis timely and accurately to improve the dependability of industrial processes. In this study, fault diagnosis of nonlinear and large-scale processes by variable-weighted kernel Fisher discriminant analysis (KFDA) based on improved biogeography-based optimisation (IBBO) is proposed, referred to as IBBO-KFDA, where IBBO is used to determine the parameters of variable-weighted KFDA, and variable-weighted KFDA is used to solve the multi-classification overlapping problem. The main contributions of this work are four-fold to further improve the performance of KFDA for fault diagnosis. First, a nonlinear fault diagnosis approach with variable-weighted KFDA is developed for maximising separation between the overlapping fault samples. Second, kernel parameters and features selection of variable-weighted KFDA are simultaneously optimised using IBBO. Finally, a single fitness function that combines erroneous diagnosis rate with feature cost is created, a novel mixed kernel function is introduced to improve the classification capability in the feature space and diagnosis accuracy of the IBBO-KFDA, and serves as the target function in the optimisation problem. Moreover, an IBBO approach is developed to obtain the better quality of solution and faster convergence speed. On the one hand, the proposed IBBO-KFDA method is first used on Tennessee Eastman process benchmark data sets to validate the feasibility and efficiency. On the other hand, IBBO-KFDA is applied to diagnose faults of automation gauge control system. Simulation results demonstrate that IBBO-KFDA can obtain better kernel parameters and feature vectors with a lower computing cost, higher diagnosis accuracy and a better real-time capacity.     

基于Fisher 准则和最大熵原理的SVM核参数选择方法

针对支持向量机(SVM)核参数选择困难的问题,提出一种基于Fisher准则和最大熵原理的SVM核参数优选方法.首先,从SVM分类器原理出发,提出SVM核参数优劣的衡量标准;然后,根据此标准利用Fisher准则来优选SVM核参数,并引入最大熵原理进一步调整算法的优选性能.整个模型采用粒子群优化算法(PSO)进行参数寻优.UCI标准数据集实验表明了所提方法具有良好的参数选择效果,优选出的核参数能够使SVM具有较高的泛化性能.     

基于CPSO的混合核函数SVM参数优化及应用

支持向量机(SVM)建模的拟合精度和泛化能力取决于相关参数的选取,目前SVM中的参数的寻优一般只针对惩罚系数和核参数,而混合核函数的引入,使SVM增加了一个可调参数.针对混合核函数SVM的多参数选择问题,提出利用具有较强全局搜索能力的混沌粒子群(CPSO)优化算法对混合核函数SVM建模过程中的重要参数进行优化调整,每一...