不变矩的改进支持向量机在显微目标识别中的应用研究

为完成多个微小零件的识别,提出了一种改进的支持向量机分类算法．该算法应用基于边缘提取的不变矩获得特征属性,利用基于粗糙集的可辨识矩阵的启发式属性约简算法获得特征属性的约简,最后应用支持向量机进行目标识别分类．比较了使用支持向量机分类和使用提出的改进支持向量机分类对多个微小零件识别的效果．在显微视觉环境下的实验表明,提出的改进支持向量机分类方法能满足系统应用要求,分辨率达95%．     

增量式约简最小二乘孪生支持向量回归机

为了解决增量式最小二乘孪生支持向量回归机存在构成的核矩阵无法很好地逼近原核矩阵的问题,提出了一种增量式约简最小二乘孪生支持向量回归机(IRLSTSVR)算法.该算法首先利用约简方法,判定核矩阵列向量之间的相关性,筛选出用于构成核矩阵列向量的样本作为支持向量以降低核矩阵中列向量的相关性,使得构成的核矩阵能够更好地逼近原核...     

基于核矩阵学习的XML文档相似度量方法

XML文档作为一种新的数据形式,成为当前的研究热点.XML文档间相似度的计算是XML文档分析、管理及文本挖掘的基础.结构链接向量模型(structuredlink vector model,简称SLVM)是一种综合考虑XML文档结构信息与内容信息进行XML文档相似度量的方法.体现XML文档结构单元关系的核矩阵在结构链接向量模型中扮演着重要角色.为自动捕获XML文档结构单元关系,提出了两种核矩阵的学习算法,分别是基于支持向量机(support vector machine,简称SVM)的回归学习算法和基于矩阵迭代的学习算法.相似搜索实验对比结果表明,基于核矩阵学习方法的XML文档相似度量方法的准确性明显优于其他方法.进一步实验表明,基于矩阵迭代学习的核矩阵学习算法与基于支持向量机的回归学习算法相比,不仅具有更高的准确性,而且所需训练文档更少、计算代价更小.     

基于增量学习支持向量机的音频例子识别与检索

音频例子识别与检索的主要任务是构造一个良好的分类学习机，而在构造过程中，从含有冗余样本的训练库中选择最佳训练例子、节省学习机的训练时间是构造分类机面临的一个挑战，尤其是对含有大样本训练库音频例子的识别．由于支持向量是支持向量机中的关键例子，提出了增量学习支持向量机训练算法．在这个算法中，训练样本被分成训练子库按批次进行训练，每次训练中，只保留支持向量，去除非支持向量．与普通和减量支持向量机对比的实验表明，算法在显著减少训练时间前提下，取得了良好的识别检索正确率．     

稀疏Tikhonov正则化多分类支持向量机

Tikhonov正则化多分类支持向量机是一种将多分类问题简化为单个优化问题的新型支持向量机.由于Tikhonov正则化多分类支持向量机利用全部类别数据样本构建核函数矩阵,因此不适合大规模数据集的模式分类问题,鉴于该原因,一种稀疏Tikhonov正则化多分类支持量机被建立,其训练算法首先构建样本重要性评价标准,在标准下通过迭代学习获取约简集,最后利用约简集构建核函数矩阵并训练支持向量机.仿真实验结果表明稀疏Tikhonov正则化多分类支持向量机在训练速度和稀疏性方面具有很大的优越性.     

一种基于Cholesky分解的动态无偏LS-SVM学习算法

针对最小二乘支持向量机用于在线建模时存在的计算复杂性问题,提出一种动态无偏最小二乘支持向量回归模型.该模型通过改进标准最小二乘支持向量机结构风险的形式消除了偏置项.得到了无偏的最小二乘支持向量机,简化了回归系数的求解.根据模型动态变化过程中核函数矩阵的特点,设计了基于Cholesky分解的在线学习算法.该算法能充分利用历史训练结果,减少计算复杂性.仿真实验表明了所提出模型的有效性.     

改进的用于回归估计的支持向量机学习算法

该文对用于回归估计的标准支持向量机(SVM)加以改进,提出了一种新的用于回归估计的支持向量机学习算法。实验表明,这种新的学习算法在精度上与标准支持向量机算法完全相同,而在学习速度上明显优于标准学习算法。     

基于分层并行筛选样本的SVM增量学习算法

在增量学习过程中,随着训练集规模的增大,支持向量机的学习过程需要占用大量内存,寻优速度非常缓慢。在现有的一种支持向量机增量学习算法的基础上,结合并行学习思想,提出了一种分层并行筛选训练样本的支持向量机增量学习算法。理论分析和实验结果表明:与原有的算法相比,新算法能在保证支持向量机的分类能力的前提下显著提高训练速度。     

互补支持向量机

基于支持向量机的修正模型,得到一个互补支持向量机。利用Fischer-Burmeister互补函数,提出了一个新的下降算法。该算法不是基于支持向量机最优化问题本身,而是一个与之等价的互补问题。新算法不需要计算任何Hesse矩阵或矩阵求逆运算,实现简单,计算量小,克服了Mangasarian等人提出的LSVM算法需要求逆矩阵而造成不适合求解大规模非线性分类问题的缺陷。在不需要任何假设的情况下,证明了算法的全局收敛性。仿真实验表明算法是可行有效的。     

增量回归支持向量机改进学习算法

传统的支持向量机不具有增量学习性能,而常用的增量学习方法具有不同的优缺点,为了解决这些问题,提高支持向量机的训练速度,文章分析了支持向量机的本质特征,根据支持向量机回归仅与支持向量有关的特点,提出了一种适合于支持向量机增量学习的算法(IRSVM),提高了支持向量机的训练速度和大样本学习的能力,而支持向量机的回归能力基本不受影响,取得了较好的效果。     

USING LEAST SQUARE SVM FOR NONLINEAR SYSTEMS MODELING AND CONTROL

Support vector machine is a learning technique based on the structural risk minimization principle, and it is also a class of regression method with good generalization ability. The paper firstly introduces the mathematical model of regression least squares support vector machine (LSSVM), and designs incremental learning algorithms by the calculation formula of block matrix, then uses LSSVM to model nonlinear system, based on which to control nonlinear systems by model predictive method. Simulation experiments indicate that the proposed method provides satisfactory performance, and it achieves superior modeling performance to the conventional method based on neural networks, moreover it achieves well control performance.     

Statistical learning algorithms for identifying contrasting tillage practices with Landsat Thematic Mapper data

Tillage management practices have a direct impact on water-holding capacity, evaporation, carbon sequestration and water quality. This study examines the feasibility of two statistical learning algorithms, namely the least square support vector machine (LSSVM) and relevance vector machine (RVM), for identifying two contrasting tillage management practices using remote-sensing data. LSSVM is firmly based on statistical learning theory, whereas RVM is a probabilistic model where the training takes place in a Bayesian framework. Input to the LSSVM and RVM algorithms were reflectance values at different bandwidths and indices derived from Landsat Thematic Mapper (TM) data. Ground-truth data for this study were collected from 72 commercial production fields in two counties located in the Texas High Plains of the south-central USA. Numerous LSSVM- and RVM-based tillage models were developed and evaluated for tillage classification accuracy. The percentage correct and kappa statistic were used for the evaluation. The results showed that the best LSSVM and RVM models included the use of TM band 5 or vegetation indices that involved TM band 5, indicating sensitivity of near-infrared reflectance of crop residue cover on the surface. This is consistent with other remote-sensing models reported in the literature. Overall classification accuracies of the best LSSVM and RVM models were 87.8 and 90.2%, respectively. The corresponding kappa statistics for those models were 0.75 and 0.80, respectively. Furthermore, comparison of the best LSSVM and RVM models with the published logistic regression-based tillage models developed with the same data indicated the superiority of the RVM model over LSSVM and logistic regression models in determining contrasting tillage practices with Landsat TM data.     

一种实用的火电厂飞灰含碳量软测量建模方法

提出了同时利用自适应加权融合和最小二乘支持向量机建模的实用新方法。首先,给出了基于小波的自适应加权融合和最小二乘支持向量机算法;其次,将BP神经网络、最小二乘支持向量机和基于小波的自适应加权融合的最小二乘支持向量机算法进行建模精度比较;最后,采用真实火电厂飞灰含碳量数据进行模型验证与预测,仿真结果表明基于小波的自适应加权融合的最小二乘支持向量机算法具有较好的建模精度和实用性。     

基于信息融合的火电厂飞灰含碳量的软测量建模实验室

提出了利用信息融合与软测量技术对火电厂飞灰含碳量测量进行建模的新算法．首先给出了自适应加 权融合和最小二乘支持向量机（LSSVM）算法,其次对三个非线性测试函数分别运用BP 神经网络、LSSVM 和基于 自适应加权融合的LSSVM 算法进行建模并比较了精度,最后给出了基于自适应加权融合的LSSVM 在火电厂飞灰 含碳量建模中应用的结果．     

基于- 范数约束的LSSVR 多核学习算法

针对核函数选择对最小二乘支持向量机回归模型泛化性的影响, 提出一种新的基于????- 范数约束的最小二乘支持向量机多核学习算法. 该算法提供了两种求解方法, 均通过两重循环进行求解, 外循环用于更新核函数的权值, 内循环用于求解最小二乘支持向量机的拉格朗日乘数, 充分利用该多核学习算法, 有效提高了最小二乘支持向量机的泛化能力, 而且对惩罚参数的选择具有较强的鲁棒性. 基于单变量和多变量函数的仿真实验表明了所提出算法的有效性.

     

一种改进的SVM回归估计算法

支持向量机是一种基于结构风险最小化原理的学习技术,也是一种新的具有很好泛化性能的回归方法。目前,如何设计快速有效的回归估计算法仍然是支持向量机实际应用中的问题之一。文中对标准SVM回归估计算法加以改进,提出一种改进的SVM回归估计算法,并从学习速度和回归估计精度两个方面对提出的改进的SVM回归估计算法与标准SVM回归估计算法进行了比较。实验结果表明,在学习速度与回归估计精度之间取折衷时,文中提出的回归估计算法自由度更大。     

Least square support vector machine and multivariate adaptive regression spline for modeling lateral load capacity of piles

This article adopts least square support vector machine (LSSVM) and multivariate adaptive regression spline (MARS) for prediction of lateral load capacity (Q) of pile foundation. LSSVM is firmly based on the theory of statistical learning, uses regression technique. MARS is a nonparametric regression technique that models complex relationships. Diameter of pile (D), depth of pile embedment (L), eccentricity of load (e), and undrained shear strength of soil (S _u) have been used as input parameters of LSSVM and MARS. Equations have been presented from the developed MARS and LSSVM. This study also presents a comparative study between the developed MARS and LSSVM.     

An unbiased LSSVM model for classification and regression

Aiming at the common support vector machine’s biased disadvantage and computational complexity, an unbiased least squares support vector machine (LSSVM) model is proposed in this paper. The model eliminates the bias item of LSSVM by improving the form of structure risk, then the unbiased least squares support vector classifier and the unbiased least squares support vector regression are deduced. Based on this model, we design a new learning algorithm using Cholesky factorization according to the characteristic of kernel function matrix, in this way the calculation of Lagrangian multipliers is greatly simplified. Several experiments on diffenert datasets are carried out, including the common datasets classification, synthetic aperture radar image automatic target recognition and chaotic time series prediction. The experimental results of correct recognition rate and the fitting precision testify that the unbiased LSSVM model has good universal ability and fitting accuracy, better generalization capability and stability, and have a great improvement in learning speed.     

最小二乘支持向量机用于水量预测

针对标准支持向量机建模时间长的缺点,为了城市用水量准确预测,需建立有效的预测模型.采用的最小二乘支持向量机基于结构风险最小化,并在支持向量机的基础上,将求解二次规划问题转化线性方程组,采用径向基核函数,使最小二乘支持向量机模型的待定参数比标准支持向量机少,可大大加快建模速度,同时还采用了人工免疫系统的自适应动态克隆选择算法,在寻优过程中能够准确、快速地搜索最小二乘支持向量机的最优参数.把上述模型用于城市日用水量预测,具有学习速度快.也具有良好的非线性建模和泛化能力,而且预测精度较高.     

A Hybrid Heat Rate Forecasting Model Using Optimized LSSVM Based on Improved GSA

Heat rate value is considered as one of the most important thermal economic indicators, which determines the economic, efficient and safe operation of steam turbine unit. At the same time, an accurate heat rate forecasting is core task in the optimal operation of steam turbine unit. Recently, least squares support vector machine (LSSVM) is being proved an effective machine learning technique for solving nonlinear regression problem with a small sample set. However, it has also been proved that the prediction precision of LSSVM is highly dependent on its parameters, which are hardly choosing for the LSSVM. In the paper, an improved gravitational search algorithm (AC-GSA) is presented to further enhance optimal performance of GSA, and it is employed to serve as an approach for pre-selecting LSSVM parameters. Then, a novel soft computing method, based on LSSVM and AC-GSA, is therefore proposed to forecast heat rate of a 600 MW supercritical steam turbine unit. It combines the merits of the high accuracy of LSSVM and the fast convergence of GSA in order to build heat rate prediction model and obtain a well-generalized model. Results indicate that the developed AC-GSA–LSSVM model demonstrates better regression precision and generalization capability.