基于支持向量回归的光谱反射率重建方法

提出了一种基于支持向量回归和小框架核的光谱反射率重建方法。光谱反射率重建是光学研究的一个重要问题,其目的是通过各种成像设备所获取的与设备相关的RGB三色值重建出物体本身固有的与设备和光照都无关的光谱反射率。回归方法已经在这一领域取得了广泛应用,如基于多项式模型的正则化最小二乘方法、基于核的正则化最小二乘方法等。提出了一种新的光谱反射率重建方法,这种方法采用了一种可以减弱样本不规则噪音影响的小框架核函数,并将其用于支持向量回归来重建光谱反射率函数。实验表明,新方法可以提高光谱反射率重建的精度和稳定性。     

Fuzzy rule-based support vector regression system

In this paper,we design a fuzzy rule-based support vector regression system.The proposed system utilizes the advantages of fuzzy model and support vector regression to extract support vectors to generate fuzzy if-then rules from the training data set.Based on the first-order linear Tagaki-Sugeno (TS) model,the structure of rules is identified by the support vector regression and then the consequent parameters of rules are tuned by the global least squares method.Our model is applied to the real world regression task.The simulation results gives promising performances in terms of a set of fuzzy rules,which can be easily interpreted by humans.     

Fuzzy nile-based support vector regression system

In this paper, we design a fuzzy rule-based support vector regression system. The proposed system utilizes the advantages of fuzzy model and support vector regression to extract support vectors to generate fuzzy if-then rules from the training data set. Based on the first-order hnear Tagaki-Sugeno （TS） model, the structure of rules is identified by the support vector regression and then the consequent parameters of rules are tuned by the global least squares method. Our model is applied to the real world regression task. The simulation results gives promising performances in terms of a set of fuzzy hales, which can be easily interpreted by humans.     

非线性动态系统中迭代的同步数据协调与显著误差检测的支持向量回归方法

化工厂中过程数据的质量严重影响到来自例如性能监控, 在线优化和控制等活动所获得的效益和性能. 由于许多化工过程通常表现为非线性动态特性, 例如扩展卡尔曼滤波(EKF)和非线性动态数据协调(NDDR)等技术已经被发展出来改进数据的质量. 近期, 迭代非线性动态数据协调(RNDDR)技术已被提出, 该技术结合了EKF和NDDR技术的优点. 但是, RNDDR技术不能够处理具有显著误差的测量值. 本文中, 一种非线性动态系统中迭代的同步数据协调与显著误差检测的支持向量(SV)回归方法被提出. SV回归是一种经验风险和结构风险间的妥协, 并且对于数据协调来说, 其对随机误差和显著误差是鲁棒的．通过将结构风险取代RNDDR中的极大似然估计并使其最小化, 我们的方法不仅可以实现迭代非线性动态数据协调, 还可以同时实现显著误差检测. 本文中的非线性动态系统仿真结果显示出, 所提出的方法在迭代实时估计框架下, 对于非线性动态系统的同步数据协调和显著误差检测是鲁棒、稳定并且精确的. 该方法也可以提供更好的控制性能.     

Exploiting multi-scale support vector regression for image compression

Unlike traditional neural networks that require predefined topology of the network, support vector regression (SVR) approach can model the data within the given level of accuracy with only a small subset of the training data, which are called support vectors (SVs). This property of sparsity has been exploited as the basis for image compression. In this paper, for still image compression, we propose a multi-scale support vector regression (MS-SVR) approach, which can model the images with steep variations and smooth variations very well resulting in good performance. We test our proposed MS-SVR based algorithm on some standard images. The experimental results verify that the proposed MS-SVR achieves better performance than standard SVR. And in a wide range of compression ratio, MS-SVR is very close to JPEG in terms of peak signal-to-noise ratio (PSNR) but exhibits better subjective quality. Furthermore, MS-SVR even outperforms JPEG on both PSNR and subjective quality when the compression ratio is higher enough, for example 25:1 for Lena image. Even when compared with JPEG-2000, the results show greatly similar trend as those in JPEG experiments, except that the compression ratio is a bit higher where our proposed MS-SVR will outperform JPEG-2000.     

High-dimensional pseudo-logistic regression and classification with applications to gene expression data

High dimension low sample size data, like the microarray gene expression levels, pose numerous challenges to conventional statistical methods. In the particular case of binary classification, some classification methods, such as the support vector machine (SVM), can efficiently deal with high-dimensional predictors, but lacks the accuracy in estimating the probability of membership of a class. In contrast, the traditional logistic regression (TLR) effectively estimates the probability of class membership for data with low-dimensional inputs, but does not handle high-dimensional cases. The study bridges the gap between SVM and TLR by their loss functions. Based on the proposed new loss function, a pseudo-logistic regression and classification approach which simultaneously combines the strengths of both SVM and TLR is also proposed. Simulation evaluations and real data applications demonstrate that for low-dimensional data, the proposed method produces regression estimates comparable to those of TLR and penalized logistic regression, and that for high-dimensional data, the new method possesses higher classification accuracy than SVM and, in the meanwhile, enjoys enhanced computational convergence and stability.     

最小方差支撑向量回归

基于支撑向量回归(SVR)可以通过构建支撑向量机分类问题实现的基本思想,推广最小类方差支撑向量机(MCVSVMs)于回归估计,提出了最小方差支撑向量回归(MVSVR)算法.该方法继承了MCVSVMs鲁棒性和泛化能力强的优点,分析了MVSVR和标准SVR之间的关系,讨论了在散度矩阵奇异情况下该方法的求解问题,同时也讨论了MVSVR的非线性情况.实验表明,该方法是可行的,且表现出了更强的泛化能力.     

模糊最小二乘支持向量机回归研究及应用

针对传统支持向量机对训练样本内的噪声和孤立点比较敏感,导致建模精度不高的问题,将模糊集理论引入到最小二乘支持向量机回归中,建立一种基于数据域描述的模糊最小二乘支持向量机回归的数学模型,该方法将样本映射到高维空间,在高维空间中寻找最小包含超球,然后根据样本到超球心的距离确定模糊隶属度的大小,通过仿真实验验证,该算法提高了支持向量机回归的训练精度,将此模型应用于谷氨酸发酵过程菌体浓度预测,结果表明此方法的有效性。     

支持向量回归的一种网络优化策略

提出一种用于支持向量回归的网络优化策略．学习策略分为两个阶段：首先训练支持向量机,得到支持向量回归的初始结构和参数,构造一个无阈值的支持向量回归网络;然后通过带有遗忘因子的递归最小二乘算法,优化计算支持向量回归网络的权值,以达到更好的函数拟合精度．与支持向量回归相比,这种策略可以得到最优的权值和阈值．仿真结果表明,该网络性能优良,具有在线应用的潜力．     

一种数据域描述的加权支持向量回归算法

针对支持向量回归中由于噪声和孤立点带来的过拟合问题,提出了一种基于支持向量数据域描述的加权系数函数模型,根据样本到特征空间最小包含超球球心的距离来确定其加权系数。将提出的加权系数模型用于加权支持向量回归中,一维数据集仿真表明,提出的模型可以有效减小回归误差,提高支持向量回归算法的抗噪声能力。     

基于记忆模式的NO_x支持向量回归预测研究

低NO_x排放是电站锅炉燃烧优化的主要目标之一,影响燃煤锅炉NO_x排放因素众多且复杂,对锅炉燃烧过程NO_x浓度进行准确预测是低NO_x燃烧优化的基础。机组全工况运行时表现出强时变性,静态预测模型难以保证预测精度,考虑到观测样本的时效性,模拟记忆模式对观测数据进行重采样,进而基于支持向量回归算法构建NO_x排放预测模型,构造一种基于记忆模式的支持向量回归算法。以某机组热态试验数据为基础,对算法进行了仿真分析,结果表明,该算法在保证回归建模精度的同时,在训练速度、稳定性以及泛化性能等方面较传统支持向量回归算法更有优势。     

基于加权系数寻优的回归型加权支持向量机

在加权回归型支持向量机中,由于考虑到不同数据对预测函数贡献程度的差异性,其预测效果往往优于标准的回归型支持向量机,该文针对现有回归型加权支持向量机使用中直接选择加权系数法存在的不足,提出了一种对加权系数进行优化的新方法。该方法通过选取曲率变化大、形式简单的幂函数作为候选加权函数,并采用格子搜索法寻找最优参数,从而可以确定出最优加权系数。仿真实验表明：在利用加权支持向量机训练时间序列数据集时,采用该方法确定最优加权系数,比目前常用选择加权系数的方法效果好。     

灰色局部支持向量回归机及应用

为了解决全局支持向量回归机(Global-SVR)在大样本数据集中计算效率低下的问题,将局部支持向量回归机与灰色系统理论有机结合,并利用灰色关联度作为局部邻域函数构造灰色局部支持向量回归机(GL-SVR),该做法具有一定的理论价值.优化过程中采用留一法评估学习机的泛化性能,利用模式搜索法选择模型参数.真实的股价涨跌幅预测实验结果表明,该方法既加快了运算速度,又提高了预测精度.     

基于自适应质心距投影HSVMs的网络故障识别*

为了处理有限样本条件下的多类网络故障识别问题,提出了一种自适应质心距投影层次支持向量机。针对层次支持向量机固有的误差积累现象,该方法通过定义特征空间样本质心距投影度量类别离散程度,依据类别可分性优化偏态层次树结构;并设计基于自适应惩罚因子的补偿算法,修正由不平衡数据引起的分类超平面倾斜。实验结果表明,该方法具有较好的识别效果和效率,能够有效地抑制误差积累。     

A synergistic Mahalanobis–Taguchi system and support vector regression based predictive multivariate manufacturing process quality control approach

The primary objective of this study is to propose and verify a new synergistic prediction-based multivariate process quality control (MPQC) approach for manufacturing processes. The proposed approach considers the influence of covariates (e.g. uncontrollable inputs) and output (or response) uncertainties to predict, monitor, diagnose, and adjust for out-of-control scenarios. The prediction-based real-time synergistic approach integrates off-line and on-line multivariate quality control strategies. In this approach, based on a current state prediction of responses, process control variables are adjusted to prevent any out-of-control or abnormal situations in the process. The unique approach is designed based on a Mahalanobis–Taguchi System (MTS), support vector regression (SVR), bootstrap prediction interval (PI), and derivative-free Nelder-Mead (NM) optimisation strategy. Two real-life case studies demonstrate the suitability of the proposed approach and show improvements in process performance. This easy-to-implement distribution-free predictive quality control approach provides the necessary flexibility to industry practitioners for real-life implementation in discrete or continuous manufacturing processes.     

Fuzzy functions with support vector machines

A new fuzzy system modeling (FSM) approach that identifies the fuzzy functions using support vector machines (SVM) is proposed. This new approach is structurally different from the fuzzy rule base approaches and fuzzy regression methods. It is a new alternate version of the earlier FSM with fuzzy functions approaches. SVM is applied to determine the support vectors for each fuzzy cluster obtained by fuzzy c-means (FCM) clustering algorithm. Original input variables, the membership values obtained from the FCM together with their transformations form a new augmented set of input variables. The performance of the proposed system modeling approach is compared to previous fuzzy functions approaches, standard SVM, LSE methods using an artificial sparse dataset and a real-life non-sparse dataset. The results indicate that the proposed fuzzy functions with support vector machines approach is a feasible and stable method for regression problems and results in higher performances than the classical statistical methods.     

Centre and Range method for fitting a linear regression model to symbolic interval data

This paper introduces a new approach to fitting a linear regression model to symbolic interval data. Each example of the learning set is described by a feature vector, for which each feature value is an interval. The new method fits a linear regression model on the mid-points and ranges of the interval values assumed by the variables in the learning set. The prediction of the lower and upper bounds of the interval value of the dependent variable is accomplished from its mid-point and range, which are estimated from the fitted linear regression model applied to the mid-point and range of each interval value of the independent variables. The assessment of the proposed prediction method is based on the estimation of the average behaviour of both the root mean square error and the square of the correlation coefficient in the framework of a Monte Carlo experiment. Finally, the approaches presented in this paper are applied to a real data set and their performance is compared.     

A new learning schema based on support vector for multi-classification

A novel learning schema SVCMR based on support vector is proposed in this paper to address M-class classification issue. It creates a tree-shaped decision frame where M/2 nodes are constructed with the three-separation model as the basic classifier. A class selection rule is defined to ensure basic classifiers be trained in turn on pair of classes with maximum feature distance. Class contours are extracted as data representatives to reduce training set size. Another point is that parameters involved in SVCMR are learned from data neighborhood, which brings adaptation to various datasets and avoids pricy cost spent on searching parameter spaces. Experiments on real datasets demonstrate the performance of SVCMR can be competitive to those state-of-the-art classifiers but with the higher effectiveness than them.     

Modeling uncertain processes with interval random vector functional-link networks

This paper presents a new approach to building an interval model for an industrial process with uncertainty that employs an interval neural network (INN), which can solve problems such as model structure demands and complexity limitations in the conventional unknown but bounded (UBB) errors method. A new architecture for an interval random vector functional-link network (IRVFLN) and its learning algorithm with penalty factors are proposed, to solve the problems such as the local minima, slow convergence, and very poor sensitivity to learning rate settings in the interval feed-forward neural networks with error back-propagation (IBPNNs). As an application case study, the IRVFLN is used to model the glutamic acid fermentation process under the condition of bounded-error data, and the test results indicate that the accuracy of the IRVFLN model meets the manufacturing requirements. The comparison is performed with IBPNN, and the results demonstrate that the proposed network outperforms IBPNN both on effectiveness and efficiency. Also, a comparison is given with a crisp (point-valued) approach using RVFLN, and the results show that the crisp approach is less reliable when existing uncertainties in measuring or process.     

SVOIS: Support Vector Oriented Instance Selection for text classification

Automatic text classification is usually based on models constructed through learning from training examples. However, as the size of text document repositories grows rapidly, the storage requirements and computational cost of model learning is becoming ever higher. Instance selection is one solution to overcoming this limitation. The aim is to reduce the amount of data by filtering out noisy data from a given training dataset. A number of instance selection algorithms have been proposed in the literature, such as ENN, IB3, ICF, and DROP3. However, all of these methods have been developed for the k-nearest neighbor (k-NN) classifier. In addition, their performance has not been examined over the text classification domain where the dimensionality of the dataset is usually very high. The support vector machines (SVM) are core text classification techniques. In this study, a novel instance selection method, called Support Vector Oriented Instance Selection (SVOIS), is proposed. First of all, a regression plane in the original feature space is identified by utilizing a threshold distance between the given training instances and their class centers. Then, another threshold distance, between the identified data (forming the regression plane) and the regression plane, is used to decide on the support vectors for the selected instances. The experimental results based on the TechTC-100 dataset show the superior performance of SVOIS over other state-of-the-art algorithms. In particular, using SVOIS to select text documents allows the k-NN and SVM classifiers perform better than without instance selection.