基于核最小噪声分离变换的高光谱遥感影像特征提取研究

高光谱遥感影像具有高维非线性的特点,线性特征提取方法容易造成信息丢失和失真。在最小噪声分离变换(MNF)线性特征提取算法的基础上,引入核方法,提出核最小噪声分离变换(KMNF)高光谱遥感影像非线性特征提取方法。KMNF通过核函数,将样本映射到高维特征空间,在特征空间中运算线性MNF,实现原始空间中的非线性KMNF算法。进行基于KMNF的高光谱影像特征提取实验,分析样本个数对KMNF特征提取的效果,发现样本数量对KMNF特征提取的结果影响很小,较少的样本数即可达到较多样本时特征提取的效果。对比KMNF与MNF特征提取的效果,分析它们降维的效率与保留的信息量,发现KMNF总体降维效率与MNF相当,且体现出高光谱图像的非线性特征;在KMNF和MNF特征提取的基础上,利用SVM进行高光谱图像分类,KMNF+SVM的分类精度优于MNF+SVM。     

基于MNF和SVM的高光谱遥感影像分类研究

通过分析高光谱遥感影像分类的现状及遇到的困难,以OMIS1高光谱数据为实验数据,提出了基于最小噪声分离(Minimum Noise Fraction-MNF)变换和支持向量机(Support Vector Machine-SVM)的高光谱遥感影像分类方法。分类实验结果表明:与传统的最大似然分类法(Maxi mum Likelihood Classification-MLC)比较,该方法克服了Hughes现象,分类速度得以提高,总体分类精度达到94.85%,从而表明了该方法用于高光谱遥感影像分类的实用性和优越性。     

基于核最小噪声分离变换的高光谱遥感影像多类SVM分类

高光谱遥感影像具有高维非线性、数据冗余多、训练样本难以获得等特点。在线性最小噪声分离变换MNF(Minimum Noise Fraction)的基础上,引入核方法,提出核最小噪声分离变换KMNF(Kernel Minimum Noise Fraction)高光谱遥感影像非线性特征提取方法。在KMNF特征提取后的影像上利用多类SVM进行高光谱影像分类,分析数据维数、样本个数对分类结果的影响,并与传统的最小距离分类方法进行对比。发现最小距离分类法存在维数灾难现象,当达到一定的特征维数之后,多类SVM分类方法受维数影响较小,具有一定的抗噪声能力,在一定程度上避免了维数灾难现象;利用多类SVM进行分类时,随着样本数目的减少,合理设置有关参数,高光谱图像的分类能够维持在较高精度;而传统的最小距离分类法当样本数量较小时,效果很差,这说明了SVM小样本分类的优势。     

基于KMNF和BP神经网络的高光谱遥感影像分类

为了对高维非线性的高光谱影像进行降维及信息提取,提出了高光谱影像核最小噪声分离变换(kernel minimum noise fraction,KMNF)特征提取后利用BP神经网络分类的方法.以高光谱影像KMNF特征提取后的前几个特征分量作为BP神经网络的输入,进行BP神经网络分类,并与单独的高光谱影像BP神经网络分类进行比较.美国内华达州CUPRITE矿区AVIRIS数据的实验结果表明,基于KMNF和BP神经网络的高光谱影像分类较单独BP神经网络分类总体精度及时间性能均得到提高.     

KCCA与SVM算法支撑下的遥感影像变化检测

针对多时相影像间存在非线性变化以及变化检测阈值难以确定问题,提出结合核典型相关分析和支持向量机的遥感影像变化检测算法。首先,运用核函数对多波段遥感影像非线性映射到高维特征空间进行多变量典型相关分析,去除影像间的相关性,并构造差异影像向量。然后,采用支持向量机方法提取差异影像变化区域与不变化区域。以Landsat-8遥感影像多光谱数据进行实验,结果表明,该方法可以很好提取多光谱影像的变化信息。最后,利用形态学算子对分类结果作处理,消除了"椒盐现象"的干扰,同时提高了变化检测精度。     

KCCA与SVM算法支撑下的遥感影像变化检测

针对多时相影像间存在非线性变化以及变化检测阈值难以确定问题,提出结合核典型相关分析和支持向量机的遥感影像变化检测算法。首先,运用核函数对多波段遥感影像非线性映射到高维特征空间进行多变量典型相关分析,去除影像间的相关性,并构造差异影像向量。然后,采用支持向量机方法提取差异影像变化区域与不变化区域。以Landsat-8遥感影像多光谱数据进行实验,结果表明,该方法可以很好提取多光谱影像的变化信息。最后,利用形态学算子对分类结果作处理,消除了“椒盐现象”的干扰,同时提高了变化检测精度。     

基于小波核LS-SVM的网络流量预测

网络流量预测对大规模网络管理、规划、设计具有重要意义.支持向量机方法是近年来发展起来的新型机器学习算法,用于解决高度非线性分类及回归问题.介绍了基于小波核最小二乘支持向量机的网络流量预测方法,利用小波核函数的多分辨特性提高了支持向量机的非线性建模能力.通过对实测网络流量数据的学习,对未来网络流量进行预测.实验结果表明,取得了较好的预测效果.     

基于自适应核参数优化的小波核相关向量机算法

传统相关向量机算法在处理大规模数据集时训练速度较慢,并且高斯径向核无法完备表示特征空间。为此,基于自适应核参数优化,提出一种小波核相关向量机算法。以小波核作为基函数,在训练中,采取增量学习流程实现各个小波核参数的快速自适应优化。将提出算法应用于混沌时间序列预测及UCI数据集分类实验,结果表明,自适应参数优化小波相关向量机算法在预测精度、训练速度上均优于传统相关向量机算法。     

基于小波核LS—SVM的网络流量预测

网络流量预测对大规模网络管理、规划、设计具有重要意义。支持向量机方法是近年来发展起来的新型机器学习算法,用于解决高度非线性分类及回归问题。介绍了基于小波核最小二乘支持向量机的网络流量预测方法,利用小波核函数的多分辨特性提高了支持向量机的非线性建模能力。通过对实测网络流量数据的学习,对未来网络流量进行预测。实验结果表明,取得了较好的预测效果。     

基于支持向量机的高光谱影像分类研究

高光谱遥感技术,将反映目标辐射属性的光谱信息与反映目标空间几何关系的图像信息有机地结合在一起.高光谱影像丰富的光谱信息使其较全色遥感、多光谱遥感能够更好的进行地面目标的分类识别.本文综合利用支持向量机分类的若干关键技术,包括序列最小优化训练算法,多类支持向量机构造方法、核函数及其参数选择的交叉验证"网格搜索",给出了高光谱影像分类流程,进行了遥感数据试验分析.     

Wavelet twin support vector machine

Twin support vector machine (TWSVM) is a research hot spot in the field of machine learning in recent years. Although its performance is better than traditional support vector machine (SVM), the kernel selection problem still affects the performance of TWSVM directly. Wavelet analysis has the characteristics of multivariate interpolation and sparse change, and it is suitable for the analysis of local signals and the detection of transient signals. The wavelet kernel function based on wavelet analysis can approximate any nonlinear functions. Based on the wavelet kernel features and the kernel function selection problem, wavelet twin support vector machine (WTWSVM) is proposed by this paper. It introduces the wavelet kernel function into TWSVM to make the combination of wavelet analysis techniques and TWSVM come true. The experimental results indicate that WTWSVM is feasible, and it improves the classification accuracy and generalization ability of TWSVM significantly.     

一种基于变分相关向量机的特征选择和分类结合方法

相关向量机(Relevance vector machine, RVM)是一种函数形式等价于支持向量机(Support vector machine, SVM)的全概率模型,利用变分贝叶斯(Variational Bayesian, VB)方法求解的RVM可以给出所有参数的后验分布. 进一步,通过对样本所在原始特征空间的稀疏化,基于线性核的RVM可以在分类的同时实现对原始特征的线性选择. 本文在传统VB-RVM的基础上提出一种特征选择和分类结合方法. 该方法采用Probit模型将分类问题与回归问题有机地结合起来, 同时,通过对特征维的幂变换扩展,不仅在分类时增加了样本的信息量, 可以构造非线性分类面,而且实现了非线性特征选择的功能. 通过对仿真数据和实测数据分别进行实验, 证明了该特征选择和分类结合方法的实用性和有效性.     

基于最小噪声分离变换的高光谱异常检测方法研究

RX算法和核RX算法能很好地分离目标和背景,是较为广泛使用的异常检测算法,但是高光谱图像数据量大且存在冗余信息和噪声,直接进行RX及核RX异常探测运算量大且容易受噪声影响.针对此问题,提出一种基于最小噪声分离变换的高光谱图像异常检测方法,首先采用残差分析法估计噪声协方差矩阵以改进最小噪声分离变换,然后利用改进后的最小噪声分离变换来有效地降低高光谱图像数据的维数并分离出噪声,最后对低维降噪后的数据进行RX及核RX异常检测,避免了随机噪声对RX及核RX异常检测结果的影响并提高了异常检测率.对真实的AVIRIS数据测试表明,该算法优于传统的相应的RX、核RX异常检测算法.     

小波核局部Fisher判别分析的高光谱遥感影像特征提取

为了提高高光谱遥感影像的分类精度,充分利用影像的光谱和局部信息,文中提出小波核局部Fisher判别分析的高光谱遥感影像特征提取方法.通过小波核函数将数据集从低维原始空间映射至高维特征空间,考虑到数据的局部信息,利用加权矩阵计算散度矩阵,对局部Fisher判别准则函数求解最优特征矩阵,使不同类别的样本在高维特征空间中的可分离性更佳.在2个公开高光谱数据集上的实验表明,文中方法的总体分类精度和Kappa系数都有所提高.     

Semantic classification for hyperspectral image by integrating distance measurement and relevance vector machine

Accurate hyperspectral image classification requires not only image features but also semantic concept. Similarity and relevance relation are both key factors in building image features and semantic measurement. To perform hyperspectral image classification from the viewpoint of semantic, this study focuses on creating a semantic annotation-based image classification method with relevance and similarity measurement. First, the computational model of relevance vector machine is utilized to perform cluster computation for hyperspectral image data. Then multi-distance learning algorithm is optimized as holding capability for multiple dimensions data. The proposed multi-distance learning algorithm with multiple dimensions is used to measure the similarity, according to the result of cluster computation through relevance vector machine. Finally, semantic annotation is introduced to complete classification of hyperspectral image with semantic concept. Validation with the ground truth data illustrates that the proposed method can provide more accurate and integrated classification result compared with the other methodologies. Therefore, the integration of similarity and relevance measurement is able to improve the performance of hyperspectral image classification.     

A wavelet-based classification of hyperspectral images using Schroedinger eigenmaps

This article proposes a new algorithm for hyperspectral image classification. The proposed method is a spectral–spatial method based on wavelet transforms, kernel minimum noise fraction (KMNF) and spatial–spectral Schroedinger eigenmaps (SSSE). To overcome the computation complexity, one-dimensional discrete wavelet transform (1D-DWT) is applied in spectral domain. To reduce noise, KMNF coefficients are extracted in wavelet space. To solve time-consuming problem, 2D-DWT coefficients are employed in spatial space. Hence, the combination of 1D-DWT, KMNF, and 2D-DWT is suggested to create SSSE features. The classification is carried out by a Support Vector Machine (SVM) classifier. Experimental results show that classification accuracy and time consumption are effectively improved compared to the state-of-the art reported spectral–spatial SVM-based methods.     

A wavelet extreme learning machine

Extreme learning machine (ELM) has been widely used in various fields to overcome the problem of low training speed of the conventional neural network. Kernel extreme learning machine (KELM) introduces the kernel method to ELM model, which is applicable in Stat ML. However, if the number of samples in Stat ML is too small, perhaps the unbalanced samples cannot reflect the statistical characteristics of the input data, so that the learning ability of Stat ML will be influenced. At the same time, the mix kernel functions used in KELM are conventional functions. Therefore, the selection of kernel function can still be optimized. Based on the problems above, we introduce the weighted method to KELM to deal with the unbalanced samples. Wavelet kernel functions have been widely used in support vector machine and obtain a good classification performance. Therefore, to realize a combination of wavelet analysis and KELM, we introduce wavelet kernel functions to KELM model, which has a mix kernel function of wavelet kernel and sigmoid kernel, and introduce the weighted method to KELM model to balance the sample distribution, and then we propose the weighted wavelet–mix kernel extreme learning machine. The experimental results show that this method can effectively improve the classification ability with better generalization. At the same time, the wavelet kernel functions perform very well compared with the conventional kernel functions in KELM model.     

变元可分离核函数对非线性支持向量分类机的影响

证明了变元可分离函数在Hilbert空间中满足Mercer定理的条件，为构造新的非线性支持向量分类机时选定核函数提供了一种新方法，并通过新方法构造的核函数与其它核函数构造的非线性支持向量分类机比较，得出了较好的结果。