Image mining by spectral features: A case study of scenery image classification

Spectral features of images, such as Gabor filters and wavelet transform can be used for texture image classification. That is, a classifier is trained based on some labeled texture features as the training set to classify unlabeled texture features of images into some pre-defined classes. The aim of this paper is twofold. First, it investigates the classification performance of using Gabor filters, wavelet transform, and their combination respectively, as the texture feature representation of scenery images (such as mountain, castle, etc.). A k-nearest neighbor (k-NN) classifier and support vector machine (SVM) are also compared. Second, three k-NN classifiers and three SVMs are combined respectively, in which each of the combined three classifiers uses one of the above three texture feature representations respectively, to see whether combining multiple classifiers can outperform the single classifier in terms of scenery image classification. The result shows that a single SVM using Gabor filters provides the highest classification accuracy than the other two spectral features and the combined three k-NN classifiers and three SVMs.     

基于SVM的图像分类研究

图像分类技术有着重要的应用前景,而且对于基于内容的图像检索的发展会有积极的推动作用。多类图像分类是图像分类中的难点,对基于SVM的多类图像分类方法进行了研究,提出在二类支持向量机的基础上构造多类分类器的方法,实验结果证明和传统方法相比,分类准确率有了较大的提高。     

一种设计层次支持向量机多类分类器的新方法

层次结构的设计是层次支持向量机多类分类方法应用中的关键问题,类间可分性是设计层次结构的重要依据,提出了一种基于线性支持向量机度量类间相似程度的方法,并给出了一种基于类间可分性设计层次支持向量机多类分类器的新方法。实验表明,新方法有效地提高了层次支持向量机多类分类器的分类精度和速度。     

基于自适应特征选择和SVM的图像分类的研究

提出多特征结合的图像分类方法,分别提取颜色特征和LBP纹理特征,同时提出Adaboost算法对特征进行选择,选择最能表示图像的特征,这样既降低了特征的维数,又提高了分类的精度。最后对基于SVM的多类图像分类方法进行了研究,提出在二类支持向量机的基础上构造多类分类器的方法,实验结果表明,提出的方法能够很好地用于图像分类。     

Classification of mental tasks using stockwell transform

In recent years, various physiological signal based rehabilitation systems have been developed for the physically disabled in which electroencephalographic (EEG) signal is one among them. The efficiency of such a system depends upon the signal processing and classification algorithms. In order to develop an EEG based rehabilitation or assistive system, it is necessary to develop an effective EEG signal processing algorithm. This paper proposes Stockwell transform (ST) based analysis of EEG dynamics during different mental tasks. EEG signals from Keirn and Aunon database were used in this study. Three classifiers were employed such as k-means nearest neighborhood (kNN), linear discriminant analysis (LDA) and support vector machine (SVM) to test the strength of the proposed features. Ten-fold cross validation method was used to demonstrate the consistency of the classification results. Using the proposed method, an average accuracy ranging between 84.72% and 98.95% was achieved for multi-class problems (five mental tasks).     

An expert diagnosis system for classification of human parasite eggs based on multi-class SVM

In this paper, it is proposed a new methodology based on invariant moments and multi-class support vector machine (MCSVM) for classification of human parasite eggs in microscopic images. The MCSVM is one of the most used classifiers but it has not used for classification of human parasite eggs to date. This method composes four stages. These are pre-processing stage, feature extraction stage, classification stage, and testing stage. In pre-processing stage, the digital image processing methods, which are noise reduction, contrast enhancement, thresholding, and morphological and logical processes. In feature extraction stage, the invariant moments of pre-processed parasite images are calculated. Finally, in classification stage, the multi-class support vector machine (MCSVM) classifier is used for classification of features extracted feature extraction stage. We used MATLAB software for estimating the success classification rate of proposed approach in this study. For this aim, proposed approach was tested by using test data. At end of test, 97.70% overall success rates were obtained.     

基于证据理论的多类分类支持向量机集成

针对多类分类问题,研究支持向量机集成中的分类器组合架构与方法.分析已有的多类级和两类级支持向量机集成架构的不足后,提出两层的集成架构.在此基础上,研究基于证据理论的支持向量机度量层输出信息融合方法,针对一对多与一对一两种多类扩展策略,分别定义基本概率分配函数,并根据证据冲突程度采用不同的证据组合规则.在一对多策略下,采用经典的Dempster规则;在一对一策略下则提出一条新的规则,以组合冲突严重的证据.实验表明,两层架构优于多类级架构,证据理论方法能有效地利用两类支持向量机的度量层输出信息,取得了满意的结果.     

以多类支持向量机为基础的小样本信息融合策略*

通过将多类支持向量机作为分类器,运用Dempster-Shafer理论等信息融合方法对分类结果进行融合,实现对小样本的分类。主要采用对多类支持向量机的分类结果进行求和后取最大值、Dempster-Shafer理论以及使用Dempster-Shafer理论后第二次使用支持向量机三种方式进行融合。由于支持向量机本身是适用于小样本的机器学习算法,Dempster-Shafer理论又可以较好地处理不确定性,两者的结合可以较好地处理小样本分类问题,并提高最终的分类精度。实验结果表明,提出的几种融合策略确实可以在小样     

Boosting a fast neural network for supervised land cover classification

It is demonstrated that the use of an ensemble of neural networks for routine land cover classification of multispectral satellite data can lead to a significant improvement in classification accuracy. Specifically, the AdaBoost.M1 algorithm is applied to a sequence of three-layer, feed-forward neural networks. In order to overcome the drawback of long training time for each network in the ensemble, the networks are trained with an efficient Kalman filter algorithm. On the basis of statistical hypothesis tests, classification performance on multispectral imagery is compared with that of maximum likelihood and support vector machine classifiers. Good generalization accuracies are obtained with computation times of the order of 1 h or less. The algorithms involved are described in detail and a software implementation in the ENVI/IDL image analysis environment is provided.     

基于类别的室内被动定位特征选择

针对基于射频的室内被动定位研究中,用于训练定位分类器的链路特征数较多,分类器复杂度较高的问题,提出了一种基于类别的室内被动定位特征选择方法。此方法将被动定位的多分类问题转化为多个二分类问题,利用最大-最小马尔科夫毯为每个位置类别选择其表征能力较强的特征子集,并构建相应的二分类模型。在测试阶段,采用支持向量机的概率评估输出,最终确定测试样例的位置类别。实验结果表明,此方法大幅减少了定位所需的特征维数,降低了分类器复杂度,同时使定位的准确度得以提高。     

基于SVM集成学习的网络故障诊断方法

针对现有支持向量机(support vector machine,SVM)多分类方法在网络故障诊断中识别精度较低的问题,提出一种基于二叉树结构和模型二重扰动的SVM集成学习算法;通过集成学习思想提高网络故障诊断的精度;在集成过程中对二叉树结构和核参数进行扰动,加大个体分类器的差异度,提升了诊断模型的泛化性;在实际网络中的诊断实验表明,所提的方法较二叉树等其它SVM多分类方法具有更高的诊断精度。     

Multi-class supervised classification of electrical borehole wall images using texture features

Electrical borehole wall images represent micro-resistivity measurements at the borehole wall. The lithology reconstruction is often based on visual interpretation done by geologists. This analysis is very time-consuming and subjective. Different geologists may interpret the data differently. In this work, linear discriminant analysis (LDA) in combination with texture features is used for an automated lithology reconstruction of ODP (Ocean Drilling Program) borehole 1203A drilled during Leg 197. Six rock groups are identified by their textural properties in resistivity data obtained by a Formation MircoScanner (FMS). Although discriminant analysis can be used for multi-class classification, non-optimal decision criteria for certain groups could emerge. For this reason, we use a combination of 2-class (binary) classifiers to increase the overall classification accuracy. The generalization ability of the combined classifiers is evaluated and optimized on a testing dataset where a classification rate of more than 80% for each of the six rock groups is achieved. The combined, trained classifiers are then applied on the whole dataset obtaining a statistical reconstruction of the logged formation. Compared to a single multi-class classifier the combined binary classifiers show better classification results for certain rock groups and more stable results in larger intervals of equal rock type.     

基于小波变换和多类支持向量机的图像分类

提出了一种基于小波变换和多类支持向量机的图像分类新方法,该方法利用小波变换进行图像特征提取,利用多类支持向量机进行图像分类,并与基于图像底层特征的图像分类方法进行了实验比较。实验结果表明该方法具有较好的分类性能。     

基于ELM和证据理论的纹理图像分类

目前纹理图像分类有不同的方法,但对纹理的描述还不够全面,而且当有新方法提取的特征加入时,系统的可扩展性也不够,通用性不好。本文针对上述问题提出了一种将D-S证据理论与极限学习机相结合的决策级融合模型,用来对纹理图像进行分类。采用三种不同方法来提取特征以获得更多更全面的纹理表现形式,并对提取的每种特征向量用极限学习机建立相应的分类器,最后用D-S证据理论在不确定性表示、度量和组合方面有着的优势来进行决策级融合。对于证据理论中基本概率赋值函数(BPAF)难以有效获取的问题,由于极限学习机具有学习速度快,泛化性能好的优点并且产生唯一的最优解的优点,所以利用其来构造其基本概率赋值函数。实验结果表明这种方法比单个分类器具有更高的识别正确率,降低了识别的不确定性。     

基于熵的二叉树多类支持向量机的漏洞分类

为了有效提高漏洞分类的准确性,针对基于二叉树多类支持向量机分类算法的分类复杂性和分类结果依赖二叉树的结构等缺点,提出了一种基于熵的二叉树多类支持向量机的漏洞分类算法。根据定义最小超球体进行漏洞样本空间的分类,有效地通过熵的计算来描述漏洞之间的混杂程度,使得漏洞分类的计算过程被简化且能够有效减少分类结果对二叉树结构的依赖。采用公共漏洞枚举(CWE)漏洞分类体系在收集到的3000个漏洞样本上进行大量仿真实验,漏洞分类的平均准确率和平均召回率达93.3%和93.25%,高于基于二叉树多类支持向量机分类算法和K-近邻(KNN)分类算法得到的平均值。实验结果表明所提算法有效可行,能精确地实现漏洞的分类。     

Estimating size fraction categories of coal particles on conveyor belts using image texture modeling methods

Motivation: Physical properties of coal such as particle size distribution have a large influence on the stability and operational behavior of fluidized bed reactors and metallurgical furnaces. In particular, the presence of large amounts of “fine” particles invariably has a drastic effect on plant performance as a result of impaired gas permeability characteristics of the coal or ore burden. Therefore, monitoring and control of particle size distribution profiles of such aggregate material on reactor feed streams, such as moving conveyor belts, is critical for predictable operation of these processes. Traditionally, the method of sieve analysis using stock or belt cut samples has been widely used in industry. Unfortunately, the reliability and usefulness of belt cut techniques are constrained by frequency of sampling as well as laboratory analysis turnaround times. For real-time monitoring and control purposes, automated sampling and analysis methods are more desirable. Methods: In this study, the problem of estimating the particle size distribution profile of material on a moving conveyor belt is formulated within a texture classification framework, which has its basis in machine vision and incorporates elements from statistical pattern recognition. Using exemplar images of coal particles taken on a process stream, a set of local features that compactly describes the textural properties of each image are expressed in terms of localized nonlinear features called textons. Representation of image information using textons is primarily motivated by insights from neuroscience research on the optimality of linear oriented basis functions as models of perception in early processing of visual information in the cortex regions of the human brain. Using these representations for different textures, nearest neighbor and support vector machine classification models are subsequently used to classify test images. Results: Using a comprehensive evaluation, it is shown that the use of texton representation obtained from decomposing images with linear oriented basis functions can be sufficiently discriminative compared to the use of the widely used second-order statistical features or features from other baseline models. In particular, model performance obtained with appropriately tuned filters suggest the importance of including shape and spatial structure information in an image representation for texture classification of coal particles. Furthermore, using nonlinear support vector machines rather than nearest neighbor classifiers significantly improved classification performance. A texture classification approach to particle size profile estimation has potential applications in the online monitoring of the proportion of “fines” in coal material on moving conveyor belts.     

基于复小波和支持向量机的纹理分类法*

针对图像纹理分类问题,提出了一种将二元树复小波变换与支持向量机相结合的分类方法,通过二元树复小波变换对纹理图像进行四层分解,提取各子频带小波系数模的均值和标准方差组成特征向量,利用支持向量机作为分类器实现纹理图像分类。对20类Brodatz纹理图像的分类实验表明,提出的方法具有较高的分类精度,在有限训练样本的情况下比传统的分类算法平均正确率有10%左右的提高,体现了该方法的有效性和良好的泛化能力。     

Feature selection in the Laplacian support vector machine

Traditional classifiers including support vector machines use only labeled data in training. However, labeled instances are often difficult, costly, or time consuming to obtain while unlabeled instances are relatively easy to collect. The goal of semi-supervised learning is to improve the classification accuracy by using unlabeled data together with a few labeled data in training classifiers. Recently, the Laplacian support vector machine has been proposed as an extension of the support vector machine to semi-supervised learning. The Laplacian support vector machine has drawbacks in its interpretability as the support vector machine has. Also it performs poorly when there are many non-informative features in the training data because the final classifier is expressed as a linear combination of informative as well as non-informative features. We introduce a variant of the Laplacian support vector machine that is capable of feature selection based on functional analysis of variance decomposition. Through synthetic and benchmark data analysis, we illustrate that our method can be a useful tool in semi-supervised learning.