Integration of orthoimagery and lidar data for object-based urban thematic mapping using random forests

Using high-spatial-resolution multispectral imagery alone is insufficient for achieving highly accurate and reliable thematic mapping of urban areas. Integration of lidar-derived elevation information into image classification can considerably improve classification results. Additionally, traditional pixel-based classifiers have some limitations in regard to certain landscape and data types. In this study, we take advantage of current advances in object-based image analysis and machine learning algorithms to reduce manual image interpretation and automate feature selection in a classification process. A sequence of image segmentation, feature selection, and object classification is developed and tested by the data sets in two study areas (Mannheim, Germany and Niagara Falls, Canada). First, to improve the quality of segmentation, a range image of lidar data is incorporated in an image segmentation process. Among features derived from lidar data and aerial imagery, the random forest, a robust ensemble classifier, is then used to identify the best features using iterative feature elimination. On the condition that the number of samples is at least two or three times the number of features, a segmentation scale factor has no particular effect on the selected features or classification accuracies. The results of the two study areas demonstrate that the presented object-based classification method, compared with the pixel-based classification, improves by 0.02 and 0.05 in kappa statistics, and by 3.9% and 4.5% in overall accuracy, respectively.     

Object-based urban structure type pattern recognition from Landsat TM with a Support Vector Machine

This study evaluates the potential of object-based image analysis in combination with supervised machine learning to identify urban structure type patterns from Landsat Thematic Mapper (TM) images. The main aim is to assess the influence of several critical choices commonly made during the training stage of a learning machine on the classification performance and to give recommendations for classifier-dependent intelligent training. Particular emphasis is given to assess the influence of size and class distribution of the training data, the approach of training data sampling (user-guided or random) and the type of training samples (squares or segments) on the classification performance of a Support Vector Machine (SVM). Different feature selection algorithms are compared and segmentation and classifier parameters are dynamically tuned for the specific image scene, classification task, and training data. The performance of the classifier is measured against a set of reference data sets from manual image interpretation and furthermore compared on the basis of landscape metrics to a very high resolution reference classification derived from light detection and ranging (lidar) measurements. The study highlights the importance of a careful design of the training stage and dynamically tuned classifier parameters, especially when dealing with noisy data and small training data sets. For the given experimental set-up, the study concludes that given optimized feature space and classifier parameters, training an SVM with segment-shaped samples that were sampled in a guided manner and are balanced between the classes provided the best classification results. If square-shaped samples are used, a random sampling provided better results than a guided selection. Equally balanced sample distributions outperformed unbalanced training sets.     

基于图像目标特征空间自学习分类算法

为解决图像分类过程中特征点选择的随机性对分类精度造成的影响,提出一种基于图像目标特征空间自学习分类算法。利用基于颜色和纹理特征的多通道局部主动轮廊模型找到图像的目标区域,在目标区域选取特征并对特征稀疏编码建立图像的目标特征空间。为进一步提高图像分类精度建立投票机制下基于图像目标特征空间的自学习算法。实验结果表明,该方法能避免特征选择的随机性对实验结果的影响,有效地提高图像分类的精度。     

Partially supervised hierarchical classification for urban features from lidar data with aerial imagery

Although spatial and spectral resolutions of remotely sensed data have been improved, the usage of multispectral imagery is not sufficient for urban feature classification. This article addresses the problem of automated classification by integrating airborne lidar range data and aerial imagery. In this study, the classification procedure is divided into three phases. We first use the lidar range data to obtain the coarse lidar-based classification results, by which a lidar-driven labelled image and a lidar-driven high-rise object mask are acquired in this phase. Then, at the image-based classification level, we train samples based on the lidar-driven labelled image and conduct maximum likelihood classification experience with the lidar-driven normalized digital surface model as a high-rise object mask. Finally, we propose a knowledge-based cross-validation (KBCV) for misclassification between the lidar-based classification results and the image-based classification results. Experimental results are presented to demonstrate the benefits of the training sample selection of the lidar-driven labelled image, using the lidar-driven high-rise object mask, and the greater classification accuracy of the KBCV.     

基于改进CNN的宫颈细胞自动分类算法

本文采用深度学习算法中的卷积神经网络对细胞图像进行识别, 实现对宫颈细胞图像的自动分类. 首先对宫颈细胞进行预处理, 通过细胞核裁剪解决图像输入尺寸不一的问题, 对图像进行翻转平移, 对数据集进行扩充, 并解决样本量不均衡的问题; 接着选取VGG-16网络进行改进, 使用改进后的VGG-16网络进行特征提取, 以及细胞分类; 并采用迁移学习的方法加载预训练网络参数, 进而加快参数收敛速度, 提高分类准确率; 最终通过对网络的训练, 得到了较好的分类结果, 将分类结果与人工提取特征设计分类器的方法相比, 分类的准确率有所提高, 二分类的准确率达97.3%, 七分类的准确率达89%. 实验结果表明: 卷积神经网络对宫颈细胞图像进行自动分类, 分类准确率相比较人工提取特征分类器效果较好, 且分类结果不受分割图像准确率的影响.     

跨数据集评估的高光谱图像分类

目的 随着高光谱成像技术的飞速发展,高光谱数据的应用越来越广泛,各场景高光谱图像的应用对高精度详细标注的需求也越来越旺盛。现有高光谱分类模型的发展大多集中于有监督学习,大多数方法都在单个高光谱数据立方中进行训练和评估。由于不同高光谱数据采集场景不同且地物类别不一致,已训练好的模型并不能直接迁移至新的数据集得到可靠标注,这也限制了高光谱图像分类模型的进一步发展。本文提出跨数据集对高光谱分类模型进行训练和评估的模式。方法 受零样本学习的启发,本文引入高光谱类别标签的语义信息,拟通过将不同数据集的原始数据及标签信息分别映射至同一特征空间以建立已知类别和未知类别的关联,再通过将训练数据集的两部分特征映射至统一的嵌入空间学习高光谱图像视觉特征和类别标签语义特征的对应关系,即可将该对应关系应用于测试数据集进行标签推理。结果 实验在一对同传感器采集的数据集上完成,比较分析了语义—视觉特征映射和视觉—语义特征映射方向,对比了5种基于零样本学习的特征映射方法,在高光谱图像分类任务中实现了对分类模型在不同数据集上的训练和评估。结论 实验结果表明,本文提出的基于零样本学习的高光谱分类模型可以实现跨数据集对分类模型进行训练和评估,在高光谱图像分类任务中具有一定的发展潜力。     

结合地籍数据的高密度城区面向对象遥感分类 

利用高分辨率遥感影像和GIS辅助数据,对高密度城区进行面向对象的土地利用覆被分类研究。使用NAIP高分辨率航空遥感影像,在多尺度影像分割的基础上,针对特定地物选择合适的影像分割参数。采用决策树方法建立高密度城市地区的分类规则,并结合该地区地籍图数据作为辅助数据,逐步进行高密度城市地区地物信息提取。利用辅助数据进行面向对象的遥感分类效果优于单纯依靠遥感影像进行的分类,且有效提取了道路和复杂的房屋等信息,得到了理想的分类结果,其总分类精度从常规面向对象方法的84.08%提高到89.79%。利用辅助数据进行遥感分类提高了高分辨率遥感影像的分类精度,说明了利用辅助数据进行遥感分类方法的有效性。     

深度学习在GlobeLand30-2010产品分类精度优化中应用研究

本文提出结合深度卷积神经网络与在线高分遥感影像的分类方法，用于GlobeLand30地表覆盖产品的质量优化。首先，通过对多源地表覆盖产品的一致性分析，构建深度学习训练所需的高分辨率遥感大样本（224万样本量）；其次，基于该大规模样本集训练适用于GlobeLand30优化的深度卷积神经网络模型（GoogleNet Inception V3）；最后，利用训练好的神经网络模型对在线高分影像进行分类，用以优化GlobeLand30产品的不可靠区域。经独立测试样本集验证，经过训练的神经网络分类总体精度为87.7%，Kappa系数为0.86，相比原始GlobeLand30的精度（总体精度75.1%、Kappa系数0.71）有了明显提升。在4个试验区的GlobeLand 30产品优化实验表明：该方法能够有效优化GlobeLand30产品的分类精度。     

一种改进的红外目标识别算法

提出一种基于一维搜索和距离函数的快速独立分量分析(Fast ICA)特征提取改进算法。该算法针对Fast ICA中迭代初始值的选取影响其收敛性的问题,通过一维搜索策略使其收敛性不依赖于初始值的选取。与此同时,根据红外图像的特性设计类内类间距离函数准则对提取的独立分量进行优化选择,保留对目标识别贡献大的独立分量特征,从而克服在高维特征子空间下随着训练图像样本数的增多,红外目标识别率和稳定性下降的问题。实测数据实验结果表明,与传统算法相比,该算法能够在提取少量红外目标特征的情况下达到更低的错分率,且算法在不同类别数下的错分率具有较强的鲁棒性。     

深度学习在GlobeLand30-2010产品分类精度优化中应用研究

本文提出结合深度卷积神经网络与在线高分遥感影像的分类方法,用于GlobeLand30地表覆盖产品的质量优化。首先,通过对多源地表覆盖产品的一致性分析,构建深度学习训练所需的高分辨率遥感大样本（224万样本量）;其次,基于该大规模样本集训练适用于GlobeLand30优化的深度卷积神经网络模型（GoogleNet Inception V3）;最后,利用训练好的神经网络模型对在线高分影像进行分类,用以优化GlobeLand30产品的不可靠区域。经独立测试样本集验证,经过训练的神经网络分类总体精度为87.7%,Kappa系数为0.86,相比原始GlobeLand30的精度（总体精度75.1%、Kappa系数0.71）有了明显提升。在4个试验区的GlobeLand 30产品优化实验表明：该方法能够有效优化GlobeLand30产品的分类精度。     

采用最小误差阈值分割算法的基因芯片图像分析

为了能够较好地处理芯片图像,尽可能准确地提取出描述基因样点的数据信息,采用了最小误差阈值的分割算法.该方法在假设目标和背景的分布服从混合正态分布的前提下,设定了最小误差分类目标函数,通过求得使目标函数值最小的最佳分割阈值,实现基因样点和背景图像的分割.针对分割出来的基因样点图像提取特征数据,最后对这些数据进行聚类分析,进而对实验样点进行分类.在实验中应用该方法分析了2组基因芯片图像,基因样点的分类效果较好,验证了该基因芯片分析方法的可行性.     

基于高分辨率遥感影像的不透水面信息提取方法研究

不透水面是城市地区的典型特征,它与城市总用地面积的比值--不透水率作为一个重要的城市生态指数常出现于城市水文、水质、面源污染以及城市植被制图等研究中。利用高分辨率遥感影像提取不透水面不仅可获得较高精度的不透水面信息,而且可为中低分辨率遥感影像的不透水面提取提供样本训练区并检验其提取精度。本文利用南京IKONOS影像,采用面向对象分类方法提取不透水面信息,初步解决了阴影归类和遮盖不透水面的植被剔除等问题,提高了不透水面信息提取精度。     

Application of Bayes linear discriminant functions in image classification

In statistical image classification it is usually assumed that feature observations given class labels are independently distributed. Even in the case when training sample is formed by dependent feature observations, the feature observations to be classified are usually assumed to be independent from training sample. In this paper we propose the original method of the incorporation of spatial information into the per-pixel classifiers. Our approach is based on the retraction of the independence assumption by proposing stationary Gaussian random field (GRF) model for features. The conditional distribution of class label of observation to be classified is assumed to be dependent on its spatial adjacency within the spatial framework of the training sample. For a given training sample, plug-in version of the Bayes discriminant function (PBDF) is proposed for classification. Performance of the proposed PBDF is tested and compared with ones ignoring dependence among feature observations to be classified and training sample. For illustration the image of figure corrupted by the additive GRF is analyzed. The advantage of the proposed classifier against the competing one is shown visually and numerically in the first example. In the second example, three spatial sampling designs for training data are compared on the basis of the actual error rate values of the proposed PBDF. For the remotely sensed image, the advantage of the proposed classification method against popular unsupervised classification method is shown in terms of visual evaluation and empirical errors of misclassification.     

基于Gabor小波和CNN的图像失真类型判定算法

针对图像失真分类问题,提出了一种基于Gabor小波和卷积神经网络（convolutional neural network,CNN）的失真类型判定算法。该算法先利用Gabor小波的良好特性对图像进行特征粗提取,再通过改进的CNN进一步提取关键特征。算法步骤包括：首先对图像进行预处理（包括标签设定、样本均衡和样本扩充）;然后对预处理后的图像进行八方向的Gabor小波变换,并将不同方向的子带叠加构成输入样本;最后通过自行设计的CNN和Softmax分类器对样本进行训练,训练过程中采用随机梯度下降和反向误差传播的方法对卷积核参数进行优化得到最终模型。对训练好的模型进行失真类型判定实验,在LIVE标准图像库上分类正确率达95.62%,表明本算法具有较高的准确性和鲁棒性。     

Bayesian sample steered discriminative regression for biometric image classification

Regression techniques, such as ridge regression (RR) and logistic regression (LR), have been widely used in supervised learning for pattern classification. However, these methods mainly exploit the class label information for linear mapping function learning. They will become less effective when the number of training samples per class is small. In visual classification tasks such as face recognition, the appearance of the training sample images also conveys important discriminative information. This paper proposes a novel regression based classification model, namely Bayesian sample steered discriminative regression (BSDR), which simultaneously exploits the sample class label and the sample appearance for linear mapping function learning by virtue of the Bayesian formula. BSDR learns a linear mapping for each class to extract the image class label features, and classification can be simply done by nearest neighbor classifier. The proposed BSDR method has advantages such as small number of mappings, insensitiveness to input feature dimensionality and robustness to small sample size. Extensive experiments on several biometric databases also demonstrate the promising classification performance of our method.     

基于多尺度特征和元学习的智能预测找矿靶区实验研究

当前智能找矿靶区预测方法大多依赖于人工采样和专家的知识经验,然而,对于现实世界中区域小、数量少的矿区区域,这些方法将面临巨大的挑战。为了迎接这个挑战,提出一种新颖的深度智能找矿靶区预测框架——多尺度特征交互框架。具体地,首先定义两个网络,即多尺度特征映射网络和多尺度特征分类网络;在此基础上,通过膨胀卷积捕获多尺度特征映射网络中不同地球化学元素的特征,并且利用多尺度分类网络处理这些特征;其次,使用元网络为多尺度分类网络生成卷积权重;最后使用自蒸馏挖掘多尺度分类网络中的隐知识用于预测。整个模型采用端到端的训练方式,大量的实验结果表明,多尺度特征交互框架与当前最先进的方法比较具有显著的竞争力。     

3D密集全卷积的高光谱地物分类算法研究

针对高光谱遥感图像训练样本较少、光谱维度较高、空间特征与频谱特征存在差异性而导致高光谱地物分类的特征提取不合理、分类精度不稳定和训练时间长等问题,提出了基于3D密集全卷积（3D-DSFCN）的高光谱图像（HSI）分类算法。算法通过密集模块中的3D卷积核分别提取光谱特征和空间特征,采用特征映射模块替换传统网络中的池化层和全连接层,最后通过softmax分类器进行分类。实验结果表明,基于3D-DSFCN的HSI分类方法提高了地物分类的准确率、增强了低频标签的分类稳定性。     

样本特征对参数/非参数分类器分类精度的影响分析

为验证理论训练数量(10~30 p)对参数分类器(如最大似然分类)、非参数分类器(如支撑向量机)的适用性以及样本特征(光谱统计、空间分布特征)对分类器分类精度的影响,选择不同规模的训练样本进行最大似然分类和支撑向量机分类,分析分类精度与样本之间的关系。实验结果表明:随着样本量的增加,最大似然、支撑向量机分类精度均随样本量增多而提高并趋于稳定,最大似然分类精度的增长速度要快于支撑向量机。MLC受样本量的影响较大,在小样本的时候(5个),分类精度不稳定,超过30个样本的时候,分类精度稳定下来;对于SVM分类器,在小样本的时候(5个),分类精度较高且稳定,因此SVM分类适合于小样本分类,不受限于理论样本量的影响。当样本量超过最小理论样本量值(30个)的时候,最大似然分类精度要优于支撑向量机,主要是由于当样本量增加后,最大似然更易于获得有效的信息量样本,而对于支撑向量机边缘信息样本的增加数量不大。研究结果为进一步优化样本进行分类打下前期的实验基础。     

Automated extraction of welds from digitized radiographic images based on mlp neural networks

It is desired to automate inspection of welding flaws. Automated extraction of welds forms the first step in developing an automated weld inspection system. This article presents a multilayered perceptron (MLP) based procedure for extracting welds from digitized radiographic images. The procedure consists of three major components: feature extraction, MLP-based object classification, and postprocessing. For each object in the line image extracted from the whole image, four features are defined: the peak position (x1), the width (x2), the mean square error between the object and its Gaussian intensity plot (x3), and the peak intensity (x4). Fiftyone training samples were used to train MLP neural networks. The training of MLP classifiers is discussed. Trained MLP neural networks are subsequently used to test unlearned feature patterns and to identify whether the patterns are welds or not. Postprocessing is performed to remove noises (misclassified nonweld objects) and restore the continuity of weld line (discontinuity due to missed weld objects). Test results show that the procedure can successfully extract all welds (100%) from 25 radiographic images.