地物提取的多尺度特征遥感应用分析

通过空间尺度效应分析,阐述不同属性景观地物在同一分辨率或同一尺度影像中提取的不合理性。为获得精确的地表信息,提出多尺度遥感影像分析方法,解决不同地物在不同空间尺度影像数据中提取的难题。通过多种分辨率影像的多尺度影像信息提取的应用实践,分析地物提取中的多尺度特性、尺度与分辨率关系等。     

Image‐object detectable in multiscale analysis on high‐resolution remotely sensed imagery

Landscapes are complex systems composed of a large number of heterogeneous components as well as explicit homogeneous regions that have similar spectral character on high‐resolution remote sensing imagery. The multiscale analysis method is considered an effective way to study the remotely sensed images of complex landscape systems. However, there remain some difficulties in identifying perfect image‐objects that tally with the actual ground‐object figures from their hierarchical presentation results. Therefore, to overcome the shortcomings in applications of multiresolution segmentation, some concepts and a four‐step approach are introduced for homogeneous image‐object detection. The spectral mean distance and standard deviation of neighbouring object candidates are used to distinguish between two adjacent candidates in one segmentation. The distinguishing value is used in composing the distinctive feature curve (DFC) with object candidate evolution in a multiresolution segmentation procedure. The scale order of pixels is built up by calculating a series of conditional relative extrema of each curve based on the class separability measure. This is helpful in determining the various optimal scales for diverse ground‐objects in image segmentation and the potential meaningful image‐objects fitting the intrinsic scale of the dominant landscape objects. Finally, the feasibility is analysed on the assumption that the homogeneous regions obey a Gaussian distribution. Satisfactory results were obtained in applications to high‐resolution remote sensing imageries of anthropo‐directed areas.     

自适应多尺度融合遥感图像分割方法

针对遥感图像数据量大、地物对象与空间尺度密切相关的特点,提出一种自适应多尺度融合遥感图像分割方法。使用颜色方差作为距离度量,利用区域邻接图和最近邻区域图对遥感图像进行快速分割,建立阈值和尺度之间的函数关系,通过不同阈值得到多尺度分割结果,并采用融合方法获得最终结果。实验结果表明,与eCognition单尺度分割方法相比,该方法可消除遥感图像过分割或欠分割的现象。     

基于区域生长的多尺度遥感图像分割算法

图像分割是图像解译的关键一步,仅仅利用光谱信息的传统分割方法已不能有效地对高分辨遥感图像进行分割。鉴于高分辨率遥感图像提供了地物光谱、形状和纹理等大量信息,文章提出了一种基于区域生长结合多种特征的多尺度分割算法。首先利用图像梯度信息选取种子点;其次综合高分辨率遥感图像地物的局部光谱信息和全局形状信息作为区域生长的准则进行区域生长。迭代这两个过程,直到所有区域的平均面积大于设定的尺度面积参数则停止生长。该算法用VC实现,实验结果表明该算法能获得不同尺度下的分割结果且分割效率高、分割效果好。     

基于注意力机制的多尺度融合航拍影像语义分割

航拍影像同一场景不同对象尺度差异较大,采用单一尺度的分割往往无法达到最 佳的分类效果。为解决这一问题,提出一种基于注意力机制的多尺度融合模型。首先,利用不 同采样率的扩张卷积提取航拍影像的多个尺度特征;然后,在多尺度融合阶段引入注意力机制, 使模型能够自动聚焦于合适的尺度,并为所有尺度及每个位置像素分别赋予权重;最后,将加 权融合后的特征图上采样到原图大小,对航拍影像的每个像素进行语义标注。实验结果表明, 与传统的 FCN、DeepLab 语义分割模型及其他航拍影像分割模型相比,基于注意力机制的多尺 度融合模型不仅具有更高的分割精度,而且可以通过对各尺度特征对应权重图的可视化,分析 不同尺度及位置像素的重要性。     

Hierarchical image segmentation based on similarity of NDVI time series

Although a variety of hierarchical image segmentation procedures for remote sensing imagery have been published, none of them specifically integrates remote sensing time series in spatial or hierarchical segmentation concepts. However, this integration is important for the analysis of ecosystems which are hierarchical in nature, with different ecological processes occurring at different spatial and temporal scales. Therefore, the objective of this paper is to introduce a multi-temporal hierarchical image segmentation (MTHIS) methodology to generate a hierarchical set of segments based on spatial similarity of remote sensing time series. MTHIS employs the similarity of the fast Fourier transform (FFT) components of multi-seasonal time series to group pixels with similar temporal behavior into hierarchical segments at different scales. Use of the FFT allows the distinction between noise and vegetation related signals and increases the computational efficiency. The MTHIS methodology is demonstrated on the area of South Africa in an MTHIS protocol for Normalized Difference Vegetation Index (NDVI) time series. Firstly, the FFT components that express the major spatio-temporal variation in the NDVI time series, the average and annual term, are selected and the segmentation is performed based on these components. Secondly, the results are visualized by means of a boundary stability image that confirms the accuracy of the algorithm to spatially group pixels at different scale levels. Finally, the segmentation optimum is determined based on discrepancy measures which illustrate the correspondence of the applied MTHIS output with landcover-landuse maps describing the actual vegetation. In future research, MTHIS can be used to analyze the spatial and hierarchical structure of any type of remote sensing time series and their relation to ecosystem processes.     

Selection and Evaluation of the Optimal Scale in Multi-scale Segmentation of Remote Sensing Images

Multi-scale segmentation is the premise and key step of Object-Based Image Analysis (OBIA). The quality of multi-scale segmentation directly affects the accuracy of object-oriented classification. However, scale selection and evaluation remains a challenge in multi-scale segmentation. According to the fact that the optimal segmentation scale of the remote sensing image is closely related to the complexity of the objects of the image, a top-down method to select the optimal scale based on the complexity of segmented objects is proposed. In the top-down segmentation process, image features of each segmented object are extracted to construct the complexity function, and the optimal scale of each object is determined by setting a threshold value and iterating calculation. Then, the segmentation results with the best scale are obtained and applied to the ZY-3 satellite multispectral image and the GF-2 fusion image to obtain segmentation and classification results. Qualitative visual evaluation method, unsupervised evaluation method and supervised classification evaluation method were used to compare them with results obtained by the optimal single-scale segmentation and the unsupervised evaluation method. The experimental results show that the method can accurately obtain the scale matching with the ground targets, and improve segmentation effect and the classification accuracy, it is of practical value.     

遥感影像多尺度分割中最优尺度的选取及评价

多尺度分割是面向对象图像分析技术的前提和关键,多尺度分割的质量直接影响着面向对象分类的精度,但尺度选择仍然是多尺度分割中的一个难题。针对此问题,根据遥感影像的最优分割尺度与影像上目标复杂度密切相关的事实,提出了一种自上而下基于分割对象复杂度选取最优尺度的方法。该方法在分割过程中,提取每一对象的影像特征构建其复杂度函数,通过设置阈值,经迭代计算来确定每一对象的最优分割尺度,进而得到具有全局最优尺度的分割结果,并将其应用于ZY-3多光谱数据和GF-2融合影像,得到分割和分类结果。并将其与单一最优尺度和非监督评价法的分割及分类结果进行比较,结果表明：该方法能够获取与地面目标相匹配的分割尺度,改善了分割效果,提高了分类精度,具有一定实用价值。     

Mapping vegetation morphology types in a dry savanna ecosystem: integrating hierarchical object-based image analysis with Random Forest

Savanna ecosystems are geographically extensive and both ecologically and economically important, and require monitoring over large spatial extents. Remote-sensing-based characterization of vegetation properties in savannas is methodologically challenging, mainly due to high structural and functional heterogeneity. Recent advances in object-based image analysis (OBIA) and machine learning algorithms offer new opportunities to address these challenges. Focusing on the semi-arid savanna ecosystem in the central Kalahari, this study examined the suitability of a hierarchical OBIA approach combined with in situ data and an ensemble classification technique for mapping vegetation morphology types at landscape scale. A stack of Landsat TM imagery, NDVI, and topographic variables was segmented with six different scale factors resulting in a hierarchical network of image objects. Sample objects for each vegetation morphology class were selected at each segmentation scale and classification was performed using optimal features consisting of spectral and textural features. Overall and class-specific classification accuracies were compared across the six scales to examine the influence of segmentation scale on each. Results suggest that the highest overall classification accuracy (i.e. 85.59%) was observed not at the finest segmentation scale, but at coarse segmentation. Additionally, individual vegetation morphology classes differed in the segmentation scale at which they achieved highest classification accuracy, reflecting their unique ecology and physiognomic composition. While classes with high vegetation density/height attained higher accuracy at fine segmentation scale, those with lower vegetation density/height reached higher classification accuracy at coarse segmentation scales. Contrarily, for pans and bare areas, accuracy was relatively unaffected by changing segmentation scale. Variable importance plots suggested that spectral features were the most important, followed by textural variables. These results show the utility of the OBIA approach and emphasize the requirement of multi-scale analysis for accurately characterizing savanna systems.     

A multi-temporal masking classification method for vineyard monitoring in central Spain

Abstract

The objective of image segmentation in remote sensing is to define regions in an image that correspond to objects in the ground scene. Traditional scene models underlying image segmentation procedures have assumed that objects as manifest in images have internal variances that are both low and equal. This scene model is unrealistically simple. An alternative scene model recognizes different scales of objects in scenes. Each level in the hierarchy is nested, or composed of objects or categories of objects from the preceding level. Different objects may have distinct attributes, allowing for relaxation of assumptions like equal variance.

A multiple-pass, region-based segmentation algorithm improves the segmentation of images from scenes better modelled as a nested hierarchy. A multiple-pass approach allows slow and careful growth of regions while inter-region distances are below a global threshold. Past the global threshold, a minimum region size parameter forces development of regions in areas of high local variance. Maximum and viable region size parameters limit the development of undesirably large regions.

Application of the segmentation algorithm for forest stand delineation in Landsat TM imagery yields regions corresponding to identifiable features in the landscape. The use of a local variance, adaptive-window texture channel in conjunction with spectral bands improves the ability to define regions corresponding to sparsely-stocked forest stands which have high internal variance.     

一种形态学彩色图像多尺度分割算法

为了对彩色图像进行快速有效的分割，提出了一种用于分割彩色图像的多尺度形态学算法。该算法首先用基于张量梯度的彩色分水岭算法来得到初始分割结果，即局部水平集连通区域，并综合考虑了面积和色彩计算区域间的相似性，构造了区域间的RAG（region adjacency graph）和NNG（nearest neighbor nraph），用于后续形态学处理；接着，基于HSV空间中的色彩全序关系，定义了彩色形态算子；然后采用顶点塌缩算法实现的彩色形态学开闭算子生成了所需的非线性尺度空间；最后，利用图像中的极值点与物体间的对应关系，逐级提取图像中包含的物体来得到分层级的表示，并用区域在不同尺度下熵的变化来决定尺度树的构成，从而完成了彩色图像的分割。试验结果表明，该算法不仅具有出色的形状保持能力，而且可提高计算效率。     

改进U-Net的高分辨率遥感图像轻量化分割

针对传统图像分割方法分割效率低下,遥感图像特征复杂多样,复杂场景下分割性能受到限制等问题,在基于U-Net网络架构的基础上,提出一种能够较好提取遥感图像特征并兼顾效率的改进U-Net模型.首先,以EfficientNetV2作为U-Net的编码网络,增强特征提取能力,提高训练和推理效率,然后在解码部分使用卷积结构重参数化方法并结合通道注意力机制,几乎不增加推理时间的前提下提升网络性能,最后结合多尺度卷积融合模块,提高网络对不同尺度目标的特征提取能力和更好地结合上下文信息.实验表明,改进的网络在遥感图像分割性能提升的同时分割效率也提高.     

多模态特征融合的遥感图像语义分割网络

遥感图像语义分割是指通过对遥感图像上每个像素分配语义标签并标注,从而形成分割图的过程,在国土资源规划、智慧城市等领域有着广泛的应用。高分辨率遥感图像存在目标大小尺度不一与阴影遮挡等问题,单一模态下对相似地物和阴影遮挡地物分割较为困难。针对上述问题,提出了将IRRG（infrared、red、green）图像与DSM（digital surface model）图像融合的遥感图像语义分割网络MMFNet。网络采用编码器-解码器的结构,编码层采用双输入流的方式同时提取IRRG图像的光谱特征和DSM图像的高度特征。解码器使用残差解码块（residual decoding block,RDB）提取融合后的特征,并使用密集连接的方式加强特征的传播和复用。提出复合空洞空间金字塔（complex atrous spatial pyramid pooling,CASPP）模块提取跳跃连接的多尺度特征。在国际摄影测量与遥感学会（international society for photogrammetry and remote sensing,ISPRS）提供的Vaihingen和Potsdam数据集上进行了实验,MMFNet分别取得了90.44%和90.70%的全局精确度,相比较与DeepLabV3+、OCRNet等通用分割网络和CEVO、UFMG_4等同数据集专用分割网络具有更高的分割精确度。     

基于面向对象的青海湖环湖区居民地信息自动化提取

居民地的空间格局和密度直接反映着区域人类活动的强弱程度,影响着区域人地系统演变和生态环境可持续发展。基于高分辨率卫星遥感影像数据,提出了一种面向对象的青海湖环湖区居民地信息自动化提取方法。首先,利用尺度集理论对高分辨率卫星遥感影像进行多尺度分割,获取不同尺度的分割对象;其次,通过机器学习算法集对分割对象的自定义特征、光谱特征、几何特征和纹理特征进行训练,选取最优自动分类算法;最后,利用最优自动分类算法提取青海湖环湖区城镇居民地和农村居民地信息。采用平均召回率、平均准确率和平均F值评价指标对分类结果进行精度评价,其中,城镇居民地各评价指标均在93%以上,农村居民地各评价指标均在86%以上。结果表明:该方法提取城镇居民地和农村居民地总体精度较高,在大面积人类活动精细化监测中具有较好的科学意义和应用价值。     

面向对象的遥感影像最优分割尺度评价

遥感影像分割决定了后续分类的精度,鉴于目前分割技术评价的研究缺乏且局限于主观判断的现状,以定量方法确定最优分割尺度。利用Definiens平台面向对象的分割算法,将组成对象的像素灰度值的标准差作为衡量对象内同质性的标准,用与邻域的平均差分的绝对值作为对象间的异质性度量变量,同时考虑面积权重的影响;根据上述3个评价指标,在考虑多光谱影像的基础上,构造了平均分割评价指数;基于该评价指数,以优度实验法对QuickBird多光谱影像进行了研究,并确定了不同地物类型的最优分割尺度。最后,利用平均对象匹配指数对评价结果进行了验证,并对评价方法的可行性进行了探讨。     

Multi-scale,object-based image analysis for mapping geomorphic and ecological zones on coral reefs

Providing accurate maps of coral reefs where the spatial scale and labels of the mapped features correspond to map units appropriate for examining biological and geomorphic structures and processes is a major challenge for remote sensing. The objective of this work is to assess the accuracy and relevance of the process used to derive geomorphic zone and benthic community zone maps for three western Pacific coral reefs produced from multi-scale, object-based image analysis (OBIA) of high-spatial-resolution multi-spectral images, guided by field survey data. Three Quickbird-2 multi-spectral data sets from reefs in Australia, Palau and Fiji and georeferenced field photographs were used in a multi-scale segmentation and object-based image classification to map geomorphic zones and benthic community zones. A per-pixel approach was also tested for mapping benthic community zones. Validation of the maps and comparison to past approaches indicated the multi-scale OBIA process enabled field data, operator field experience and a conceptual hierarchical model of the coral reef environment to be linked to provide output maps at geomorphic zone and benthic community scales on coral reefs. The OBIA mapping accuracies were comparable with previously published work using other methods; however, the classes mapped were matched to a predetermined set of features on the reef.     

高分辨率遥感影像的多特征多核ELM分类方法

针对高分辨率遥感影像地物分布复杂多变,利用ELM的快速分类性能,提出了一种ELM的多特征多核高分辨率遥感影像分类方法。首先利用多尺度分割算法将原始影像粗分为若干地物区域;然后依据区域合并准则对粗分割图像合并得到典型地物特征的对象信息,并提取分割对象的光谱特征与空间特征;最后以多种核函数加权组合的方式构建多核ELM对影像分类,获得最终的分类结果。实验结果表明,所提方法不仅降低了对目标训练样本的要求,同时还提高了分类的准确性、及时性和完整性。     

基于对象的最优尺度建筑物信息提取方法

针对基于像素分析方法不适用于高分辨率影像信息提取的问题,提出一种基于对象的图像分析方法来进行城市建筑信息提取。采用多分辨率图像分割方法得到图像对象,提出非监督的最优尺度判定方法解决单尺度分割造成的欠分割和过分割问题。在对象分类提取过程中,结合LiDAR数据的地形表面高程信息和光谱信息对建筑物进行提取,并利用尺寸、空间位置等信息进行误分类修正。实验区域共提取出18个建筑目标,结果表明所提出的方法有效可行。     

Multi-scale superpixel spectral–spatial classification of hyperspectral images

A novel multi-scale superpixel-based spectral–spatial classification (MS-SSC) approach is proposed for hyperspectral images in this study. Superpixels are considered as the basic processing units for spectral–spatial-based classification. The use of multiple scales allows the capturing of local spatial structures of various sizes. The proposed technique consists of three steps. In the first step, hierarchical superpixel segmentations are performed from fine to coarse scales for the original hyperspectral image and the spectral information of each superpixel is used for classification at each scale. In the second step, each single scale superpixel-based classification is improved by combining with the segmentations at a higher level. Finally, the multi-scale classification is achieved via decision fusion. Experimental results are presented for two hyperspectral images and compared with recently advanced pixel-wise and pixel-based spectral–spatial classification approaches. The experiments demonstrate that the proposed method works effectively on the homogeneous regions and is also able to preserve the small local spatial structures in the image.     

From global image annotation to interactive object segmentation

This paper presents a graphical environment for the annotation of still images that works both at the global and local scales. At the global scale, each image can be tagged with positive, negative and neutral labels referred to a semantic class from an ontology. These annotations can be used to train and evaluate an image classifier. A finer annotation at a local scale is also available for interactive segmentation of objects. This process is formulated as a selection of regions from a precomputed hierarchical partition called Binary Partition Tree. Three different semi-supervised methods have been presented and evaluated: bounding boxes, scribbles and hierarchical navigation. The implemented Java source code is published under a free software license.