基于PCA与HIS模型的高分辨率遥感影像阴影检测研究

根据高分辨率遥感影像阴影区域的性质,基于主成分变换和HIS模型,提出一种检测阴影的阴影指数SI(Shadow Index)。选取两个试验区,分别采用Polidorio算法、归一化阴影指数(NDUI)和SI进行阴影检测和比较分析,结果表明SI能够有效地区分阴影区域与水体和偏蓝色地物。提取3种算法的直方图得出,SI图像的直方图具有两个波峰一个波谷形状,能够更好地采用直方图阈值法分割阴影区和非阴影区。实验表明该方法简单有效。     

Corresponding regions for shadow restoration in satellite high-resolution images

ABSTRACT

High spatial resolution images available by satellites such as Ikonos, Quickbird, and WorldView-2 provide more information for remote sensing applications, such as object detection, classification, change detection, and object mapping. The presence of shadow reduces the amount of information that can be extracted and consequently makes these applications more difficult or even impossible. In this article, a shadow restoration approach for high-resolution satellite images is proposed. The approach detects the shadow area and segments the image into regions according to the land surface type. Then, shadow restoration is carried out for each region based on the degree of correspondence between shadow and neighbouring non-shadow regions. The proposed approach is applied to study areas from Ikonos and WorldView-2 satellite images. A comparison to the standard approaches for shadow restoration is performed, and an accuracy assessment is carried out by visual inspection and land-cover classification. The results show that the enhanced shadow regions using the proposed approach have better appearances and are highly compatible with their surrounding non-shadow regions. In addition, the overall accuracy is higher than those of the standard approaches.     

城市航空影像的阴影检测和阴影消除方法研究

阴影是城市航空遥感影像的基本特征之一,阴影的存在影响地物边缘的提取、建筑物的识别和影像的配准等,因此,阴影检测和阴影消除在城市遥感中具有重要意义。本文主要介绍了一种高分辨率城市航空影像的阴影检测和阴影消除方法,在阴影检测过程中,分别对影像RGB色彩空间中的G通道和HIS色彩空间中的亮度通道进行阈值选择检测出阴影区域,然后对这两种阴影检测结果进行与运算得到最终的阴影区域并标记出来。对所标记的阴影区域,根据Retinex理论选择合适的尺度对其进行增强处理,由于阴影区域的地物信息进行增强时阴影边界也有所增强,因此需要对阴影边界进行模糊化处理。试验表明,该方法能较好的检测出阴影区域,而且对阴影区域的地物恢复效果较好。     

结合多尺度分割和形态学运算的高分辨率遥感影像阴影检测

目的 针对阴影在高分辨率遥感影像的特性,提出了一种多尺度分割和形态学运算相结合的阴影检测方法。方法 基于面向对象思想,首先利用均值漂移法实现影像分割生成对象,并以对象为基本单元分别进行形态学膨胀和腐蚀运算,从而获得面向对象的阴影指数;然后对影像进行多尺度分割,生成阴影指数矢量;最后对阴影指数矢量和亮度均值分别指定高低阈值,进而获得阴影检测结果。结果 选取高分二号和Google earth影像进行实验,采用误检率、漏检率和总错误率3个指标进行定量分析,并将实验结果与结合多特征法和形态学阴影指数法进行比较。在阴影检测定量精度分析中,相比于对比方法,本文方法的误检率偏高,但漏检率平均降低了7.31%;在建筑物阴影检测实验中,本文方法的漏检率同样下降了4.5个百分点;在多尺度效果融合分析中,本文方法在多组尺度组合下,各项精度指标均较理想;在阴影压盖地物实验中,3种方法的误检情况差异不大,但本文方法的漏检率得到较大改善,其下降程度平均达到了19.29%。结论 本文提出的阴影检测方法具备一定的抗干扰能力,适用性强,可靠性高。     

基于GF-2遥感影像的一种快速水体信息提取方法

在高分辨率遥感影像中,水体与阴影(尤其是高大建筑物阴影)、暗色地物不易区 分。针对 GF-2 遥感影像的光谱特性的大量实验研究,提出了一种新综合水体指数法(NCWI)来 增强水体区域信息;同时利用改进的 OSTU 结合鸡群算法(CSO)快速自适应地确定最佳分割阈 值,进而得到最终的水体区域。将其同归一化 NDWI、改进谱间关系法、主成分分析综合法等 常见水体信息提取方法应用于 GF-2 遥感影像水体信息提取,利用采用实地采样和人工解译的 混淆矩阵对提取的水体区域结果进行精度验证和对比分析,从而验证了其有效性和高效性。4 个实验区域的结果证明,该算法可以快速有效地提取水体信息,精确度分别达到 97.82%, 97.44%,92.13%,96.94%。     

An automatic shadow detection method for high-resolution remote sensing imagery based on polynomial fitting

Most existing shadow detection models and algorithms require extensive calculations and have difficulties effectively removing features, such as water bodies, some dark objects and bluish ground objects. In this paper, we propose a high-resolution automatic shadow extraction algorithm based on the process of histogram fitting. First, the histogram of the whole image is fitted by fourth and fifth-degree polynomials according to the histogram difference of the near-infrared bands of different shadow areas in the remotely sensed image. Second, the shadow area is preliminarily extracted based on the relationships between the shadow features of the remote sensing image and the intersections of the fourth- and fifth-degree polynomials. Then, the normalized difference water index (NDWI) is applied to extract the water bodies. Finally, to obtain the shaded area, the scanning line seed filling algorithm is applied to remove the water bodies falsely detected as shadows in the preliminary shading extraction. The proposed algorithm is evaluated by using the various high-resolution images including GaoFen-1 (GF-1), GaoFen-2 (GF-2), QuickBird2, and ZiYuan-3 (ZY-3), as well as an elaborate comparison to histogram threshold segmentation algorithms such as Component 3 (C3) algorithm, multi-elements extraction algorithm multi-band detection algorithm, and spectral correlation algorithm based on spectral features. The results of experiment showed that the proposed algorithm could extract the shadows of various images, achieve satisfied results, and completely remove water bodies.     

基于阴影概率模型的遥感影像阴影检测方法

阴影区像素光谱响应的不一致性使得依据阈值获取的阴影检测结果与真实情况出入较大。针对这一问题,结合不透明度和亮度两种信息设计了一个全新的阴影概率模型。在此基础上,针对邻域像素信息未能充分利用的问题,提出了一个基于多尺度马尔可夫随机场(MRF)的遥感影像检测方法。首先,用所提出的模型描述多尺度影像中像素的阴影概率;然后,使用Potts模型建模多尺度标记场,同时兼顾尺度内和尺度间的邻域像素的交互关系;最后,基于最大后验(MAP)概率准则获取最终阴影检测结果。通过与色调亮度比值方法、差分双阈值方法、主成分分析法和支持向量机分类方法的对比实验证明,所提出的方法能够提高高分辨率城区遥感影像的阴影检测精度。     

集成特征分量的高分二号影像阴影检测

针对高分辨率遥感影像中阴影检测精度易受水体、植被等因素干扰的问题，通过分析高分二号影像中典型地物的光谱特征，构建了一种集成特征分量与面向对象分类相结合的阴影检测方法。构建的特征分量包括：主成分第一分量PC1、亮度分量I、归一化差分植被指数NDVI及水体指数WI。将各特征分量进行归一化处理，建立包含波段均值、标准差等特征的规则集，对影像的I和PC1分量进行多尺度分割 ，结合面向对象的方法进行阴影检测。选取不同区域遥感影像进行实验，实验结果表明:与传统基于像素的阴影提取方法相比，该方法提取出的阴影斑块完整，且能有效地减弱水体和植被的影响。     

集成特征分量的高分二号影像阴影检测

针对高分辨率遥感影像中阴影检测精度易受水体、植被等因素干扰的问题,通过分析高分二号影像中典型地物的光谱特征,构建了一种集成特征分量与面向对象分类相结合的阴影检测方法。构建的特征分量包括：主成分第一分量PC1、亮度分量I、归一化差分植被指数NDVI及水体指数WI。将各特征分量进行归一化处理,建立包含波段均值、标准差等特征的规则集,对影像的I和PC1分量进行多尺度分割 ,结合面向对象的方法进行阴影检测。选取不同区域遥感影像进行实验,实验结果表明:与传统基于像素的阴影提取方法相比,该方法提取出的阴影斑块完整,且能有效地减弱水体和植被的影响。     

基于波谱角和掩膜的卫星影像阴影去除研究

详细分析了卫星影像的阴影来源,以遮挡物类型和传感器探测特点为依据对阴影进行了分类和研究。分析了波谱角法检测阴影的技术特点和操作方式,研究了掩膜技术提取阴影的方法,并提出采用分波段线性扩展和滤波的手段去除阴影。通过ETM数据的试验分析,验证了波谱角和掩膜技术可以在去除陆地卫星影像阴影中发挥重要作用。     

Phase correlation pixel‐to‐pixel image co‐registration based on optical flow and median shift propagation

With singular value decomposition (SVD) and robust 2‐dimensional fitting phase correlation algorithms, it is possible to achieve pixel‐to‐pixel image co‐registration at sub‐pixel accuracy via local feature matching. However, the method often fails in featureless and low correlation areas making it not robust for co‐registration of images with considerable spectral differences and large featureless ground objects. A median shift propagation (MSP) technique is proposed to eliminate the problem, in a phase correlation and Normalized Cross‐Correlation (NCC) combined approach. The experiment results using images from different sensor platforms and spectral bands indicate that the new method is very robust to featureless and low correlation areas and can achieve very accurate pixel‐to‐pixel image co‐registration with good tolerance of spectral and spatial differences between images. The method will significantly improve change detection in various remote sensing applications.     

Automated cloud and shadow detection and filling using two-date Landsat imagery in the USA

A simple, efficient, and practical approach for detecting cloud and shadow areas in satellite imagery and restoring them with clean pixel values has been developed. Cloud and shadow areas are detected using spectral information from the blue, shortwave infrared, and thermal infrared bands of Landsat Thematic Mapper or Enhanced Thematic Mapper Plus imagery from two dates (a target image and a reference image). These detected cloud and shadow areas are further refined using an integration process and a false shadow removal process according to the geometric relationship between cloud and shadow. Cloud and shadow filling is based on the concept of the Spectral Similarity Group (SSG), which uses the reference image to find similar alternative pixels in the target image to serve as replacement values for restored areas. Pixels are considered to belong to one SSG if the pixel values from Landsat bands 3, 4, and 5 in the reference image are within the same spectral ranges. This new approach was applied to five Landsat path/rows across different landscapes and seasons with various types of cloud patterns. Results show that almost all of the clouds were captured with minimal commission errors, and shadows were detected reasonably well. Among five test scenes, the lowest producer's accuracy of cloud detection was 93.9% and the lowest user's accuracy was 89%. The overall cloud and shadow detection accuracy ranged from 83.6% to 99.3%. The pixel-filling approach resulted in a new cloud-free image that appears seamless and spatially continuous despite differences in phenology between the target and reference images. Our methods offer a straightforward and robust approach for preparing images for the new 2011 National Land Cover Database production.     

改进卷积网络的高分遥感图像城镇建成区提取

目的 城镇建成区是城镇研究重要的基础信息,也是实施区域规划、落实城镇功能空间布局的前提。但是遥感影像中城镇建成区的环境复杂,同时不同城镇建成区在坐落位置、发展规模等方面存在许多差异,导致其信息提取存在一定困难。方法 本文基于面向图像语义分割的深度卷积神经网络,使用针对特征图的强化模块和通道域的注意力模块,对原始DeepLab网络进行改进,并通过滑动窗口预测、全连接条件随机场处理方法,更准确地实现城镇建成区提取。同时,针对使用深度学习算法容易出现过拟合和鲁棒性不强的问题,采用数据扩充增强技术进一步提升模型能力。结果 实验数据是三亚和海口部分地区的高分二号遥感影像。结果表明,本文方法的正确率高于93%,Kappa系数大于0.837,可以有效地提取出大尺度高分辨率遥感影像中的城镇建成区,且提取结果最为接近实际情况。结论 针对高分辨率遥感卫星影像中城镇建成区的光谱信息多样化、纹理结构复杂化等特点,本文算法能在特征提取网络中获取更多特征信息。本文使用改进的深度学习方法,提出两种处理方法,显著提高了模型的精度,在实际大幅遥感影像的使用中表现优秀,具有重要的实用价值和广阔的应用前景。     

多特征融合的高分辨率遥感影像建筑物分级提取

目的 针对高分辨率遥感影像普遍存在的同谱异物和同物异谱问题,提出一种综合利用光谱、形状、空间上下文和纹理特征的建筑物分级提取方法。方法 该方法基于单幅高分辨率遥感影像,首先利用多尺度多方向梯度算子构造的建筑物指数和形状特征提取部分分割完整的矩形建筑物目标;然后由多方向线性结构元素和形态学膨胀运算确定投票矩阵,从而获取光照方向,并利用光照方向和阴影特征对已提取建筑物进行筛选,剔除非建筑物对象,完成建筑物初提取;最后借助初提取建筑物对象的纹理特征向量建立概率模型,取得像素级建筑物提取结果,将该结果与影像分割相结合实现建筑物提取。结果 选取两幅高分辨率遥感影像进行实验,在建筑物初提取实验中,将本文方法与邻域总变分法和Sobel算子进行对比,实验结果表明,本文方法适用性强,为后提取提供的建筑物样本可靠性更高。在建筑物提取实验中,采用查准率、查全率和F₁分数3个指标进行定量分析,与形态学建筑物指数结合形态学阴影指数算法、邻域总变分结合混合高斯模型和贝叶斯判决算法相比,各项精度指标均得到显著提升,其中查准率提高了2.90个百分点,查全率提高了12.49个百分点,F₁分数则提升了8.84。结论 本文提出的建筑物分级提取方法具备一定抗干扰能力,且提取准确性高,适用性强。     

多模态特征融合的遥感图像语义分割网络

遥感图像语义分割是指通过对遥感图像上每个像素分配语义标签并标注,从而形成分割图的过程,在国土资源规划、智慧城市等领域有着广泛的应用。高分辨率遥感图像存在目标大小尺度不一与阴影遮挡等问题,单一模态下对相似地物和阴影遮挡地物分割较为困难。针对上述问题,提出了将IRRG（infrared、red、green）图像与DSM（digital surface model）图像融合的遥感图像语义分割网络MMFNet。网络采用编码器-解码器的结构,编码层采用双输入流的方式同时提取IRRG图像的光谱特征和DSM图像的高度特征。解码器使用残差解码块（residual decoding block,RDB）提取融合后的特征,并使用密集连接的方式加强特征的传播和复用。提出复合空洞空间金字塔（complex atrous spatial pyramid pooling,CASPP）模块提取跳跃连接的多尺度特征。在国际摄影测量与遥感学会（international society for photogrammetry and remote sensing,ISPRS）提供的Vaihingen和Potsdam数据集上进行了实验,MMFNet分别取得了90.44%和90.70%的全局精确度,相比较与DeepLabV3+、OCRNet等通用分割网络和CEVO、UFMG_4等同数据集专用分割网络具有更高的分割精确度。     

结合多种特征的高分辨率遥感影像阴影检测

针对现有的阴影检测算法对较亮阴影和较暗地物中的阴影不能同时较好地检测等问题, 提出一种结合多种特征的高分辨率遥感影像阴影检测方法.该算法首先结合主成分分析、颜色特征和直方图的分割构建多种阈值检测条件, 然后综合多种特征来进行遥感影像阴影的初步检测, 最后通过分析RGB模型在阴影与非阴影地物上的差别, 利用颜色特性最终检测出阴影区域.实验结果表明, 本文算法能有效检测较亮阴影和较暗地物中的阴影.与现有方法相比, 较亮阴影的平均总错误率从水平集法的31.85%降至24.61%, 较暗地物中阴影的平均总错误率从自动检测法的37.75%降至23.30%.     

Building Height Estimation from GF-2 Image based on Morphological Shadow Index

GF-2 is a high resolution earth observing satellite with sub\|meter resolution which is developed by our own technique.To estimate urban building height based on GF\|2 remote sensing image combined with the idea of mathematical morphology and object\|oriented classification.First of all,segment image based on multi\|scale segmentation.Then extract shadow and calculate its length based on object\|oriented classification combined with spectral,shape,Morphological Shadow Index (MSI) and other features.In the end,estimate building height based on the geometrical model of satellite,sun and building and then accuracy evaluation and error analysis are carried out by using the field measurement data.Experimental results showed that 90% of the buildings’ absolute error is less than 1 m.This experiment demonstrate that the method can extract the height of urban building from the GF\|2 image effectively and the immense potential of domestic high resolution remote sensing image in applications on urban building information extraction.     

多尺度分形维的星载舰船显著性检测

目的 星上的舰船检测需要在资源和时间受限条件下实现快速检测,并且对目标的种类和尺寸缺少先验信息的指导,更多时候还需要实现一景图像中不同尺寸舰船的检测,因此,星上舰船检测要求检测方法具有一定的自适应性,从而实现星上多变的检测场景。方法 针对这一问题,提出了一种多尺度分形维的检测方法,可以实现一景遥感图像中不同尺寸舰船目标的检测。首先,针对差分盒算法受盒子尺寸约束的限制使分形维数的计算精度受到影响的问题提出了一种改进算法,改进算法增加了拟合直线的点对数目并引入了拟合误差剔除误差点对,提高了分形维特征计算的精确度。结果 在提高了分形维计算精度的基础上,新算法利用自然物体在不同尺度上具有的自相似性,通过多尺度分形维的计算并借鉴视觉显著性中c-s算子来排除背景对目标的干扰,突出舰船目标。实验结果表明,新算法能够有效检测出一景图像中不同尺寸的舰船,优于双参数CFAR算法的检测结果。结论 本文提出的多尺度分形维的检测算法可以实现对一景图像中不同尺寸舰船目标的检测,在保证一定检测率的同时有效降低了目标检测的虚警率。     

注意力机制改进卷积神经网络的遥感图像目标检测

目的 遥感图像目标检测是遥感图像处理的核心问题之一,旨在定位并识别遥感图像中的感兴趣目标。为解决遥感图像目标检测精度较低的问题,在公开的NWPU_VHR-10数据集上进行实验,对数据集中的低质量图像用增强深度超分辨率（EDSR）网络进行超分辨率重构,为训练卷积神经网络提供高质量数据集。方法 对原Faster-RCNN （region convolutional neural network）网络进行改进,在特征提取网络中加入注意力机制模块获取更多需要关注目标的信息,抑制其他无用信息,以适应遥感图像视野范围大导致的背景复杂和小目标问题;并使用弱化的非极大值抑制来适应遥感图像目标旋转;提出利用目标分布之间的互相关对冗余候选框进一步筛选,降低虚警率,以进一步提高检测器性能。结果 为证明本文方法的有效性,进行了两组对比实验,第1组为本文所提各模块间的消融实验,结果表明改进后算法比原始Faster-RCNN的检测结果高了12.2%,证明了本文所提各模块的有效性。第2组为本文方法与其他现有方法在NWPU_VHR-10数据集上的对比分析,本文算法平均检测精度达到79.1%,高于其他对比算法。结论 本文使用EDSR对图像进行超分辨处理,并改进Faster-RCNN,提高了算法对遥感图像目标检测中背景复杂、小目标、物体旋转等情况的适应能力,实验结果表明本文算法的平均检测精度得到了提高。     

Review Article Principles of field spectroscopy

Abstract

Field spectroscopy involves the study of the interrelationships between the spectral characteristics of objects and their biophysical attributes in the field environment. It is a technique of fundamental importance in remote sensing, yet its full potential is rarely exploited. In this article the principles of the subject are explained and its historical development reviewed with reference to the instruments and methods adopted. Field spectroscopy has a role to play in at least three areas of remote sensing. Firstly, it acts as a ridge between laboratory measurements of spectral reflectance and the field situation and is thus useful in the calibration of airborne and satellite sensors. Secondly, it is useful in predicting the optimum spectral bands, viewing configuration and time to perform a particular remote sensing task. Thirdly, it provides a tool for the development, refinement and testing of models relating biophysical attributes to remotely-sensed data.