Complexity-aware algorithm architecture for real-time enhancement of local anomalies in hyperspectral images

Anomaly detection (AD) from remotely sensed multi-hyperspectral images is a powerful tool in many applications, such as strategic surveillance and search and rescue operations. In a typical operational scenario, an airborne hyperspectral sensor searches a wide area to identify regions that may contain potential targets. These regions typically cue higher spatial-resolution sensors to provide target recognition and identification. While this procedure is mostly automated, an on-board operator is generally assigned to examine in real time the AD output and select the regions of interest to be sent for cueing. Real-time enhancement of local anomalies in images of the over flown scene can be presented to the operator to facilitate the decision-making process. Within this framework, one of the ultimate research interests is undoubtedly the design of complexity-aware AD algorithm architectures capable of assuring real-time or nearly real-time in-flight processing and prompt decision making. Among the different AD algorithms developed, this work focuses on those AD algorithms aimed at detecting small rare objects that are anomalous with respect to their local background. One of such algorithms, called RX algorithm, is based on a local Gaussian assumption for background and locally estimates its parameters from each pixel local neighborhood. RX has been recognized to be the benchmark AD algorithm for detecting local anomalies in multi-hyperspectral images. RX decision rule has been employed to develop computationally efficient algorithms tested in real-time operating systems. These algorithms rely upon a recursive block-based parameter estimation procedure that makes their processing and, in turn, their detection performance differ from those of original RX. In this paper, a complexity-aware algorithm architecture fully adaptable to real-time processing is presented that allows the computational load to be reduced with respect to original RX, while strictly following its original formulation and thus assuring the same detection performance. An experimental study is presented that analyzes in detail the complexity reduction, in terms of number of elementary operations, offered by the proposed architecture with respect to original RX. A real hyperspectral image of a scene with deployed targets has been employed to perform a case-study analysis of the complexity reduction to be experienced in different operational scenarios. The real data are also adopted to illustrate a possible strategy for on-board line-by-line enhanced visualization of anomalies for decision support.     

结合孪生网络和像素配对的高光谱图像异常检测

目的 高光谱遥感中,通常利用像素的光谱特征来区分背景地物和异常目标,即通过二者之间的光谱差异来寻找图像中的异常像元。但传统的异常检测算法并未有效挖掘光谱的深层特征,高光谱图像中丰富的光谱信息没有被充分利用。针对这一问题,本文提出结合孪生神经网络和像素配对策略的高光谱图像异常检测方法,利用深度学习技术提取高光谱图像的深层非线性特征,提高异常检测精度。方法 采用像素配对的思想构建训练样本,与原始数据集相比,配对得到的新数据集数量呈指数增长,从而满足深度网络对数据集数量的需求。搭建含有特征提取模块和特征处理模块的孪生网络模型,其中,特征处理模块中的卷积层可以专注于提取像素对之间的差异特征,随后利用新的训练像素对数据集进行训练,并将训练好的分类模型固定参数,迁移至检测过程。用滑动双窗口策略对测试集进行配对处理,将测试像素对数据集送入网络模型,得到每个像素相较于周围背景像素的差异性分数,从而识别测试场景中的异常地物。结果 在异常检测的实验结果中,本文提出的孪生网络模型在San Diego数据集的两幅场景和ABU-Airport数据集的一幅场景上,得到的AUC （area under the curve）值分别为0.993 51、0.981 21和0.984 38,在3个测试集上的表现较传统方法和基于卷积神经网络的异常检测算法具有明显优势。结论 本文方法可以提取输入像素对的深层光谱特征,并根据其特征的差异性,让网络学习到二者的区分度,从而更好地赋予待测像素相对于周围背景的异常分数。本文方法相对于卷积神经网络的异常检测方法可以有效地降低虚警,与传统方法相比能够更加明显地突出异常目标,提高了检测率,同时也具有较强的鲁棒性。     

Random selection-based adaptive saliency-weighted RXD anomaly detection for hyperspectral imagery

With recent advances in hyperspectral imaging sensors, subtle and concealed targets that cannot be detected by multispectral imagery can be identified. The most widely used anomaly detection method is based on the Reed–Xiaoli (RX) algorithm. This unsupervised technique is preferable to supervised methods because it requires no a priori information for target detection. However, two major problems limit the performance of the RX detector (RXD). First, the background covariance matrix cannot be properly modelled because the complex background contains anomalous pixels and the images contain noise. Second, most RX-like methods use spectral information provided by data samples but ignore the spatial information of local pixels. Based on this observation, this article extends the concept of the weighted RX to develop a new approach called an adaptive saliency-weighted RXD (ASW-RXD) approach that integrates spectral and spatial image information into an RXD to improve anomaly detection performance at the pixel level. We recast the background covariance matrix and the mean vector of the RX function by multiplying them by a joint weight that in fuses spectral and local spatial information into each pixel. To better estimate the purity of the background, pixels are randomly selected from the image to represent background statistics. Experiments on two hyperspectral images showed that the proposed random selection-based ASW RXD (RSASW-RXD) approach can detect anomalies of various sizes, ranging from a few pixels to the sub-pixel level. It also yielded good performance compared with other benchmark methods.     

改进协同表示的高光谱图像异常检测算法

针对协同表示的高光谱图像异常检测算法中双窗口中心为异常像元同时背景字典存在同种异常像元的情况,中心像元的输出较小难以与背景区分的问题,提出一种改进协同表示的高光谱图像异常检测算法。为了减小背景字典中异常像元的权重,使用背景字典原子与均值的距离调整原子的权重,从而增大上述情况下中心像元的输出。实验结果表明,提出的算法在不同双窗口下都取得了较好的检测效果,验证了算法的有效性。     

基于最小噪声分离变换的高光谱异常检测方法研究

RX算法和核RX算法能很好地分离目标和背景,是较为广泛使用的异常检测算法,但是高光谱图像数据量大且存在冗余信息和噪声,直接进行RX及核RX异常探测运算量大且容易受噪声影响.针对此问题,提出一种基于最小噪声分离变换的高光谱图像异常检测方法,首先采用残差分析法估计噪声协方差矩阵以改进最小噪声分离变换,然后利用改进后的最小噪声分离变换来有效地降低高光谱图像数据的维数并分离出噪声,最后对低维降噪后的数据进行RX及核RX异常检测,避免了随机噪声对RX及核RX异常检测结果的影响并提高了异常检测率.对真实的AVIRIS数据测试表明,该算法优于传统的相应的RX、核RX异常检测算法.     

一种利用均值匹配改进的高光谱异常检测方法

传统高光谱异常检测算法由于背景信息估计不准确等原因普遍存在高虚警率的问题,针对这一现象,提出了一种利用图像均值进行匹配改进的高光谱异常目标检测后验处理方法。首先采用传统的高光谱异常检测算法将待检测高光谱图像划分为背景与异常目标潜在区域,之后通过对待测图像求解均值,将其与异常目标潜在区域像元进行相似性匹配计算,剔除大范围误检像元,得到最终检测结果。该方法在传统异常目标检测算法基础上进行相似度量剔除大范围虚警像元,在提高原算法探测能力的同时有效地降低虚警率。实验表明,该方法可以有效降低虚警率,提高原算法对于亚像元异常目标的检测能力,且对于不同算法、不同数据具有普适性。     

Fast anomaly detection in hyperspectral images with RX method on heterogeneous clusters

Remotely sensed hyperspectral sensors provide image data containing rich information in both the spatial and the spectral domain, and this information can be used to address detection tasks in many applications. One of the most widely used and successful algorithms for anomaly detection in hyperspectral images is the RX algorithm. Despite its wide acceptance and high computational complexity when applied to real hyperspectral scenes, few approaches have been developed for parallel implementation of this algorithm. In this paper, we evaluate the suitability of using a hybrid parallel implementation with a high-dimensional hyperspectral scene. A general strategy to automatically map parallel hybrid anomaly detection algorithms for hyperspectral image analysis has been developed. Parallel RX has been tested on an heterogeneous cluster using this routine. The considered approach is quantitatively evaluated using hyperspectral data collected by the NASA’s Airborne Visible Infra-Red Imaging Spectrometer system over the World Trade Center in New York, 5 days after the terrorist attacks. The numerical effectiveness of the algorithms is evaluated by means of their capacity to automatically detect the thermal hot spot of fires (anomalies). The speedups achieved show that a cluster of multi-core nodes can highly accelerate the RX algorithm.     

Real-time anomaly detection in hyperspectral images using multivariate normal mixture models and GPU processing

Hyperspectral imaging, which records a detailed spectrum of light arriving in each pixel, has many potential uses in remote sensing as well as other application areas. Practical applications will typically require real-time processing of large data volumes recorded by a hyperspectral imager. This paper investigates the use of graphics processing units (GPU) for such real-time processing. In particular, the paper studies a hyperspectral anomaly detection algorithm based on normal mixture modelling of the background spectral distribution, a computationally demanding task relevant to military target detection and numerous other applications. The algorithm parts are analysed with respect to complexity and potential for parallellization. The computationally dominating parts are implemented on an Nvidia GeForce 8800 GPU using the Compute Unified Device Architecture programming interface. GPU computing performance is compared to a multi-core central processing unit implementation. Overall, the GPU implementation runs significantly faster, particularly for highly data-parallelizable and arithmetically intensive algorithm parts. For the parts related to covariance computation, the speed gain is less pronounced, probably due to a smaller ratio of arithmetic to memory access. Detection results on an actual data set demonstrate that the total speedup provided by the GPU is sufficient to enable real-time anomaly detection with normal mixture models even for an airborne hyperspectral imager with high spatial and spectral resolution.     

空域协同自编码器的高光谱异常检测

目的 自编码器作为一种无监督的特征提取算法,可以在无标签的条件下学习到样本的高阶、稠密特征。然而当训练集含噪声或异常时,会迫使自编码器学习这些异常样本的特征,导致性能下降。同时,自编码器应用于高光谱图像处理时,往往会忽略掉空域信息,进一步限制了自编码器的探测性能。针对上述问题,本文提出一种基于空域协同自编码器的高光谱异常检测算法。方法 利用块图模型优良的背景抑制能力从空域角度筛选用于自编码器训练的背景样本集。自编码器采用经预筛选的训练样本集进行网络参数更新,在提升对背景样本表达能力的同时避免异常样本对探测性能的影响。为进一步将空域信息融入探测结果,利用块图模型得到的异常响应构建权重,起到突出目标并抑制背景的作用。结果 实验在3组不同尺寸的高光谱数据集上与5种代表性的高光谱异常检测算法进行比较。本文方法在3组数据集上的AUC （area under the curve）值分别为0.990 4、0.988 8和0.997 0,均高于其他算法。同时,对比了不同的训练集选择策略,与随机选取和使用全部样本进行对比。结果表明,本文基于空域响应的样本筛选方法相较对比方法具有较明显的优势。结论 提出的基于空域协同自编码器的高光谱异常检测算法从空域角度筛选样本以提升自编码器区分异常与背景的能力,同时融合了光谱域和空域信息,进一步提升了异常检测性能。     

迭代分析相对密度的高光谱异常检测

目的 针对复杂高光谱数据在不同地物规模和光谱特征上的差异,致使背景特征难以准确描述,导致异常检测算法检测效果不理想的问题,提出一种基于相对密度分析建立背景模型的高光谱遥感异常检测算法。方法 该算法借助最大相对密度分析的思想,通过统计与待测像元相似像元的数目作为其相对相似性分布密度,在像元光谱特征相似性分布密度的驱动下,自动搜索聚类中心并实现自适应聚类。为了避免不同背景地物受类别规模差异的影响,设计迭代筛选方法不断提取具有相对最大分布密度的类作为背景地物类别。当迭代终止时即可获得关于背景地物的统计模型,最后采用经典的马氏距离实现异常检测。结果 仿真实验采用两组常用的数据HyMap和HYDICE,与经典算法如基于聚类分析的异常检测算法（CBAD）、局部RX算法（LRX）和基于空间边缘特征变化的异常检测算法（2DCAD）等进行比较,并采用受试者工作特性曲线（ROC）和ROC曲线下面积（AUC）作为评价标准对实验结果进行分析。从实验数据中可以看到,本文算法在ROC曲线整体上表现优于其他算法,在HyMap下AUC值比同类算法至少高出5.6%,HYDICE下AUC值比同类算法至少高出13.6%。另外,对于不同数据,本文算法最终表现较为稳定,鲁棒性较好。结论 实验结果表明该算法无需构建分类面以及设定类别数目,在每次迭代中根据数据本身特征自适应地获取当前规模下背景显著性强的像元。另外,本文建立背景模型的方法适用于不同复杂场景下的高光谱数据,可以获得对背景的准确描述,有助于改善高光谱数据异常检测中对异常目标显著性衡量的准确性。     

粗定位和协同表示的高光谱图像异常检测

目的 由于在军事和民用应用中的重要作用,高光谱遥感影像异常检测在过去的20~30年里一直都是备受关注的研究热点。然而,考虑到异常点往往藏匿于大量的背景像元之中,且只占据很少的数量,给精确检测带来了不小的挑战。针对此问题,基于异常点往往表现在高频的细节区域这一前提,本文提出了一种基于异常点粗定位和协同表示的高光谱遥感影像异常检测算法。方法 对输入的原始高光谱遥感影像进行空间维的降质操作;通过衡量降质后影像与原始影像在空间维的差异,粗略定位可能的异常点位置;将粗定位的异常点位置用于指导像元间的协同表示以重构像元;通过衡量重构像元与原始像元的差异,从而进一步优化异常检测结果。结果 在4个数据集上与6种方法进行了实验对比。对于San Diego数据集,次优算法和本文算法分别取得的AUC （area under curve）值为0.978 6和0.994 0;对于HYDICE （hyperspectral digital image collection equipment）数据集,次优算法和本文算法的AUC值为0.993 6和0.998 5;对于Honghu数据集,次优算法和本文方法的AUC值分别为0.999 2和0.999 3;对Grand Isle数据集而言,尽管本文方法以0.001的差距略低于性能第1的算法,但从目视结果图中可见,本文方法所产生的虚警目标远少于性能第1的算法。结论 本文所提出的粗定位和协同表示的高光谱异常检测算法,综合考虑了高光谱遥感影像的谱间特性,同时还利用了其空间特性以及空间信息的先验分布,从而获得异常检测结果的提升。     

Maximized subspace model for hyperspectral anomaly detection

An important application in remote sensing using hyperspectral imaging system is the detection of anomalies in a large background in real-time. A basic anomaly detector for hyperspectral imagery that performs reasonaly well is the RX detector. In practice, the subspace RX (SSRX) detector which deletes the clutter subspace has been known to perform better than the RX detector. In this paper an anomaly detector that can do better than the SSRX detector without having to delete the clutter subspace is developed. The anomaly detector partials out the effect of the clutter subspace by predicting the background using a linear combination of the clutter subspace. The Mahalanobis distance of the resulting residual is defined as the anomaly detector. The coefficients of the linear combination are chosen to maximize a criterion based on squared correlation. The experimental results are obtained by implementing the anomaly detector as a global anomaly detector in unsupervised mode with background statistics computed from hyperspectral data cubes with wavelengths in the visible and near-infrared range. The results show that the anomaly detector has a better performance than the SSRX detector. In conclusion, the anomaly detector that is based on partialling out can achieve better performance than the conventional anomaly detectors.     

FPGA implementation of collaborative representation algorithm for real-time hyperspectral target detection

Hyperspectral image contains various wavelength channels and the corresponding imagery processing requires a computation platform with high performance. Target and anomaly detection on hyperspectral image has been concerned because of its practicality in many real-time detection fields while wider applicability is limited by the computing condition and low processing speed. The field programmable gate arrays (FPGAs) offer the possibility of on-board hyperspectral data processing with high speed, low-power consumption, reconfigurability and radiation tolerance. In this paper, we develop a novel FPGA-based technique for efficient real-time target detection algorithm in hyperspectral images. The collaborative representation is an efficient target detection (CRD) algorithm in hyperspectral imagery, which is directly based on the concept that the target pixels can be approximately represented by its spectral signatures, while the other cannot. To achieve high processing speed on FPGAs platform, the CRD algorithm reduces the dimensionality of hyperspectral image first. The Sherman–Morrison formula is utilized to calculate the matrix inversion to reduce the complexity of overall CRD algorithm. The achieved results demonstrate that the proposed system may obtains shorter processing time of the CRD algorithm than that on 3.40 GHz CPU.     

Hyperspectral anomaly detection using spectral–spatial features based on the human visual system

ABSTRACT

Anomaly detection (AD) is one of the most attracting topics within the recent 10 years in hyperspectral imagery (HSI). The goal of the AD is to label the pixels with significant spectral or spatial differences to their neighbours, as targets. In this paper, we propose a method that uses both spectral and spatial information of HSI based on human visual system (HVS). By inspiring the retina and the visual cortex functionality, the multiscale multiresolution analysis is applied to some principal components of hyperspectral data, to extract features from different spatial levels of the image. Then the global and local relations between features are considered based on inspiring the visual attention mechanism and inferotemporal (IT) part of the visual cortex. The effects of the attention mechanism are implemented using the logarithmic function which well highlights, small variations in pixels’ grey levels in global features. Also, the maximum operation is used over the local features for imitating the function of IT. Finally, the information theory concept is used for generating the final detection map by weighting the global and local detection maps to obtain the final anomaly map. The result of the proposed method is compared with some state-of-the-art methods such as SSRAD, FLD, PCA, RX, KPCA, and AED for two well-known real hyperspectral data which are San Diego airport and Pavia city, and a synthetic hyperspectral data. The results demonstrate that the proposed method effectively improves the AD capabilities, such as enhancement of the detection rate, reducing the false alarm rate and the computation complexity.     

局部投影可分离的高光谱图像异常检测

针对高光谱异常检测中临近异常像素相互干扰和背景地物复杂的问题,提出基于局部投影可分离的高光谱图像异常检测算法.在归一化的数据中,将待测像素光谱作为参考光谱,构造目标子空间,然后把邻域背景像素投影到该子空间,用投影后向量模值构造异常度计算式.最后将检测到的异常与全局主要背景地物进行比对,肖除部分虚警.利用HyMap高光谱数据进行仿真实验结果表明,本文算法具有克服背景复杂性和干扰点的影响,尤其对异类干扰点的抑制效果更佳.     

基于改进RX算法的高光谱异常检测

针对RX算法中局部背景协方差矩阵估计的局限性,提出一种改进的RX (I-RX)异常检测算法。基于奇异值分解(SVD),将高光谱图像投影到背景的正交子空间上,获得仅包含噪声和异常的残留图像。在此基础上,通过计算各样本的空间秩深度将残留图像划分为噪声背景和潜在异常两个样本集,利用噪声背景集估计整幅图像的背景协方差矩阵,并将潜在异常集作为测试样本进行异常检测。对模拟数据和真实高光谱数据进行了实验仿真,ROC曲线表明,在相同的虚警概率下,I-RX算法的检测概率相较于RX平均提高了2倍左右。     

GPU implementation of RX detection using spectral derivative features

Hyperspectral image (HSI), which can record abundance information of a pixel, has shown huge potential on many applications such as image classification, target and anomaly detection and so on. Nowadays, anomaly detection has attracted more attention because there is no limitation of spectral library. A standard approach for anomaly detection is the method developed by Reed and Xiaoli, called RX algorithm. However, the data volume is getting bigger with the developing of imaging technology. A problem that ensues is the rapid increase of computation complexity and this will lead a time-consumed application. In addition, there will be noise in HSI with the influence of illumination and atmospheric. In this paper, we realize an implementation of RX algorithm on NVIDIA GeForce 1060 GPU with the utilization of derivative features. On one hand, the GPU parallel implementation reach the purpose of real-time processing and it also eliminates the storage burden of on-board processing. On the other hand, the derivative features have better performance on salient features detection and noise restraint. Thus, it can further promote the detection performance of RXD. In our experiments, three real HSI datasets were tested to verify the effect of GPU parallel implementation. The experiment results had indicated that the utilization of derivative features can promote the detection performance. Compared with serial computation, the parallel implementation achieves a great reduction on processing time.     

Hyperspectral anomaly detection based on uniformly partitioned pixel

The objective of this paper is to develop an algorithm to detect anomaly in a hyperspectral image. The algorithm is based on a subspace model that is derived statistically. The anomaly detector is defined as the Mahalanobis distance of a residual from a pixel that is partitioned uniformly. The high correlation among adjacent components of the pixel is exploited by partitioning the pixel uniformly to improve anomaly detection. The residual is obtained by partialling out the main background from the pixel by predicting a linear combination of each partition of the pixel with a linear combination of the random variables representing the main background. Experimental results show that the anomaly detector outperforms conventional anomaly detectors.     

Comparison of spectral and spatial windows for local anomaly detection in hyperspectral imagery

A new way of implementing two local anomaly detectors in a hyperspectral image is presented in this study. Generally, most local anomaly detector implementations are carried out on the spatial windows of images, because the local area of the image scene is more suitable for a single statistical model than for global data. These detectors are applied by using linear projections. However, these detectors are quite improper if the hyperspectral dataset is adopted as the nonlinear manifolds in spectral space. As multivariate data, the hyperspectral image datasets can be considered to be low-dimensional manifolds embedded in the high-dimensional spectral space. In real environments, the nonlinear spectral mixture occurs more frequently, and these manifolds could be nonlinear. In this case, traditional local anomaly detectors are based on linear projections and cannot distinguish weak anomalies from background data. In this article, local linear manifold learning concepts have been adopted, and anomaly detection algorithms have used spectral space windows with respect to the linear projection. Output performance is determined by comparison between the proposed detectors and the classic spatial local detectors accompanied by the hyperspectral remote-sensing images. The result demonstrates that the effectiveness of the proposed algorithms is promising to improve detection of weak anomalies and to decrease false alarms.