Hyperspectral image quality based on convolutional network of multi-scale depth

Hyperspectral imagery has been widely used in military and civilian research fields such as crop yield estimation, mineral exploration, and military target detection. However, for the limited imaging equipment and the complex imaging environment of hyperspectral images, the spatial resolution of hyperspectral images is still relatively low, which limits the application of hyperspectral images. So, studying the data characteristics of hyperspectral images deeply and improving the spatial resolution of hyperspectral images is an important prerequisite for accurate interpretation and wide application of hyperspectral images. The purpose of this paper is to deal with super-resolution of the hyperspectral image quickly and accurately, and maintain the spectral characteristics of the hyperspectral image, makes the spectral separability of the substrate in the original image remains unchanged after super-resolution processing. This paper first learns the mapping relationship between the spectral difference of low-resolution hyperspectral image and the spectral difference of the corresponding high-resolution hyperspectral image based on multiple scale convolutional neural network, Thus, apply this mapping relationship to the input low-resolution hyperspectral image generally, getting the corresponding high resolution spectral difference. Constrained space by using the image of reconstructed spectral difference, this requires the low-resolution hyperspectral image generated by the reconstructed image is to be close to the input low-resolution hyperspectral image in space, so that the whole process becomes a closed circulation system where the low-resolution hyperspectral image generation of high-resolution hyperspectral images, then back to low-resolution hyperspectral images. This innovative design further enhances the super-resolution performance of the algorithm. The experimental results show that the hyperspectral image super-resolution method based on convolutional neural network improves the input image spatial information, and the super-resolution performance of the model is above 90%, which can maintain the spectral information well.     

基于稀疏正则化结合NLS的超分辨率图像重建

为了保持高光谱(HS)超分辨率重建过程中的频谱一致性和边缘锐度,提出一种基于空间谱结合非局部相似性的超分辨率重建算法。首先,使用HS图像生成模型,采用稀疏正则化解决全色(PAN)图像和HS图像重建的病态问题求逆;然后分析了从高空间分辨率到低空间分辨率数据生成的丰度系数映射;最后利用非局部相似性,设计空间谱联合正则化项。实验结果表明,本文算法重建图像在PSNR,SSIM和FSIM方面明显高于其他优秀算法,在SAM和ERGAS方面明显低于其他优秀算法,在光谱失真方面丢失最少,仅有2%-3%,低于其他算法30%左右,且重建效果更加清晰自然。     

基于多维度特征遥感图像分类方法的研究北大核心CSCD

为了解决传统高光谱图像分类方法精度低、计算成本高及未能充分利用空-谱信息的问题,本文提出一种基于多维度并行卷积神经网络(multidimensional parallel convolutional neural network,3D-2D-1D PCNN)的高光谱图像分类方法。首先,该算法利用不同维度卷积神经网络(convolutional neural network,CNN)提取高光谱图像信息中的空-谱特征、空间特征及光谱特征;之后,采用相同并行卷积层将组合后的空-谱特征、空间特征及光谱特征进行特征融合;最后,通过线性分类器对高光谱图像信息进行精准分类。本文所提方法不仅可以提取高光谱图像中更深层次的空间特征和光谱特征信息,同时能够将光谱图像不同维度的特征进行融合,减小计算成本。在Indian Pines、Pavia Center和Pavia University数据集上对本文算法和4种传统算法进行对比实验,结果表明,本文算法均得到最优结果,分类精度分别达到了99.210%、99.755%和99.770%。     

基于特征融合方法的高光谱图像分类综述

高光谱图像中包含丰富的光谱特征和空间特征,这对地表物质的分类至关重要。然而高光谱图像的空间分辨率相对较低,使得图像中存在大量的混合像素,这严重制约物质分类的精度。受到观测噪声、目标区域大小及端元易变性等因素的影响,使得高光谱图像的分类仍然面临诸多挑战。随着人工智能和信息处理技术的不断进步,高光谱图像分类已成为遥感领域的一个热点问题。首先对基于特征融合的高光谱图像分类文献进行系统综述,并对几种分类策略进行分析与比较,然后介绍高光谱图像分类的发展现状及面临的相应问题,最后提出一些可以提高分类性能的策略,从而为课题的技术研究提供指导和帮助。     

基于独立分量分析的高光谱遥感图像混合像元盲分解

传统的独立分量分析并不适用于高光谱遥感图像的混合像元解混,因为图像中各端元的分布不是相互独立的.针对这一问题,提出了一种有约束的独立分量分析方法,来实现遥感图像混合像元的盲分解.通过在独立分量分析的目标函数中引入丰度非负约束与丰度和为一约束,改变了传统的独立性假设.同时,为了更好地适用于遥感数据分析,还提出了一种自适应...     

Super-resolution reconstruction of hyperspectral images.

Hyperspectral images are used for aerial and space imagery applications, including target detection, tracking, agricultural, and natural resource exploration. Unfortunately, atmospheric scattering, secondary illumination, changing viewing angles, and sensor noise degrade the quality of these images. Improving their resolution has a high payoff, but applying super-resolution techniques separately to every spectral band is problematic for two main reasons. First, the number of spectral bands can be in the hundreds, which increases the computational load excessively. Second, considering the bands separately does not make use of the information that is present across them. Furthermore, separate band super-resolution does not make use of the inherent low dimensionality of the spectral data, which can effectively be used to improve the robustness against noise. In this paper, we introduce a novel super-resolution method for hyperspectral images. An integral part of our work is to model the hyperspectral image acquisition process. We propose a model that enables us to represent the hyperspectral observations from different wavelengths as weighted linear combinations of a small number of basis image planes. Then, a method for applying super resolution to hyperspectral images using this model is presented. The method fuses information from multiple observations and spectral bands to improve spatial resolution and reconstruct the spectrum of the observed scene as a combination of a small number of spectral basis functions.     

基于门控卷积神经网络的图像超分辨重建算法北大核心CSCD

近年来,卷积神经网络被广泛应用于图像超分辨率领域。针对基于卷积神经网络的超分辨率算法存在图像特征提取不充分,参数量大和训练难度大等问题,本文提出了一种基于门控卷积神经网络(gated convolutional neural network, GCNN)的轻量级图像超分辨率重建算法。首先,通过卷积操作对原始低分辨率图像进行浅层特征提取。之后,通过门控残差块(gated residual block, GRB)和长短残差连接充分提取图像特征,其高效的结构也能加速网络训练过程。GRB中的门控单元(gated unit, GU)使用区域自注意力机制提取输入特征图中的每个特征点权值,紧接着将门控权值与输入特征逐元素相乘作为GU输出。最后,使用亚像素卷积和卷积模块重建出高分辨率图像。在Set14、BSD100、Urban100和Manga109数据集上进行实验,并和经典方法进行对比,本文算法有更高的峰值信噪比(peak signal-to-noise ratio,PSNR)和结构相似性(structural similarity,SSIM),重建出的图像有更清晰的轮廓边缘和细节信息。     

基于同质区分割的非线性端元提取算法

端元提取是高光谱遥感图像混合像元分解的关键步骤。传统端元提取算法忽略了高光谱图像中地物空间分布相关性与非线性结构,制约了端元提取算法的精度。针对高光谱图像的空间关系与非线性结构,提出一种基于同质区分割的非线性端元提取算法。使用超像素分割方法将图像分割为若干同质区,利用流形学习构造高光谱图像数据的非线性结构,最后在同质区内提取端元并利用聚类方法优选端元。模拟和真实图像数据实验表明,该算法能够保证高光谱数据的非线性结构,端元提取结果优于其他传统线性端元提取方法,在低信噪比的情况下,可以保持较好的端元提取结果。     

Generative adversarial networks for hyperspectral image spatial super-resolution

It is becoming increasingly easier to obtain more abundant supplies for hyperspectral images ( HSIs). Despite this, achieving high resolution is still critical. In this paper, a method named hyperspectral images super-resolution generative adversarial network ( HSI-RGAN ) is proposed to enhance the spatial resolution of HSI without decreasing its spectral resolution. Different from existing methods with the same purpose, which are based on convolutional neural networks ( CNNs) and driven by a pixel-level loss function, the new generative adversarial network (GAN) has a redesigned framework and a targeted loss function. Specifically, the discriminator uses the structure of the relativistic discriminator, which provides feedback on how much the generated HSI looks like the ground truth. The generator achieves more authentic details and textures by removing the place of the pooling layer and the batch normalization layer and presenting smaller filter size and two-step upsampling layers. Furthermore, the loss function is improved to specially take spectral distinctions into account to avoid artifacts and minimize potential spectral distortion, which may be introduced by neural networks. Furthermore, pre-training with the visual geometry group (VGG) network helps the entire model to initialize more easily. Benefiting from these changes, the proposed method obtains significant advantages compared to the original GAN. Experimental results also reveal that the proposed method performs better than several state-of-the-art methods.     

双约束深度卷积网络的高光谱图像空谱解混方法

高光谱图像凭借其“图谱合一”的特点逐渐在军事、环境、农业等方面发挥出重要作用。但是，由于传感器空间分辨率的限制以及地物分布的复杂多样性，高光谱遥感图像中通常存在大量的混合像元，严重制约了高光谱遥感的应用范围。目前，处理混合像元问题最有效的分析方法是混合像元分解（解混）。近年来，深度学习的发展对高光谱遥感产生了重大影响，也催生出一系列基于深度学习的解混方法。现有基于深度学习的解混方法在隐藏信息挖掘方面表现出极大的潜力和优势，通常情况下能够取得更加准确的结果。然而，这些方法大多只考虑了地物的光谱信息而忽略空间分布规律，导致在复杂场景中估算结果可能并不理想，逐渐难以满足工程应用的实际需求。为进一步发掘和利用空间信息提升解混的准确性，本文构建了一种新的深度学习网络来实现高光谱图像解混。新提出的解混网络采用卷积层来获取先验信息，利用高斯核函数的特性来协助区分物质属性，并且通过分配中心像元与邻域像元间的权重来增进丰度平滑性。在新网络中，本文使用Softmax作为丰度对应层的激活函数来约束丰度的输出。此外，在Softmax中，本文采用了L1/2正则化来避免节点出现过拟合而影响最终结果，进一步强化了网...     

基于Fisher判别零空间的高光谱图像混合像元分解

传统的光谱混合分析方法假设每个端元必须具有完全稳定的光谱特性,而在实际问题中同类地物的端元光谱往 往存在着差异。为了有效地抑制同物异谱对混合像元分解的影响,本文提出一种基于Fisher判别零空间的高光谱遥感图像混合像元分 解算法。Fisher判别零空间方法通过对高光谱图像数据进行线性变换,使得变换后的数据中同一端元内的光谱差异减小为零,而不同 端元间的光谱差异尽可能地增大。利用变换后的光谱数据对混合像元进行分解就可以较大程度地减少同物异谱现象对分解结果的影响。 对模拟高光谱图像数据以及Indiana地区和Cuprite地区的实际AVIRIS数据的解混结果表明,用Fisher判别零空间方法处理混合像元分 解问题,可以得到较高的分解精度。     

高光谱解混方法研究

高光谱图像的空间分辨率较低,导致大量混合像元存在于高光谱图像中。混合像元的存在是使高光谱图像目标分类准确率降低的主要原因之一。高光谱像元解混在高光谱遥感图像处理中具有非常重要的意义。高光谱像元解混主要分为线性和非线性光谱解混两种方法,研究最广泛的是线性光谱解混。归纳了线性光谱解混的两个步骤:（1）提取纯净像元中地物的光谱信号,即提取端元,这是关键步骤;（2）利用端元的加权线性组合对混合像元进行光谱解混,即丰度反演。简述了端元提取及丰度反演研究的主要进展,介绍了端元提取的几种典型算法。通过归纳、对比和分析,总结了不同端元提取方法的特点,并对高光谱解混的研究前景进行了展望。     

基于迁移学习的红外图像超分辨率方法研究

针对红外图像空间分辨率低、成像质量不高的问题,提出了基于迁移学习的红外图像超分辨率方法。该方法以基于卷积神经网络的自然图像超分辨率方法为基础进行改进:增加网络的层数进行更深层次的学习训练,串联多层小的卷积核使其能够利用更多的图像信息,以“相差图”为目标进行训练,减小网络训练时间,提升网络收敛速度;利用迁移学习知识,再以少量高质量红外图像为目标样本,对自然图像超分辨率的网络进行二次训练,将网络权重经过微调后迁移应用到红外图像的超分辨率上。实验结果表明:基于卷积神经网络的超分辨率方法能够有效迁移应用到红外图像的超分辨率上,且改进后的网络具有更好的自然及红外图像的超分辨率性能,验证了本文所提方法的有效性及优越性。     

高光谱图像混合像元分解算法

传统的高光谱图像混合像元分解技术包括端元提取和估计每个端元的混合比例.虽然很多模型都能得到可以接受的解混结果,但是一些未知端元的存在使得结果在包含未知端元的像素点处出现偏差.因此,提出了一种基于支持向量数据描述的高光谱图像混合像元分解算法.首先高光谱图像数据被分成类内和类外两部分,类内是完全由已知端元数据混合的像素点,而类外数据是包含未知端元的像素点.两类数据交界处被认为是已知端元和未知端元混合的数据.然后再对这些像素点进行混合像元分解,分别对仿真数据和真实高光谱图像进行实验.结果表明该算法可以有效地解决因存在未知端元对解混精度的影响,而且能给出未知端元的解混分量.该方法的解混结果几乎不受未知端元的影响,优于直接解混结果     

Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications

Hyperspectral images have a higher spectral resolution (i.e., a larger number of bands covering the electromagnetic spectrum), but a lower spatial resolution with respect to multispectral or panchromatic acquisitions. For increasing the capabilities of the data in terms of utilization and interpretation, hyperspectral images having both high spectral and spatial resolution are desired. This can be achieved by combining the hyperspectral image with a high spatial resolution panchromatic image. These techniques are generally known as pansharpening and can be divided into component substitution (CS) and multi-resolution analysis (MRA) based methods. In general, the CS methods result in fused images having high spatial quality but the fused images suffer from spectral distortions. On the other hand, images obtained using MRA techniques are not as sharp as CS methods but they are spectrally consistent. Both substitution and filtering approaches are considered adequate when applied to multispectral and PAN images, but have many drawbacks when the low-resolution image is a hyperspectral image. Thus, one of the main challenges in hyperspectral pansharpening is to improve the spatial resolution while preserving as much as possible of the original spectral information. An effective solution to these problems has been found in the use of hybrid approaches, combining the better spatial information of CS and the more accurate spectral information of MRA techniques. In general, in a hybrid approach a CS technique is used to project the original data into a low dimensionality space. Thus, the PAN image is fused with one or more features by means of MRA approach. Finally the inverse projection is used to obtain the enhanced image in the original data space. These methods, permit to effectively enhance the spatial resolution of the hyperspectral image without relevant spectral distortions and on the same time to reduce the computational load of the entire process. In particular, in this paper we focus our attention on the use of Nonlinear Principal Component Analysis (NLPCA) for the projection of the image into a low dimensionality feature space. However, if on one hand the NLPCA has been proved to better represent the intrinsic information of hyperspectral images in the feature space, on the other hand an analysis of the impact of different fusion techniques applied to the nonlinear principal components in order to define the optimal framework for the hybrid pansharpening has not been carried out yet. More in particular, in this paper we analyze the overall impact of several widely used MRA pansharpening algorithms applied in the nonlinear feature space. The results obtained on both synthetic and real data demonstrate that an accurate selection of the pansharpening method can lead to an effective improvement of the enhanced hyperspectral image in terms of spectral quality and spatial consistency, as well as a strong reduction in the computational time.     

改进的超分辨率图像重建算法

针对超分辨率卷积神经网络(SRCNN)卷积层较少、训练时间长、不易收敛且表达和泛化能力受限等问题,提出了一种残差反卷积SRCNN(RD-SRCNN)算法。首先利用不同大小的卷积核进行卷积操作,以更好地提取低分辨率图像中的细节特征;然后将获取的图像特征输入由不同大小卷积核构成的卷积层和指数线性单元激活层组成的残差网络,并通过短路径连接各个特征提取单元,以解决梯度消失、实现特征重用、减少网络冗余;最后,通过加入反卷积层增大感受野,得到清晰的高分辨率图像。实验结果表明,RD-SRCNN算法在视觉和客观评价标准上均取得了较好的效果。     

基于sc-NMF的高光谱图像融合

将高光谱图像与全色图像融合,所得融合数据对于后续的其它高光谱图像处理非常有帮助。区别于传统方法,针对高光谱图像特点,引入了光谱约束项,改进并建立基于光谱约束的非负矩阵分解（spectral-constrained nonnegative matrix factorization,sc-NMF）。改进后,该模型首先在光谱约束前提下,对高光谱图像进行非负矩阵分解,对分解所得基底进行增强,再重建高光谱图像。这样,所得到的融合图像在空间细节和光谱保持性均有比较好的效果。最后,进行了仿真和实际数据的实验验证,通过主观和客观的评价结果,所改进的融合方法性能较好,比传统方法更适用于高光谱图像融合。     

高光谱遥感图像端元提取的零空间光谱投影算法

端元提取技术是高光谱遥感图像光谱解混的关键.在线性光谱混合分析中,首先引入了高光谱遥感图像经过零空间光谱投影后具有单形体的凸不变性.在此基础上,提出了零空间光谱投影算法,通过设计各种度量和准则,制定不同的单次端元提取策略,灵活地实现算法.经过证明,零空间光谱投影算法是对基于子空间投影距离算法(包括零空间投影距离算法与经典正交子空间投影算法)的进一步延伸,提供了更多的端元提取策略.实验结果表明,零空间光谱投影算法在模拟图像以及真实高光谱遥感图像中都能够有效地提取出图像中的各种端元.     

基于光谱线性分解的高光谱图像高效压缩

高光谱图像有效压缩对于实现实时传输具有重要意义。本文将光谱线性分解应用于高光谱图像的高效压缩中,根据高光谱图像的线性混合模型,将高光谱数据分解为端元与丰度的乘积,编码端对端元与丰度进行必要的数据处理,然后分别进行JPEG-LS无损压缩,形成输出码流数据。解码端利用最终解码后的端元与丰度相乘来重建原始图像,探讨了量化步长对率失真性能的影响。仿真实验结果表明,该方法能够取得一定的压缩性能。     

基于高光谱解混的伪装目标识别技术研究

高光谱遥感图像识别技术在伪装目标识别方面具有很大的应用前景。针对高光谱遥感图像中的混合像元和光谱变异问题,提出基于高光谱解混技术的伪装目标识别方法。该方法采用扩展线性混合模型表征高光谱图像中的光谱变异问题,利用超像元分割技术将原始高光谱图像转换为粗细多尺度特征图,对超像元丰度矩阵附加8-邻域空间加权与行约束,以降低噪声和奇异点像元的影响。针对伪装目标空间分布稀疏的特点,在模型中增加丰度矩阵的截断加权核范数作为正则化项,以提高算法精度。实验结果表明提出的方法具有良好的抗噪性和较高的解混精度,可以有效提高伪装目标识别精度。