Hyperspectral image quality based on convolutional network of multi-scale depth

Hyperspectral imagery has been widely used in military and civilian research fields such as crop yield estimation, mineral exploration, and military target detection. However, for the limited imaging equipment and the complex imaging environment of hyperspectral images, the spatial resolution of hyperspectral images is still relatively low, which limits the application of hyperspectral images. So, studying the data characteristics of hyperspectral images deeply and improving the spatial resolution of hyperspectral images is an important prerequisite for accurate interpretation and wide application of hyperspectral images. The purpose of this paper is to deal with super-resolution of the hyperspectral image quickly and accurately, and maintain the spectral characteristics of the hyperspectral image, makes the spectral separability of the substrate in the original image remains unchanged after super-resolution processing. This paper first learns the mapping relationship between the spectral difference of low-resolution hyperspectral image and the spectral difference of the corresponding high-resolution hyperspectral image based on multiple scale convolutional neural network, Thus, apply this mapping relationship to the input low-resolution hyperspectral image generally, getting the corresponding high resolution spectral difference. Constrained space by using the image of reconstructed spectral difference, this requires the low-resolution hyperspectral image generated by the reconstructed image is to be close to the input low-resolution hyperspectral image in space, so that the whole process becomes a closed circulation system where the low-resolution hyperspectral image generation of high-resolution hyperspectral images, then back to low-resolution hyperspectral images. This innovative design further enhances the super-resolution performance of the algorithm. The experimental results show that the hyperspectral image super-resolution method based on convolutional neural network improves the input image spatial information, and the super-resolution performance of the model is above 90%, which can maintain the spectral information well.     

Hyperspectral image super-resolution combining with deep learning and spectral unmixing

In recent years, hyperspectral image super-resolution has attracted the attention of many researchers and has become a hot topic in the field of computer vision. However, it is difficult to obtain high-resolution images due to imaging hardware devices. At present, many existing hyperspectral image super-resolution methods have not achieved good results. In this paper, we propose a hyperspectral image super-resolution method combining with deep residual convolutional neural network (DRCNN) and spectral unmixing. Firstly, the spatial resolution of the image is enhanced by learning a priori knowledge of natural images. The DRCNN reconstructs high spatial resolution hyperspectral images by concatenating multiple residual blocks, each containing two convolutional layers. Secondly, the spectral features of low-resolution and high-resolution hyperspectral images are linked by spectral unmixing. This approach aims to obtain the endmember matrix and the abundance matrix. The final reconstruction result is obtained by multiplying the endmember matrix and the abundance matrix. In addition, in order to improve the visual effect of the reconstructed image, the total variation regularity is used to impose constraints on the abundance matrix to enhance the relationship between the pixels. The experimental results of remote sensing data based on ground facts show that the proposed method has good performance and preserves spatial information and spectral information without the need for auxiliary images.     

Hyperspectral Fluorescence Imaging for Mouse Skin Tumor Detection

This paper presents a hyperspectral imaging technique based on laser‐induced fluorescence for non‐invasive detection of tumorous tissue on mouse skin. Hyperspectral imaging sensors collect image data in a number of narrow, adjacent spectral bands. Such high‐resolution measurement of spectral information reveals contiguous emission spectra at each image pixel useful for the characterization of constituent materials. The hyperspectral image data used in this study are fluorescence images of mouse skin consisting of 21 spectral bands in the visible spectrum of the wavelengths ranging from 440 nm to 640 nm. Fluorescence signal is measured with the use of laser excitation at 337 nm. An acousto‐optic tunable filter (AOTF) is used to capture images at 10 nm intervals. All spectral band images are spatially registered with the reference band image at 490 nm to obtain exact pixel correspondences by compensating the spatial offsets caused by the refraction differences in AOTF at different wavelengths during the image capture procedure. The unique fluorescence spectral signatures demonstrate a good separation to differentiate malignant tumors from normal tissues for rapid detection of skin cancers without biopsy.     

基于压缩感知理论的波段重构方法

针对高光谱图像数据量大、信息冗余多、传输难度大等问题,从波段压缩采样入手,通过采样数据重构出原始波段,提出一种基于压缩感知理论的波段重构方法。压缩感知理论是一种在不遵循奈奎斯特采样定理的情况下,能够高精度重构出原始信号的新型压缩采样理论。由于高光谱图像谱间相关性高,具有很强的稀疏性,故可将压缩感知理论用于高光谱数据的波段重构,仅选择少量波段,便能够重构得到原始高光谱数据。实验结果表明,压缩感知理论能够对高光谱图像波段维进行压缩与重构,并可达到较高的重构比例,同时获得较高的重构效率,且重构数据光谱曲线与原始数据光谱曲线的波形一致度高。     

最大误差可控的高光谱图像聚类压缩算法

针对原有基于奇异值分解的最大误差可控的高光谱图像压缩(EC-SVD)算法未充分利用图像光谱矢量间冗余的问题,该文将高光谱图像压缩与聚类结合,提出最大误差可控的高光谱图像聚类压缩算法。分析发现,图像的光谱矢量间相似度越高越有利于得到好的最终压缩效果。因此,算法首先使用K-均值聚类对高光谱图像像元按光谱矢量聚类,以提高同类光谱矢量间的相似度;其次,对每一类像元分别使用EC-SVD算法思想压缩以控制最大误差。论文证明了当高光谱图像的像元个数与波段数之比较大,且聚类类数不大于8时,聚类能够提高图像最终压缩比。最后,设计整体压缩实验仿真流程,并对实际高光谱图像进行数值仿真。结果表明,在相同参数条件下,该文算法比EC-SVD算法得到的压缩比和信噪比均有提高,最大压缩比提高了10% 左右。该文算法能够有效提高EC-SVD算法的图像压缩效果。     

Band Selection in Multispectral Images by Minimization of Dependent Information

In this paper, a band selection technique for hyperspectral image data is proposed. Supervised feature extraction techniques allow a reduction of the dimensionality to extract relevant features through a labeled training set. This implies an analysis of the existing class distributions, which usually means, in the case of hyperspectral imaging, a large number of samples, making the labeling process difficult. A possible alternative could be the use of information measures, which are the basis of the proposed method. The present approach basically behaves as an unsupervised feature selection criterion, to obtain the relevant spectral bands from a set of sample images. The relations of information content between spectral bands are analyzed, leading to the proposed technique based on the minimization of the dependent information between spectral bands, while trying to maximize the conditional entropies of the selected bands     

Representative band selection for hyperspectral image classification

High dimensional curse for hyperspectral images is one major challenge in image classification. In this work, we introduce a novel spectral band selection method by representative band mining. In the proposed method, the distance between two spectral bands is measured by using disjoint information. For band selection, all spectral bands are first grouped into clusters, and representative bands are selected from these clusters. Different from existing clustering-based band selection methods which select bands from each cluster individually, the proposed method aims to select representative bands simultaneously by exploring the relationship among all band clusters. The optimal representative band selection is based on the criteria of minimizing the distance inside each cluster and maximizing the distance among different representative bands. These selected bands can be further applied in hyperspectral image classification. Experiments are conducted on the 92AV3C Indian Pine data set. Experimental results show that the disjoint information-based spectral band distance measure is effective and the proposed representative band selection approach outperforms state-of-the-art methods for high dimensional image classification.     

面向图像超分辨率的紧凑型多径卷积神经网络算法研究

为改善单帧图像分辨率退化问题,减少网络参数,本文提出一种基于紧凑型多径结构卷积神经网络的图像超分辨率重构算法。本文算法采用多径结构模型充分使用低分辨率图像信息,并利用残差学习策略学习低分辨率和高分辨率图像间残差信息以重建高分辨率图像。当卷积核数量有限时,含有ReLU的网络重构性能表现不佳,因此引入最大特征图激活函数,增强网络泛化能力,使网络结构更加紧凑,以捕捉具有竞争性特征,完成图像超分辨率重构。实验结果表明,本文方法具有良好的重构能力,图像清晰度和边缘锐度明显提高,在客观评价和主观视觉效果方面优于当前主流的超分辨率重构方法。为便携式高性能超分辨率重构奠定理论基础。      

MULTI-SPECTRAL AND HYPERSPECTRAL IMAGE FUSION USING 3-D WAVELET TRANSFORM

Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional （3-D） feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures： Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling （RIBSR）method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution （A＆S） rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A＆S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.     

高光谱图像光谱域噪声检测与去除的DSGF方法

高光谱遥感图像中不仅存在空间域噪声而且存在光谱域噪声.传统的图像滤波仅对图像空间域噪声进行处理,而不能去除光谱域噪声,为改进这种状况,提出了DSGF(Derivative based Savitzky-Golay F ilter)方法.首先,基于反射率光谱的二阶导数对反射率光谱各波段噪声大小进行判定,然后用不同大小平滑窗的Savitzky-Golay滤波器对反射率光谱作两步滤波.对高光谱图像进行的逐像元DSGF滤波,在去除光谱域中噪声的同时,保留了图像反射率光谱的大部分细微特征.     

A super-resolution reconstruction algorithm for hyperspectral images

The spatial resolution of a hyperspectral image is often coarse because of the limitations of the imaging hardware. Super-resolution reconstruction (SRR) is a promising signal post-processing technique for hyperspectral image resolution enhancement. This paper proposes a maximum a posteriori (MAP) based multi-frame super-resolution algorithm for hyperspectral images. Principal component analysis (PCA) is utilized in both parts of the proposed algorithm: motion estimation and image reconstruction. A simultaneous motion estimation method with the first few principal components, which contain most of the information of a hyperspectral image, is proposed to reduce computational load and improve motion field accuracy. In the image reconstruction part, different image resolution enhancement techniques are applied to different groups of components, to reduce computational load and simultaneously remove noise. The proposed algorithm is tested on both synthetic images and real image sequences. The experimental results and comparative analyses verify the effectiveness of this algorithm.     

基于空谱特性的高光谱图像压缩感知重构

针对现有的高光谱图像压缩感知重构算法对图像的空谱特性利用不够充分,导致重构图像质量不够高的问题,提出了一种高光谱图像变投影率分块压缩感知结合优化谱间预测重构方案。编码端以频段聚类方式将高光谱图像的所有频段分成参考频段和普通频段,对不同频段单独采用不同精度分块压缩感知以获取高光谱数据。在解码端,参考频段直接采用稀疏度自适应匹配追踪( SAMP)算法重构,对于普通频段,则设计了一种优化谱间预测结合SAMP算法的新模型进行重构：首先通过重构的参考频段双向预测普通频段,并对其进行压缩投影,然后计算预测前后普通频段投影值的残差,最后利用SAMP算法重构该残差,以此修正预测值。实验表明,相比同类算法,该算法充分考虑了高光谱图像的空谱特性,有效改善了重构图像质量,且编码复杂度低,易于硬件实现。     

基于波段指数的高光谱影像波段选择算法

为了去除高光谱影像的数据冗余,提高高光谱影像处理的精度和效率,提出了一种基于波段指数的高光谱影像波段选择算法。采用小波变换对高光谱图像数据进行去噪处理,依据联合偏度-峰度指数将波段进行分组,再根据波段指数的大小确定相对较小指数的波段,并将其作为冗余波段进行去除,从而得到最小波段集。结果表明,利用该波段集和全波段所选的端元是一致的,在不影响端元提取的前提下,最大程度地去除了冗余波段,而且该波段集与全波段的分类精度较接近。该算法在波段选择过程中具有可行性与有效性,为降低高光谱影像维数提供了一种帮助。     

基于列相关的热红外高光谱遥感图像非均匀性校正

由于探测单元之间响应不一致、电子增益和偏置发生变化、焦平面污染和损伤等因素,推扫式热红外成像光谱仪获取的图像常常表现为图像列之间不均匀,条带噪声严重,影响了热红外高光谱遥感图像的后续处理和应用。结合推扫式成像光谱仪非均匀性的来源和成因,以相邻地物的相关性为理论基础,提出了适用于热红外高光谱遥感图像的非均匀性校正方法。该方法的步骤是,首先逐波段对原始热红外高光谱遥感图像进行标准矩匹配校正,得到标准矩匹配校正图像;然后,以标准矩匹配校正图像为基础,选择相邻两列像元中相同的地物像元;最后,用两列中相同的地物像元,通过线性回归得到后一列的校正系数,并对其进行校正,顺次遍历一个波段的所有列,完成一个波段图像的非均匀性校正。按照此过程,遍历一幅热红外高光谱遥感图像的所有波段,完成一幅热红外高光谱遥感图像的非均匀性校正。将该方法应用于推扫式热红外光谱成像仪实际获取图像的非均匀性校正中。结果表明,相比矩匹配方法,在保证非均匀性校正效果的情况下,本文方法的各列均值和标准差更符合实际情况。     

结合张量空间与倒易晶胞的高光谱影像去噪去混叠

传统去噪去混叠算法大多针对单波段图像,针对于高光谱影像的特点以及噪声、混叠对于图像的影响,提出了一种结合张量与倒易晶胞的多维滤波算法,并将其应用在高光谱影像的去噪和去混叠中。该方法引入张量,将高光谱影像数据视为三阶的张量表达,以倒易晶胞获取影像混叠和噪声较小的频谱覆盖,从最小均方误差的角度交替迭代求解三个方向的滤波器,最终完成影像滤波,在保证影像空间和光谱信息一致性的前提下,有效地减少影像混叠和噪声,提高图像的质量。通过与二维维纳滤波算法、张量多维去噪算法的多组高光谱数据对比实验,证明了文中算法的有效性。     

基于稀疏正则化结合NLS的超分辨率图像重建

为了保持高光谱(HS)超分辨率重建过程中的频谱一致性和边缘锐度,提出一种基于空间谱结合非局部相似性的超分辨率重建算法。首先,使用HS图像生成模型,采用稀疏正则化解决全色(PAN)图像和HS图像重建的病态问题求逆;然后分析了从高空间分辨率到低空间分辨率数据生成的丰度系数映射;最后利用非局部相似性,设计空间谱联合正则化项。实验结果表明,本文算法重建图像在PSNR,SSIM和FSIM方面明显高于其他优秀算法,在SAM和ERGAS方面明显低于其他优秀算法,在光谱失真方面丢失最少,仅有2%-3%,低于其他算法30%左右,且重建效果更加清晰自然。     

稀疏子带的多频段雷达信号融合超分辨距离成像

多频段雷达信号融合是提高目标距离分辨率的一种有效方法,在稀疏子带观测条件下,由于信号频带稀疏,传统的相位补偿和融合成像方法难以应用,为此本文在线性调频信号体制下,基于修正的多重信号选择(MUSIC)算法提出了一种新的参数化融合成像方法.该方法首先对信号离散序列进行均匀采样处理,然后对多个频带的雷达信号统一建模,将相位补偿参数与目标散射中心参数一起估计,理论分析和仿真结果表明该方法能够有效融合多频段的雷达观测信号,改善目标一维距离像的分辨率.     

基于线性解混的高光谱图像目标检测研究

高光谱图像的空间分辨率普遍较低，导致混合像元大量存在，为目标检测带来了一定困难。为了实现复杂背景下的高光谱图像目标检测，提出了一种去端元的目标检测方法。在光谱解混技术的基础上，建立了复杂背景下的光谱混合模型并加以改进，采用多次去端元的方法，取得了简化背景之后的高光谱图像。结果表明，与传统的RX目标检测算法相比，所提出的算法能够显著提升目标检测效果。在实际的军事运用中，为大尺幅图像的目标识别和揭露伪装提供了思路。     

基于光谱稀疏模型的高光谱压缩感知重构

提出了一种基于光谱稀疏化的压缩感知采样与重构模型,通过从训练样本中构建光谱稀疏字典提升光谱稀疏化效果,同时在重构时兼顾空间图像的全变分约束进一步提升重构精度.对200波段AVIRIS高光谱场景进行压缩感知重构的实验表明,利用构建的光谱稀疏字典与传统的DCT字典和Haar小波字典相比光谱稀疏化效果明显提升,同时在25%采样下基于光谱稀疏字典几乎无差别重构出了高光谱图像,同样条件下在空间和光谱的精度与现有常用方法相比有较大的提升.     

基于多波段谱间预测的高光谱图像无损压缩算法

该文提出一种基于多波段谱间预测的高光谱图像无损压缩方案。首先,充分考虑到随着高光谱图像谱间分辨率的提高,其谱间相关性也越来越强烈,推导出由多个波段对当前波段做线性预测的预测器系数,然后给出快速计算求解预测器系数的算法。对AVIRIS图像进行压缩,实验结果表明,该算法压缩比高,运算速度快,具有极高的实用价值。