ABSTRACTHyperspectral image (HSI) classification is a most challenging task in hyperspectral remote sensing field due to unique characteristics of HSI data. It consists of huge number of bands with strong correlations in the spectral and spatial domains. Moreover, limited training samples make it more challenging. To address such problems, we have presented here a spatial feature extraction technique using deep convolutional neural network (CNN) for HSI classification. As optimizer plays an important role in learning process of deep CNN model, we have presented the effect of seven different optimizers on our deep CNN model in the application of HSI classification. The seven different optimizers used in this study are SGD, Adagrad, Adadelta, RMSprop, Adam, AdaMax, and Nadam. Extensive experimental results on four hyperspectral remote sensing data sets have been presented which demonstrate the superiority of the presented deep CNN model with Adam optimizer for HSI classification. 相似文献
With recent advance in Earth Observation techniques, the availability of multi-sensor data acquired in the same geographical area has been increasing greatly, which makes it possible to jointly depict the underlying land-cover phenomenon using different sensor data. In this paper, a novel multi-attentive hierarchical fusion net (MAHiDFNet) is proposed to realize the feature-level fusion and classification of hyperspectral image (HSI) with Light Detection and Ranging (LiDAR) data. More specifically, a triple branch HSI-LiDAR Convolutional Neural Network (CNN) backbone is first developed to simultaneously extract the spatial features, spectral features and elevation features of the land-cover objects. On this basis, hierarchical fusion strategy is adopted to fuse the oriented feature embeddings. In the shallow feature fusion stage, we propose a novel modality attention (MA) module to generate the modality integrated features. By fully considering the correlation and heterogeneity between different sensor data, feature interaction and integration is released by the proposed MA module. At the same time, self-attention modules are also adopted to highlight the modality specific features. In the deep feature fusion stage, the obtained modality specific features and modality integrated features are fused to construct the hierarchical feature fusion framework. Experiments on three real HSI-LiDAR datasets demonstrate the effectiveness of the proposed framework. The code will be public on https://github.com/SYFYN0317/-MAHiDFNet. 相似文献
Hyperspectral images contain rich spatial and spectral information, which provides a strong basis for distinguishing different land-cover objects. Therefore, hyperspectral image (HSI) classification has been a hot research topic. With the advent of deep learning, convolutional neural networks (CNNs) have become a popular method for hyperspectral image classification. However, convolutional neural network (CNN) has strong local feature extraction ability but cannot deal with long-distance dependence well. Vision Transformer (ViT) is a recent development that can address this limitation, but it is not effective in extracting local features and has low computational efficiency. To overcome these drawbacks, we propose a hybrid classification network that combines the strengths of both CNN and ViT, names Spatial-Spectral Former(SSF). The shallow layer employs 3D convolution to extract local features and reduce data dimensions. The deep layer employs a spectral-spatial transformer module for global feature extraction and information enhancement in spectral and spatial dimensions. Our proposed model achieves promising results on widely used public HSI datasets compared to other deep learning methods, including CNN, ViT, and hybrid models. 相似文献
We present a registration and fusion method of fluorescein fundus angiography image and color fundus image which combines Nonsubsampled Contourlet (NSCT) and adaptive Pulse Coupled Neural Network (PCNN). Firstly, we register two images by Speeded Up Robust Features (SURF) feature points, the nearest neighbor and the next nearest neighbor distance ratio method to eliminate the spatial difference between the source images. Secondly, we use Random Sample Consensus (RANSAC) algorithm to achieve precise matching of feature points. Then, according to the transformation parameters obtained by RANSAC algorithm, we perform spatial transformation on the floating image to complete the registration. Finally, we obtain the low-frequency sub-band and high-frequency sub-band of the image to be fused by NSCT decomposition. The low-frequency sub-band is fused by the regional energy. The high-frequency sub-bands are studied using a simplified-PCNN model and the Particle Swarm Optimization algorithm. The link strength of the simplified-PCNN is an improved Laplacian energy and the images are fused based on the number of times the pixels are ignited. The proposed method has higher average gradient (AG) value and information entropy (IE) value and lower relative global dimensional synthesis error (ERGAS) than the existing fusion methods of the fundus image. The fusion image can accurately synthesize the image information, clarify the performance of the details, and has better spectral quality in the spectral range. The image of fused provides an effective reference for the clinical diagnosis of fundus diseases.
Hyperspectral image (HSI) classification is a very active research topic in remote sensing and has numerous potential applications. This paper presents a simple but effective classification method based on spectral-spatial information and K-nearest neighbor (KNN). To be specific, we propose a spectral-spatial KNN (SSKNN) method to deal with the HSI classification problem, which effectively exploits the distances all neighboring pixels of a given test pixel and training samples. In the proposed SSKNN framework, a set-to-point distance is exploited based on least squares and a weighted KNN method is used to achieve stable performance. By using two standard HSI benchmark, we evaluate the proposed method by comparing it with eight competing methods. Both qualitative and quantitative results demonstrate our SSKNN method achieves better performance than other ones. 相似文献
In this paper, we propose a novel residual fusion classification method for hyperspectral image using spatial–spectral information, abbreviated as RFC-SS. The RFC-SS method first uses the Gabor texture features and the non-parametric weighted spectral features to describe the hyperspectral image from both aspects of spatial and spectral information. Then it applies the residual fusion method to save the useful information from different classification methods, which can greatly improve the classification performance. Finally, the test sample is assigned to the class that has the minimal fused residuals. The RFC-SS classification method is tested on two classical hyperspectral images (i.e. Indian Pines, Pavia University). The theoretical analysis and experimental results demonstrate that the RFC-SS classification method can achieve a better performance in terms of overall accuracy, average accuracy, and the Kappa coefficient when compared to the other classification methods. 相似文献
A novel methodology based on multiscale spectral and spatial information fusion using wavelet transform is proposed in order to classify very high resolution (VHR) satellite imagery. Conventional wavelet‐based feature extraction methods employ single windows of a fixed size, which are not satisfactory as the VHR imagery contains complex and multiscale objects. In this paper, spectral and spatial features are extracted based on a set of concentric windows around a central pixel in order to integrate the information across different windows/scales. The proposed method is made up of three blocks: (1) the conventional wavelet‐based feature extraction methods are extended from single band processing to multispectral bands, and from single window to multi‐windows, (2) two multiscale fusion algorithms are proposed to exploit the multiscale spectral and spatial information and (3) a support vector machine (SVM), a relatively new method of machine learning, is used to classify the multiscale spectral–spatial feature sets. The proposed classification method is evaluated on two VHR datasets and the results show that the multiscale approach can improve the classification accuracy in homogeneous areas while simultaneously preserving accuracy in edge regions. 相似文献