首页 | 本学科首页   官方微博 | 高级检索  
     

基于空间与光谱注意力的光学图像和SAR图像特征融合分类方法
引用本文:姜文, 潘洁, 朱金彪, 岳昔娟. 基于空间与光谱注意力的光学图像和SAR图像特征融合分类方法[J]. 电子与信息学报, 2023, 45(3): 987-995. doi: 10.11999/JEIT220063
作者姓名:姜文  潘洁  朱金彪  岳昔娟
作者单位:1.中国科学院空天信息创新研究院 北京 100094;2.西北工业大学 西安 710072
摘    要:针对多源遥感图像的差异性和互补性问题,该文提出一种基于空间与光谱注意力的光学图像和SAR图像特征融合分类方法。首先利用卷积神经网络分别进行光学图像和SAR图像的特征提取,设计空间注意力和光谱注意力组成的注意力模块分析特征重要程度,生成不同特征的权重进行特征融合增强,同时减弱对无效信息的关注,从而提高光学和SAR图像融合分类精度。通过在两组光学和SAR图像数据集上进行对比实验,结果表明所提方法取得更高的融合分类精度。

关 键 词:SAR图像   深度学习   特征融合   注意力机制
收稿时间:2022-01-13
修稿时间:2022-05-28

Feature Fusion Classification for Optical Image and SAR Image Based on Spatial-spectral Attention
JIANG Wen, PAN Jie, ZHU Jinbiao, YUE Xijuan. Feature Fusion Classification for Optical Image and SAR Image Based on Spatial-spectral Attention[J]. Journal of Electronics & Information Technology, 2023, 45(3): 987-995. doi: 10.11999/JEIT220063
Authors:JIANG Wen  PAN Jie  ZHU Jinbiao  YUE Xijuan
Affiliation:1. Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China;2. Northwestern Polytechnical University, Xi’an 710072, China
Abstract:Considering the issue of difference and complementarity of multi-source remote sensing images, this paper proposes a feature fusion classification method for optical image and SAR image based on spatial-spectral attention. Firstly, features of optical image and SAR image are extracted by the convolutional neural network, and an attention module composed of spatial attention and spectral attention is designed to analyze the importance of features. Features can be enhanced by the weights of the attention module, which can reduce the attention to irrelevant information, and thus improve the accuracy of fusion classification for optical and SAR images. Experimental results on two datasets of optical image and SAR image demonstrate that the proposed method is able to yield higher fusion classification accuracy.
Keywords:SAR image  Deep learning  Feature fusion  Attention mechanism
点击此处可从《电子与信息学报》浏览原始摘要信息
点击此处可从《电子与信息学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号