以图像为主的多模态感知与多源融合技术发展及应用综述

不同模态的表现方式不同，描述目标的角度也会不同。多模态感知与多源融合技术是将两种或两种以上的模态组合起来，融合不同传感器、不同平台收集到的数据、特征信息，兼顾不同图像的优势，在遥感监测、军事安防、自动驾驶等领域有着广泛的运用。介绍了热成像、高光谱成像、偏振成像、合成孔径雷达(SAR)、激光雷达(LiDAR)等多模态感知技术，总结了不同成像方式的特点与联系，简述了多源融合相关概念及其技术发展历程，重点分析了不同模态下图像融合案例，在此基础上归纳多模态感知和多源融合技术的发展趋势，最后基于融合算法、系统整体性、评价指标总结出进一步发展方向。

Survey on Development and Application of Image-Based Multi-Modal Perception and Multi-Source Fusion Technology

Different modes are represented in different ways,and the angle of describing the target will be different.Multi-modal perception and multi-source fusion technology combines two or more modes,integrates data and characteristic information collected by different sensors and different platforms,and takes into account the advantages of different images.It is widely used in remote sensing monitoring,military security,automatic driving and other fields.The multi-modal perception technologies such as thermal imaging,hyperspectral imaging,polarization imaging,synthetic aperture radar(SAR) and LiDAR are introduced,the characteristics and connections of different imaging methods are summarized,the concepts related to multi-source fusion and the development process of the technology are briefly described,and the image fusion cases under different modes are mainly analyzed.On this basis,the development trend of multi-modal perception and multi-source fusion technology is summarized.Finally,the further development direction is summarized in terms of fusion algorithm,system integrity and evaluation index.