以图像为主的多模态感知与多源融合技术发展及应用综述 |
| |
引用本文: | 何赟泽,谯灵俊,郭隆强,常 珊,刘圳康,周 辉,王洪金. 以图像为主的多模态感知与多源融合技术发展及应用综述[J]. 测控技术, 2023, 42(6): 10-21 |
| |
作者姓名: | 何赟泽 谯灵俊 郭隆强 常 珊 刘圳康 周 辉 王洪金 |
| |
作者单位: | 湖南大学 电气与信息工程学院机器人视觉感知与控制技术国家工程研究中心 |
| |
基金项目: | 湖南省自然科学基金重大项目(2021JC0004);湖南省自然科学基金杰出青年基金项目(2022JJ10017) |
| |
摘 要: | 不同模态的表现方式不同,描述目标的角度也会不同。多模态感知与多源融合技术是将两种或两种以上的模态组合起来,融合不同传感器、不同平台收集到的数据、特征信息,兼顾不同图像的优势,在遥感监测、军事安防、自动驾驶等领域有着广泛的运用。介绍了热成像、高光谱成像、偏振成像、合成孔径雷达(SAR)、激光雷达(LiDAR)等多模态感知技术,总结了不同成像方式的特点与联系,简述了多源融合相关概念及其技术发展历程,重点分析了不同模态下图像融合案例,在此基础上归纳多模态感知和多源融合技术的发展趋势,最后基于融合算法、系统整体性、评价指标总结出进一步发展方向。
|
关 键 词: | 多模态感知 多源融合 跨模态 热成像 SAR LiDAR |
Survey on Development and Application of Image-Based Multi-Modal Perception and Multi-Source Fusion Technology |
| |
Abstract: | Different modes are represented in different ways,and the angle of describing the target will be different.Multi-modal perception and multi-source fusion technology combines two or more modes,integrates data and characteristic information collected by different sensors and different platforms,and takes into account the advantages of different images.It is widely used in remote sensing monitoring,military security,automatic driving and other fields.The multi-modal perception technologies such as thermal imaging,hyperspectral imaging,polarization imaging,synthetic aperture radar(SAR) and LiDAR are introduced,the characteristics and connections of different imaging methods are summarized,the concepts related to multi-source fusion and the development process of the technology are briefly described,and the image fusion cases under different modes are mainly analyzed.On this basis,the development trend of multi-modal perception and multi-source fusion technology is summarized.Finally,the further development direction is summarized in terms of fusion algorithm,system integrity and evaluation index. |
| |
Keywords: | multi-modal perception multi-source fusion cross-modal thermal imaging SAR LiDAR |
本文献已被 维普 等数据库收录! |
| 点击此处可从《测控技术》浏览原始摘要信息 |
|
点击此处可从《测控技术》下载全文 |
|