| 基于图像退化模型的红外与可见光图像融合方法 |
| |
| 引用本文： | 蒋一纯, 刘云清, 詹伟达, 朱德鹏. 基于图像退化模型的红外与可见光图像融合方法[J]. 电子与信息学报, 2022, 44(12): 4405-4415. doi: 10.11999/JEIT211112 |
| |
| 作者姓名： | 蒋一纯 刘云清 詹伟达 朱德鹏 |
| |
| 作者单位： | 长春理工大学电子信息工程学院 长春 130022 |
| |
| 基金项目： | 吉林省发展与改革委员会创新能力建设专项(2021C045-5) |
| |
| 摘 要： | 基于深度学习的红外与可见光图像融合算法依赖人工设计的相似度函数衡量输入与输出的相似度，这种无监督学习方式不能有效利用神经网络提取深层特征的能力，导致融合结果不理想。针对该问题，该文首先提出一种新的红外与可见光图像融合退化模型，把红外和可见光图像视为理想融合图像通过不同退化过程后产生的退化图像。其次，提出模拟图像退化的数据增强方案，采用高清数据集生成大量模拟退化图像供训练网络。最后，基于提出的退化模型设计了简单高效的端到端网络模型及其网络训练框架。实验结果表明，该文所提方法不仅拥有良好视觉效果和性能指标，还能有效地抑制光照、烟雾和噪声等干扰。
|
| 关 键 词： | 图像融合 深度学习 退化模型 数据增强 |
| 收稿时间： | 2021-10-11 |
| 修稿时间： | 2022-04-29 |
Infrared and Visible Image Fusion Method Based on Degradation Model |
| |
| JIANG Yichun, LIU Yunqing, ZHAN Weida, ZHU Depeng. Infrared and Visible Image Fusion Method Based on Degradation Model[J]. Journal of Electronics & Information Technology, 2022, 44(12): 4405-4415. doi: 10.11999/JEIT211112 |
| |
| Authors: | JIANG Yichun LIU Yunqing ZHAN Weida ZHU Depeng |
| |
| Affiliation: | School of Electronical and Information Engineering, Changchun University of Science and Technology, Changchun 130022, China |
| |
| Abstract: | Infrared and visible image fusion algorithms based on deep learning rely on artificially designed similarity functions to measure the similarity between input and output. The unsupervised learning method can not effectively utilize the ability of neural networks to extract deep features, resulting in unsatisfactory fusion results. Considering this problem, a new fusion degradation model of infrared and visible image is proposed in this paper, which regards infrared and visible images as the degraded images produced by ideal fusion images through mixed degradation processes. Secondly, a data enhancement scheme for simulating image degradation is proposed, and a large number of simulated degradation images are generated by using high-definition datasets for training the network. Finally, a simple and efficient end-to-end network model and its network training framework are designed based on the proposed degradation model. The experimental results show that the method proposed in this paper not only has good visual effects and performance indicators, but also can effectively suppress interferences such as illumination, smoke and noise. |
| |
| Keywords: | Image fusion Deep learning Degradation model Data augmentation |
|
| 点击此处可从《电子与信息学报》浏览原始摘要信息 |
|
点击此处可从《电子与信息学报》下载全文 |
|
