首页 | 本学科首页   官方微博 | 高级检索  
     

基于多尺度特征融合反投影网络的图像超分辨率重建
引用本文:孙超文,陈晓.基于多尺度特征融合反投影网络的图像超分辨率重建[J].自动化学报,2021,47(7):1689-1700.
作者姓名:孙超文  陈晓
作者单位:1.南京信息工程大学电子与信息工程学院 南京 210044
基金项目:江苏省333高层次人才培养工程项目(2625); 江苏高校优势学科建设工程资助项目资助
摘    要:针对现有图像超分辨率重建方法恢复图像高频细节能力较弱、特征利用率不足的问题, 提出了一种多尺度特征融合反投影网络用于图像超分辨率重建. 该网络首先在浅层特征提取层使用多尺度的卷积核提取不同维度的特征信息, 增强跨通道信息融合能力; 然后,构建多尺度反投影模块通过递归学习执行特征映射, 提升网络的早期重建能力; 最后,将局部残差反馈结合全局残差学习促进特征的传播和利用, 从而融合不同深度的特征信息进行图像重建. 对图像进行×2 ~ ×8超分辨率的实验结果表明, 本方法的重建图像质量在主观感受和客观评价指标上均优于现有图像超分辨率重建方法, 超分辨率倍数大时重建性能相比更优秀.

关 键 词:图像超分辨率重建    多尺度卷积    特征融合    反投影
收稿时间:2020-09-02

Multiscale Feature Fusion Back-projection Network for Image Super-resolution
Affiliation:1.School of Electronics and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 2100442.Jiangsu Collaborative Innovation Center for Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044
Abstract:Aiming at the problems that existing image super-resolution reconstruction methods have weak ability to restore image high-frequency details and insufficient feature utilization, a multi-scale feature fusion back projection network is proposed for image super-resolution reconstruction. The network first uses multi-scale convolution kernels in the shallow feature extraction layer to extract feature information of different dimensions to enhance cross-channel information fusion; then builds a multi-scale back projection module to perform feature mapping through recursive learning to improve the early reconstruction capabilities of the network; Finally, local residual feedback is combined with global residual learning to promote the spread and utilization of features, thereby fusing feature information of different depths for image reconstruction. The experimental results of ×2 ~ ×8 SR on the images show that the quality of SR image of this method is better than the existing image super-resolution method in subjective perception and objective evaluation index, and the reconstruction performance is relatively better when the scale factors is large.
Keywords:
点击此处可从《自动化学报》浏览原始摘要信息
点击此处可从《自动化学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号