首页 | 本学科首页   官方微博 | 高级检索  
     

基于多尺度特征融合的人脸图像修复方法
引用本文:白宗文,弋婷婷,周美丽,魏嵬.基于多尺度特征融合的人脸图像修复方法[J].计算机工程,2021,47(5):213-220,228.
作者姓名:白宗文  弋婷婷  周美丽  魏嵬
作者单位:1. 延安大学 物理与电子信息学院, 陕西 延安 716000;2. 西安理工大学 计算机学院, 西安 710048
基金项目:延安大学科研计划;陕西省能源大数据智能处理重点实验室开放基金;陕西省自然科学基金;国家自然科学基金
摘    要:传统图像修复方法在修复受损区域较大的图像时会出现修复结果过于平滑或模糊的现象,并且较难重建合理的人脸图像结构。在传统生成对抗网络的鉴别器中引入多尺度特征融合方法,将不同深度的特征图经过上采样后直接相加,使浅层信息和深层信息有效结合。通过借助高层特征把握图像的整体规律,同时利用低层特征填充人脸图像的细节纹理,进而使一张图像的分辨率及其语义特征相互融合,实现有效的人脸图像修复。在CelebA数据集上的实验结果表明,该方法的峰值信噪比、相似性结构、L1损失指标均优于区域归一化方法,取得了较好的视觉效果。

关 键 词:图像修复  生成对抗网络  多尺度特征融合  鉴别器  高层特征  低层特征  
收稿时间:2020-11-18
修稿时间:2021-01-10

Face Image Inpainting Method Based on Multi-Scale Feature Fusion
BAI Zongwen,YI Tingting,ZHOU Meili,WEI Wei.Face Image Inpainting Method Based on Multi-Scale Feature Fusion[J].Computer Engineering,2021,47(5):213-220,228.
Authors:BAI Zongwen  YI Tingting  ZHOU Meili  WEI Wei
Affiliation:1. School of Physics and Electronic Information, Yan'an University, Yan'an, Shaanxi 716000, China;2. School of Computer Science and Engineering, Xi'an University of Technology, Xi'an 710048, China
Abstract:When dealing with severely corrupted images,the traditional image inpainting methods often produce blurry or too smooth regions in the restored images,and have difficulty in reconstructing a reasonable face image structure.To address the problem,this paper introduces a multi-scale feature fusion method into the discriminator of the traditional Generative Adversarial Network(GAN),which directly adds the upsampled feature maps of different depth to achieve effective fusion of shallow and deep information.Then this method grasps the overall pattern of the image with the help of high-level features,and fills the detail texture of the face image with low-level features,so that the resolution of the image can be fused with its semantic features for effective face image restoration.The experimental results on the dataset of CelebA show that the proposed method outperforms the regional normalization method in terms of Peak Signal to Noise Ratio(PSNR),structural similarity,L1 loss indicators,achieving ideal visual effects.
Keywords:image inpainting  Generative Adversarial Network(GAN)  multi-scale feature fusion  discriminator  high-level feature  low-level feature
本文献已被 维普 万方数据 等数据库收录!
点击此处可从《计算机工程》浏览原始摘要信息
点击此处可从《计算机工程》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号