结合边缘信息和门卷积的人脸修复算法

针对任意形状遮挡下人脸修复,现有方法容易产生边缘模糊和恢复结果失真等问题。提出了一种结合边缘信息和门卷积的人脸修复算法。首先,通过先验人脸知识产生遮挡区域的边缘图,以约束人脸修复过程。其次,利用门卷积在部分像素缺失下的精确局部特征描述能力,设计面向图像修复的门卷积深度生成对抗网络(GAN)。该模型由边缘连接生成对抗网络和图像修复生成对抗网络两部分组成。边缘连接网络利用二值遮挡图和待修复图像及其边缘图的多源信息进行训练,实现对缺失边缘图像的自动补全和连接。图像修复网络以补全的边缘图为引导信息,联合遮挡图像进行缺失区域修复。实验结果表明:相比其他算法,该算法修复效果更好,其评价指标比当前基于深度学习的图像修复算法更优。

Face Inpainting Algorithm Combining Edge Information with Gated Convolution

For the face inpainting under arbitrary shape occlusion,the existing methods are easy to produce edge blur and distortion of the inpainting results.In this paper,an algorithm for face inpainting combining edge information with gated convolution is proposed.Firstly,the edge image of occluded area is generated by prior face knowledge to constrain the process of face inpainting.Secondly,the gated convolution holds the ability to extract accurate local feature in the absence of some pixels,and a gated convolution-based generative adversarial network(GAN)for image inpainting is designed.The model consists of two parts:edge connection GAN and image inpainting GAN.The edge connection network uses the binary occlusion image,the image to be repaired and its edge image for training,and realizes the automatic completion and connection of the missing edge image.The image inpainting GAN takes the completed edge image as the guidance information,and combines the occlusion image to repair the missing area.The experimental results show that the inpainting effect of this algorithm is better than that of other algorithms,and its evaluation indicators are better than those of the current image inpainting algorithms based on deep learning.