首页 | 本学科首页   官方微博 | 高级检索  
     

基于相对生成对抗网络的低清小脸幻构
引用本文:邵文泽, 张苗苗, 李海波. 基于相对生成对抗网络的低清小脸幻构[J]. 电子与信息学报, 2021, 43(9): 2577-2585. doi: 10.11999/JEIT200362
作者姓名:邵文泽  张苗苗  李海波
作者单位:1.南京邮电大学通信与信息工程学院 南京 210003;;2.南京理工大学高维信息智能感知与系统教育部重点实验室 南京 210094
基金项目:国家自然科学基金 (61771250, 61972213, 11901299),中央高校基本科研业务费专项资金 (30918014108)
摘    要:针对当前代表性低清小脸幻构方法存在的视觉真实感弱、网络结构复杂等问题,提出了一种基于相对生成对抗网络的低清小脸幻构方法(tfh-RGAN).该文方法的网络架构包括幻构生成器和判别器两个部分,通过像素损失函数和相对生成对抗损失函数的联合最小化,实现生成器和判别器的交替迭代训练.其中,幻构生成器结合了残差块、稠密块以及深度...

关 键 词:图像处理  超分辨率  人脸幻构  深度学习  生成对抗网络
收稿时间:2020-05-08
修稿时间:2020-10-18

Tiny Face Hallucination via Relativistic Adversarial Learning
Wenze SHAO, Miaomiao ZHANG, Haibo LI. Tiny Face Hallucination via Relativistic Adversarial Learning[J]. Journal of Electronics & Information Technology, 2021, 43(9): 2577-2585. doi: 10.11999/JEIT200362
Authors:Wenze SHAO  Miaomiao ZHANG  Haibo LI
Affiliation:1. College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China;;2. Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, Nanjing University of Science and Technology, Nanjing 210094, China
Abstract:Considering that previous tiny face hallucination methods either produced visually less pleasant faces or required architecturally more complex networks, this paper advocates a new deep model for tiny face hallucination by borrowing the idea of Relativistic Generative Adversarial Network (tfh-RGAN). Specifically, a hallucination generator and a relativistic discriminator are jointly learned in an alternately iterative training fashion by minimizing the combined pixel loss and relativistic generative adversarial loss. As for the generator, it is mainly structured as concatenation of a few basic modules followed by three 2×up-sampling layers, and each basic module is formulated by coupling the residual blocks, dense blocks, and depthwise separable convolution operators. As such, the generator can be made lightweight while with a considerable depth so as to achieve high quality face hallucination. As for the discriminator, it makes use of VGG128 while removing all its batch normalization layers and embedding a fully connected layer additionally so as to fulfill the capacity limit of relativistic adversarial learning. Experimental results reveal that, the proposed method, though simpler in the network architecture without a need of explicitly imposing any face structural prior, is able to produce better hallucination faces with higher definition and stronger reality. In terms of the quantitative assessment, the peak signal-to-noise ratio of the proposed method can be improved up to 0.25~1.51 dB compared against several previous approaches.
Keywords:Image processing  Super-resolution  Face hallucination  Deep learning  Generative adversarial networks
点击此处可从《电子与信息学报》浏览原始摘要信息
点击此处可从《电子与信息学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号