Manifold Constrained Transfer of Facial Geometric Knowledge for 3D Caricature Reconstruction |
| |
Authors: | Jun-Fa Liu Wen-Jing He Tao Chen Yi-Qiang Chen |
| |
Affiliation: | 1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;Beijing Key Laboratory of Mobile Computing and Pervasive Device, Beijing 100190, China 2. Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;Beijing Key Laboratory of Mobile Computing and Pervasive Device, Beijing 100190, China;University of Chinese Academy of Sciences, Beijing 100049, China 3. School of Electronic Information and Automation, Chongqing University of Technology, Chongqing 400054, China |
| |
Abstract: | 3D caricatures are important attractive elements of the interface in virtual environment such as online game. However, very limited 3D caricatures exist in the real world. Meanwhile, creating 3D caricatures manually is rather costly, and even professional skills are needed. This paper proposes a novel and effective manifold transfer algorithm to reconstruct 3D caricatures according to their original 2D caricatures. We first manually create a small dataset with only 100 3D caricature models and use them to initialize the whole 3D dataset. After that, manifold transfer algorithm is carried out to refine the dataset. The algorithm comprises of two steps. The first is to perform manifold alignment between 2D and 3D caricatures to get a “standard” manifold map; the second is to reconstruct all the 3D caricatures based on the manifold map. The proposed approach utilizes and transfers knowledge of 2D caricatures to the target 3D caricatures well. Comparative experiments show that the approach reconstructs 3D caricatures more effectively and the results conform more to the styles of the original 2D caricatures than the Principal Components Analysis (PCA) based method. |
| |
Keywords: | 3D reconstruction caricature machine learning manifold transfer |
本文献已被 CNKI 万方数据 SpringerLink 等数据库收录! |
|