Robust 3D face capture using example-based photometric stereo |
| |
Authors: | Rafael FV Saracchini Jorge Stolfi Helena CG Leitão Gary A Atkinson Melvyn L Smith |
| |
Affiliation: | 1. Institute of Computing, State University of Campinas, Brazil;2. Institute of Computing, Federal Fluminense University, Brazil;3. Machine Vision Laboratory, University of the West England, United Kingdom |
| |
Abstract: | We show that using example-based photometric stereo, it is possible to achieve realistic reconstructions of the human face. The method can handle non-Lambertian reflectance and attached shadows after a simple calibration step. We use spherical harmonics to model and de-noise the illumination functions from images of a reference object with known shape, and a fast grid technique to invert those functions and recover the surface normal for each point of the target object. The depth coordinate is obtained by weighted multi-scale integration of these normals, using an integration weight mask obtained automatically from the images themselves. We have applied these techniques to improve the PhotoFace system of Hansen et al. (2010). |
| |
Keywords: | Photometric stereo Shape-from-shading 3D surface reconstruction Facial geometry capture Image processing |
本文献已被 ScienceDirect 等数据库收录! |