| Abstract: | In this paper, a facial animation system is proposed for capturing both geometrical information and illumination changes of
surface details, called expression details, from video clips simultaneously, and the captured data can be widely applied to
different 2D face images and 3D face models. While tracking the geometric data, we record the expression details by ratio
images. For 2D facial animation synthesis, these ratio images are used to generate dynamic textures. Because a ratio image
is obtained via dividing colors of an expressive face by those of a neutral face, pixels with ratio value smaller than one
are where a wrinkle or crease appears. Therefore, the gradients of the ratio value at each pixel in ratio images are regarded
as changes of a face surface, and original normals on the surface can be adjusted according to these gradients. Based on this
idea, we can convert the ratio images into a sequence of normal maps and then apply them to animated 3D model rendering. With
the expression detail mapping, the resulted facial animations are more life-like and more expressive.
Pei-Hsuan Tu is currently a software engineer at Cyber-Link Corporation. She received the B.S. degree in computer science from “National
Chung-Cheng University” in 2001, and M.S. degree in computer science from “National Taiwan University” in 2003. Her research
interests include computer graphics and image processing. She is a member of IEEE and IEEE Computer Society.
I-Chen Lin received the B.S. and Ph.D. degrees in computer science from “National Taiwan University”. His research interests include
computer graphics, computer animation and motion tracking. He is a member of ACM SIGGRAPH, IEEE, and IEEE Computer Society.
Jeng-Sheng Yeh received a B.S. degree in computer science from “National Taiwan University” and is currently a Ph.D. candidate in “National
Taiwan University”. His research interests include computer graphics, computer user interface, and 3D protein retrieval. He
is a member of ACM SIGGRAPH.
Rung-Huei Liang is a post doctoral researcher at the Communication and Multimedia Laboratory at “National Taiwan University”. His research
interests include facial/gesture recognition and virtual reality applications. He received the B.S. and Ph.D. degrees in computer
science from “National Taiwan University”.
Ming Ouhyoung is a professor of Dept. Computer Science and Information Engineering at “National Taiwan University”. His research interests
include computer graphics, virtual reality, and multimedia systems. He received the B.S. and M.S. degrees in electrical engineering
from “National Taiwan University” and a Ph.D. degree in computer science from the University of North Carolina at Chapel Hill.
He is a member of IEEE and ACM. |
