A system for synchronizing the nods of a CG character and a human using thermal image processing and a moving-average model

The purpose of this study was to develop a system for communication between a human and a computer generated (CG) character to make him or her more peaceful and cheerful. Nonverbal communication using such things as facial expression, a nod, or a hand gesture is very important for reciprocal communication between humans. In this study, an image registered by infrared rays which describes the thermal distribution of the face and neck has been used to develop a system for communication between a human and a CG character. The CG character can synchronize its nod with a person’s nod by predicting his or her nod angle. The measured feature parameter is input to a fuzzy algorithm system to obtain the nod angle of a person in front of an infrared camera, and then a moving-average model is used to predict the nod angle of the person. The average error of the nod angle obtained by the system has been estimated as about 5°. The CG character nods its head, not only when the human nods his or her head, but also when the human shakes his or her head to the left or right.