Abstract: | This paper describes a real‐time word lip reading system. Although our system is based on a word lip reading method already proposed, this system adapts to the user facial movements that cannot be avoided in a real‐time process. With nine subjects, we obtained an average recognition rate of 89% for 14 Japanese words. Moreover, we carried out additional experiments with the system under various conditions, and verified the robustness and usefulness of our system. © 2011 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc. |