手指书写:一种虚拟文字识别人机交互新方法

本文提出了一种全新的手指书写虚拟文字识别系统,该系统利用摄像头捕捉人手指的运动轨迹,通过手指跟踪及检测算法,恢复出手指虚拟"书写"文字的二维图像数据(称之为虚拟文字),再进行识别输出.文中对单层函数连接神经网络进行改进并用来进行高准确度的运动手指尖的预测及跟踪,给出了一种基于数学形态学及模板匹配的简单有效的手指检测方法,提出了基于运动手指跟踪的"虚拟文字"恢复方法.实验结果表明:系统方案可行,手指跟踪及检测准确率高,对手指"书写"的数字、英文等虚拟文字识别率能达到95％以上.

Finger Writing:A Novel Virtual Character Recognition HCI Approach

A virtual character recognition system based on finger tracking is proposed.By capturing the finger movement with a digital camera and tracking the finger-tip position automatically,the 2-D character image(virtual character trajectory) "written" by finger-tip is reconstructed and recognized.A modified flat functional link neural network is used to predict and track the moving position of the finger-tip.A mathematical morphology and template matching based finger-tip detection approach is proposed,and an algorithm to reconstruct and recognize the virtual character is given.Experiments show that the proposed system works very well with high finger tracking and detection accuracy,and achieves more than 95% accuracy rate for virtual digital and English letters recognition.