基于Realsense的手势识别与应用

为解决现有手势识别方法易受外部环境干扰和特征提取繁琐的问题,提出一种基于Intel Realsense技术的深度图像手势识别的方法。根据SR300捕获的深度图像中获取的手部关节点和手指的信息,对这22个关节点进行几何建模;采用关节等效距离和手指伸直程度的特征,实现手势识别;将该方法应用到机械臂机器人的人机交互中去,成功实现抓取杯子到嘴边喝水等动作。实验结果表明,该方法特征简单,识别率高,通用性强,具有较强的鲁棒性。

Gesture recognition and application based on Realsense

To solve the problem that the existing gesture recognition method is vulnerable to external environment disturbance and the feature extraction process is complex, a method of depth image gesture recognition based on Intel Realsense technology was proposed. Based on the information of the hand joints and fingers acquired in the depth image captured by the SR300, the geometrically model for the 22 joints was constructed. The features of joints equivalent distance and the degree of finger extension were used to achieve gesture recognition. The gesture recognition system was successfully used in a human-computer inte- raction of the arm robot to grab the cup to the mouth for drinking. Experimental results show that the proposed methods is rea- lized with characteristics of simple feature, high recognition rate, strong universality and strong robustness.