首页 | 本学科首页   官方微博 | 高级检索  
     

改进SSD算法在中国手语识别上的应用
引用本文:周舟,韩芳,王直杰.改进SSD算法在中国手语识别上的应用[J].计算机工程与应用,2021,57(3):156-161.
作者姓名:周舟  韩芳  王直杰
作者单位:东华大学 信息科学与技术学院,上海 201620
基金项目:国家自然科学基金;中央高校基本科研业务费专项和东华大学"励志计划"
摘    要:基于计算机视觉的手语识别技术能为聋校双语教学带来很大的便利。近年来,随着深度学习技术的蓬勃发展,手语识别的准确率和速度有了极大的提高。与使用颜色标记和外界技术(如Kinect手心定位技术)的方法不同,提出一种改进的SSD(Single-Shot Multibox Detector)网络,对手势进行目标检测完成中国手语识别。针对手部小目标,将SE-Net嵌入SSD中的特征层进行通道权重分配,改进损失函数更好地应对正负样本不均衡问题,使用mixup进行数据增强,将手势识别结果在中国手语关键手势模板库中进行匹配,从而完成动态手语识别。实验证明,该算法在手语识别上具有较高的准确率和识别速度。

关 键 词:中国手语识别  目标检测  通道权重分配  数据增强  

Application of Improved SSD Algorithm in Chinese Sign Language Recognition
ZHOU Zhou,HAN Fang,WANG Zhijie.Application of Improved SSD Algorithm in Chinese Sign Language Recognition[J].Computer Engineering and Applications,2021,57(3):156-161.
Authors:ZHOU Zhou  HAN Fang  WANG Zhijie
Affiliation:School of Information Science and Technology, Donghua University, Shanghai 201620, China
Abstract:The sign language recognition technology based on computer vision can bring great convenience to bilingual teaching in schools. In recent years, with the rapid development of deep learning technology, the accuracy and detection speed of sign language recognition has also been greatly improved. Different from the method of using color marking and external technology(such as Kinect’s palm positioning technology), an improved SSD(Single-Shot Multibox Detector) network is proposed to perform target detection on gestures to complete Chinese sign language recognition. For the small target of the hand, SE-Net is embedded in the feature layer of SSD for channel weight distribution, the loss function is improved to better resolve the imbalance of positive and negative sample, and data argument is carried out by mixup. Then the recognition result will be matched with the sign language key gesture template library of China. Experiments verify that the proposed algorithm has higher recognition rate and speed in sign language recognition.
Keywords:Chinese sign language recognition  object detection  channel weight distribution  data enhancement  
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机工程与应用》浏览原始摘要信息
点击此处可从《计算机工程与应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号