首页 | 本学科首页   官方微博 | 高级检索  
     

增强现实场景下基于稳态视觉诱发电位的机械臂控制系统
引用本文:陈玲玲, 陈鹏飞, 谢良, 许敏鹏, 徐登科, 闫慧炯, 罗治国, 闫野, 印二威. 增强现实场景下基于稳态视觉诱发电位的机械臂控制系统[J]. 电子与信息学报, 2022, 44(2): 496-506. doi: 10.11999/JEIT210465
作者姓名:陈玲玲  陈鹏飞  谢良  许敏鹏  徐登科  闫慧炯  罗治国  闫野  印二威
作者单位:1.河北工业大学人工智能与数据科学学院 天津 300130;;2.智能康复装置与检测技术教育部工程研究中心 天津 300130;;3.军事科学院国防科技创新研究院 北京 100071;;4.天津(滨海)人工智能创新中心 天津 300450;;5.天津大学 天津 300072;;6.中国铁道科学研究院通信信号研究所 北京 100081
基金项目:国家自然科学基金(61901505% 61703407% 62076250),河北省自然科学基金(F2021202021),国家创新平台开放基金(2019YJ192)
摘    要:目前脑控机械臂在医疗康复等多个领域展现出了宽广的应用前景,但也存在灵活性较差、使用者易疲劳等不足之处。针对上述不足,该文设计一套增强现实(AR)环境下基于稳态视觉诱发电位(SSVEP)的机械臂异步控制系统。利用滤波器组典型相关分析方法(FBCCA)实现对12个目标的识别;提出基于投票策略和差值预测的动态窗口,实现刺激时长的自适应调节;利用伪密钥实现机械臂异步控制,完成拼图任务。试验结果表明,动态窗口可以根据受试者状态自动调整刺激时长,离线平均准确度为(93.11±5.85)%,平均信息传输速率(ITR)为(59.69±8.11) bit·min–1。在线单次命令平均选择时间为2.18 s,有效地减轻受试者的视觉疲劳。每位受试者均能迅速完成拼图任务,证明了该人机交互方法的可行性。

关 键 词:脑机接口   机械臂   增强现实   动态窗口   异步控制
收稿时间:2021-05-25
修稿时间:2021-10-26

Control System of Robotic Arm Based on Steady-State Visual Evoked Potentials in Augmented Reality Scenarios
CHEN Lingling, CHEN Pengfei, XIE Liang, XU Minpeng, XU Dengke, YAN Huijiong, LUO Zhiguo, YAN Ye, YIN Erwei. Control System of Robotic Arm Based on Steady-State Visual Evoked Potentials in Augmented Reality Scenarios[J]. Journal of Electronics & Information Technology, 2022, 44(2): 496-506. doi: 10.11999/JEIT210465
Authors:CHEN Lingling  CHEN Pengfei  XIE Liang  XU Minpeng  XU Dengke  YAN Huijiong  LUO Zhiguo  YAN Ye  YIN Erwei
Affiliation:1. School of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300130, China;;2. Engineering Research Center of Intelligent Rehabilitation and Detecting Technology, Ministry of Education, Tianjin 300130, China;;3. National Innovation Institute of Defense Technology, Academy of Military Sciences China, Beijing 100071, China;;4. Tianjin Artificial Intelligence Innovation Center, Tianjin 300450, China;;5. Tianjin University, Tianjin 300072, China;;6. Institute of Communication and Signaling, Chinese Academy of Railway Sciences, Beijing 100081,China
Abstract:At present, brain-controlled robotic arms have shown broad application prospects in many fields such as medical rehabilitation, but they also have disadvantages such as poor flexibility and fatigue of users. In view of the above shortcomings, an asynchronous control system based on Steady-State Visual Evoked Potential (SSVEP) in an Augmented Reality (AR) environment is designed. A Filter Bank Canonical Correlation Analysis (FBCCA) is applied to identify 12 targets. A dynamic window based on voting strategy and difference prediction is proposed to adjust the stimulus duration adaptively. The robotic arm is asynchronously controlled by pseudo-key to complete the task of the Jigsaw Puzzle. The experimental results demonstrate that the dynamic window can automatically adjust the length of stimulation according to the state of subjects. The average offline accuracy is (93.11±5.85)%, the average offline ITR is (59.69±8.11) bit·min–1. The average selection time of an online single command is 2.18 s. It can reduce the visual fatigue of the subjects effectively. Each subject can accomplish the puzzle task quickly, which indicates the feasibility of this human-computer interaction method.
Keywords:Brain-Computer Interface (BCI)  Robotic arm  Augmented Reality (AR)  Dynamic window  Asynchronous control
本文献已被 万方数据 等数据库收录!
点击此处可从《电子与信息学报》浏览原始摘要信息
点击此处可从《电子与信息学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号