虚实融合交互系统辅助脑卒中后失语症康复训练

脑卒中后失语症是一个普遍的致残性疾病.研究表明,虚拟现实及实物交互技术对该疾病的康复训练具有重要意义.然而现有的计算机辅助言语康复系统很少能将这2类技术有效结合并发挥它们各自的优势,且没有对言语训练素材进行合理编排以适应实际的康复训练需求.提出了一种虚实融合辅助的言语康复训练系统,构建了一个"超市购物"的虚拟场景,基于语义网络理论编排言语训练素材,实现了对操作实物的实时跟踪和识别;并将其映射到虚拟购物场景中,使得脑卒中后失语症患者可以通过对实物的操作去完成在虚拟空间的购物任务;患者在虚实融合辅助的言语康复训练系统中的任务完成时间和行为表现结果表明了系统的可用性,问卷调查结果表明,系统得到了康复治疗师的普遍认可,患者和治疗师在用户访谈中提出的多项建议对未来在这一方面的研究工作具有指导意义.

Rehabilitation of Aphasia after Stroke with Physical and Virtual Integrated System

Aphasia after stroke is a common disease.Studies indicated that virtual reality and tangible interactions can effectively assist rehabilitation of aphasia after stroke.However,few existing computer-assisted language training systems integrated the two methods and took the advantages of both successfully.Further,language training materials were not reasonably arranged to adapt the scenarios of aphasia rehabilitation in previous works.This paper presented a physical and virtual integrated language training system(PVLT)for the rehabilitation of aphasia after stroke.The developed training system composed of a virtual supermarket where language training materials are arranged based on a semantic network theory.Physical objects were tracked and recognized,and then integrated with the virtual supermarket to enable users to navigate the supermarket by manipulating physical objects.User performance of task completion time shows the usability of the system.Results of a questionnaire survey show that the system is appreciated by language therapists.The summarized user suggestions provide valuable insights to future research in this area.