移动环境下神经功能评价多通道交互模型

随着平板电脑、智能手机、智能手表等智能移动设备的普及，利用便携的智能移动设备随时随地进行健康评价受到了国内外学者的广泛关注.人机交互特有的多通道、交互式、人机协同的计算能够有效地提高移动环境下神经功能评价的准确度.然而，目前很少有研究对人机交互在这一应用场景上发挥的作用进行过充分讨论，更没有形成统一的多通道交互模型.为此，首先分析了目前移动设备上主流的神经功能评价方法，归纳总结出了一套适用该应用场景的交互原语和交互任务.然后，在此基础上提出了移动环境下神经功能评价多通道人机交互模型——MINA（multimodal human-computer interaction model for nerve function assessment in mobile environment)，并对该模型的移动医学评价和多通道融合特点进行了分析.最后，依据此模型给出神经系统疾病检测的应用实例.实践证明，MINA能够较好地指导交互式神经功能评价应用的设计和开发，多通道融合的方式能够有效地提高医学评价的准确度.

Multimodal Human-Computer Interaction Model for Nerve Function Assessment in Mobile Environment

With the growing popularity of smart mobile devices such as tablet PCs, smart phones and smart watches, the use of portable smart mobile devices in health evaluation has received extensive attention of scholars at home and abroad. The characteristics of multimodal, interactive and collaborative computing in human-computer interaction (HCI) can effectively improve the accuracy of nerve function assessment. However, little research has been done on the important role of human computer interaction in medical assessment, and no model of nerve function assessment in mobile environment has been established. Therefore, this paper firstly analyzes the mainstream method of nerve function assessment in mobile environment, and summarizes a set of interaction primitives and interaction tasks for the application on this scenario. Then it proposes a multimodal human-computer interaction model for nerve function assessment in mobile environment:MINA, and analyzes the characteristics of mobile health assessment and multimodal fusion in MINA. Finally, one application that builds on MINA has been demonstrated. The practice shows that MINA can better guide the development of interactive nerve assessment applications, and the multimodal fusion can effectively improve the accuracy of medical assessment.