面向儿童的多通道交互系统

设计和实现了一个基于笔和语音的面向儿童的多通道三维交互系统.系统中包含了基于笔和语音的交互信息整合框架,用来整合儿童输入的笔和语音信息.同时,系统中定义了一些基于笔和语音的交互技术,可以支持孩子们以自然的方式,通过笔和语音同系统进行交互.用笔来勾画三维的场景和小动物等实体,同时用笔和语音同场景和场景中的实体进行一定的交互.

A Multimodal Interaction System for Children

A pen/speech multimodal interaction system for children is designed and implemented in this paper. The system contains an integration framework used to integrate the information input by children from pen and speech. Children can communicate with the computer in a natural way via the support of several pen/speech interaction techniques, which are defined by the system. Children can draw 3D scenes and creative animals through the use of pen and communicate with the scene and the entity via pen and speech detection.