IMMIView: a multi-user solution for design review in real-time |
| |
Authors: | Ricardo Jota Bruno R de Araújo Luís C Bruno João M Pereira Joaquim A Jorge |
| |
Affiliation: | (1) VIMMI Group, Department of Computer Science and Engineering, INESC-ID, IST/Technical University of Lisbon, Rua Alves Redol, 9, 1000-029 Lisboa, Portugal |
| |
Abstract: | IMMIView is an interactive system that relies on multiple modalities and multi-user interaction to support collaborative design
review. It was designed to offer natural interaction in visualization setups such as large-scale displays, head mounted displays
or TabletPC computers. To support architectural design, our system provides content creation and manipulation, 3D scene navigation
and annotations. Users can interact with the system using laser pointers, speech commands, body gestures and mobile devices.
In this paper, we describe how we design a system to answer architectural user requirements. In particular, our system takes
advantage of multiple modalities to provide a natural interaction for design review. We also propose a new graphical user
interface adapted to architectural user tasks, such as navigation or annotations. The interface relies on a novel stroke-based
interaction supported by simple laser pointers as input devices for large-scale displays. Furthermore, input devices such
as speech and body tracking allow IMMIView to support multiple users. Moreover, they allow each user to select different modalities
according to their preference and modality adequacy for the user task. We present a multi-modal fusion system developed to
support multi-modal commands on a collaborative, co-located, environment, i.e. with two or more users interacting at the same
time, on the same system. The multi-modal fusion system listens to inputs from all the IMMIView modules in order to model
user actions and issue commands. The multiple modalities are fused based on a simple rule-based sub-module developed in IMMIView
and presented in this paper. User evaluation performed over IMMIView is presented. The results show that users feel comfortable
with the system and suggest that users prefer the multi-modal approach to more conventional interactions, such as mouse and
menus, for the architectural tasks presented. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|