Combining natural language with direct manipulation: the conceptual framework for a hybrid human-computer interface

This paper describes the development of a conceptual model of an interaction system for future human-computer interaction. It is suggested that an integrated system is the most promising solution for diverse users and tasks. A ' hybrid interaction system' is considered, which tries to efficiently direct manipulation, menu selection, and natural language. The mechanism of the natural language interface module is described in more detail. Finally, the allocation of functionalities for generalized tasks on the conceptual model is considered from the taxonomic approach.