Interactive online learning

This paper describes a system for visual object recognition based on mobile augmented reality gear. The user can train the system to the recognition of objects online using advanced methods of interaction with mobile systems: Hand gestures and speech input control “virtual menus,” which are displayed as overlays within the camera image. Here we focus on the underlying neural recognition system, which implements the key requirement of an online trainable system—fast adaptation to novel object data. The neural three-stage architecture can be adapted in two modes: In a fast training mode (FT), only the last stage is adapted, whereas complete training (CT) rebuilds the system from scratch. Using FT, online acquired views can be added at once to the classifier, the system being operational after a delay of less than a second, though still with reduced classification performance. In parallel, a new classifier is trained (CT) and loaded to the system when ready. The text was submitted by the authors in English. Gunther Heidemann was born in 1966. He studied physics at the Universities of Karlsruhe and Münster and received his PhD (Eng.) from Bielefeld University in 1998. He is currently working within the collaborative research project “Hybrid Knowledge Representation” of the SFB 360 at Bielefeld University. His fields of research are mainly computer vision, robotics, neural networks, data mining, bonification, and hybrid systems. Holger Bekel was born in 1970. He received his BS degree from the University of Bielefeld, Germany, in 1997. In 2002 he received a diploma in Computer Science from the University of Bielefeld. He is currently pursuing a PhD program in Computer Science at the University of Bielefeld, working within the Neuroinformatics Group (AG Neuroinformatik) in the project VAMPIRE (Visual Active Memory Processes and Interactive Retrieval). His fields of research are active vision and data mining. Ingo Bax was born in 1976. He received a diploma in Computer Science from the University of Bielefeld in 2002. He is currently pursuing a PhD program in Computer Science at the Neuroinformatics Group of the University of Bielefeld, working within the VAMPIRE project. His fields of interest are cognitive computer vision and pattern recognition. Helge J. Ritter was born 1958. He studied physics and mathematics at the Universities of Bayreuth, Heidelberg and Munich. After a PhD in physics at Technical University of Munich in 1988, he visited the Laboratory of Computer Science at Helsinki University of Technology and the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Since 1990 he has headed the Neuroinformatics Group at the Faculty of Technology, Bielefeld University. His main interests are principles of neural computation and their application to building intelligent systems. In 1999, she was awarded the SEL Alcatel Research Prize, and in 2001, the Leibniz Prize of the German Research Foundation DFG.