Object-spatial layout-route based hybrid map and global localization for mobile robots

This paper presents new object-spatial layout-route based hybrid map representation and global localization approaches using a stereo camera. By representing objects as high-level features in a map, a robot can deal more effectively with different contexts such as dynamic environments, human-robot interaction, and semantic information. However, the use of objects alone for map representation has inherent problems. For example, it is difficult to represent empty spaces for robot navigation, and objects are limited to readily recognizable things. One way to overcome these problems is to develop a hybrid map that includes objects and the spatial layout of a local space. The map developed in this research has a hybrid structure that combines a global topological map and a local hybrid map. The topological map represents the spatial relationships between local spaces. The local hybrid map combines the spatial layout of the local space with the objects found in that space. Based on the proposed map, we suggest a novel coarse-to-fine global localization method that uses object recognition, point cloud fitting and probabilistic scan matching. This approach can accurately estimate robot pose with respect to the correct local space. Recommended by Editor Jae-Bok Song. This research was performed for the Intelligent Robotics Development Program, one of the 21st Century Frontier R&D Programs funded by the Ministry of Knowledge Economy of Korea. Soonyong Park received the B.S. and M.S. degrees from the Department of Mechanical Engineering, Kyunghee University, Seoul, Korea, in 2001 and 2003, respectively. He is currently working toward the Ph.D. degree in the Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Korea. Since 2001, he has been a student researcher in the Center for Cognitive Robotics Research, Korea Institute of Science and Technology (KIST), Seoul, Korea. His research interests include mobile robot navigation and computer vision. Mignon Park received the B.S. and M.S. degrees in Electronics from Yonsei University, Seoul, Korea, in 1973 and 1977, respectively. He received the Ph.D. degree in University of Tokyo, Japan, 1982. He was a researcher with the Institute of Biomedical Engineering, University of Tokyo, Japan, from 1972 to 1982, as well as at the Massachusetts Institute of Technology, Cambridge, and the University of California Berkeley, in 1982. He was a visiting researcher in Robotics Division, Mechanical Engineering Laboratory, Ministry of International Trade and Industry, Tsukuba, Japan, from 1986 to 1987. He has been a Professor in the Department of Electrical and Electronic Engineering in Yonsei University, since 1982. His research interests include fuzzy control and application, robotics, and fuzzy biomedical system. Sung-Kee Park is a principal research scientist for Korea Institute of Science and Technology (KIST). He received the B.S. and M.S. degrees in Mechanical Design and Production Engineering from Seoul National University, Seoul, Korea, in 1987 and 1989, respectively. He received the Ph.D. degree (2000) from Korea Advanced Institue of Science and Technology (KAIST), Korea, in the area of computer vision. Since then, he has been working for the center for cognitive robotics research at KIST. During his period at KIST, he held a visiting position at the Robotics Institute of Carnegie Mellon University in 2005, where he did research on object recognition. His recent work has been on cognitive visual processing, object recognition, visual navigation, and human-robot interaction.