Mixture reality-based assistive system for visually impaired people |
| |
| Affiliation: | 1. College of Electronic and Optical Engineering & College of Flexible Electronics (Future Technology), Nanjing University of Posts and Telecommunications, Nanjing 210023, China;2. State Key Laboratory of Luminescent Materials and Devices, South China University of Technology, Guangzhou 510641, China;1. State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China;2. School of Computer Science and Engineering, Beihang University, Beijing 100191, China;3. Schoolof Computer Scienceand Technology,Civil Aviation University of China, Tianjin 300300, China |
| |
| Abstract: | Individuals with visual impairments often face challenges in their daily lives, particularly in terms of independent mobility. To address this issue, we present a mixed reality-based assistive system for visually impaired individuals, which comprises a Microsoft Hololens2 device and a website and utilizes a simultaneous localization and mapping (SLAM) algorithm to capture various large indoor scenes in real-time. This system incorporates remote multi-person assistance technology and navigation technology to aid visually impaired individuals. To evaluate the effectiveness of our system, we conducted an experiment in which several participants completed a large indoor scene maintenance task. Our experimental results demonstrate that the system is robust and can be utilized in a wide range of indoor environments. Additionally, the system enhances environmental perception and enables visually impaired individuals to navigate independently, thus facilitating successful task completion. |
| |
| Keywords: | Mixed reality SLAM Navigation technology Visually impaired Assistive system |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
