Interactive mixed reality white cane simulation for the training of the blind and the visually impaired

This paper presents a mixed reality tool developed for the training of the visually impaired based on haptic and auditory feedback. The proposed approach focuses on the development of a highly interactive and extensible Haptic Mixed Reality training system that allows visually impaired to navigate into real size Virtual Reality environments. The system is based on the use of the CyberGrasp™ haptic device. An efficient collision detection algorithm based on superquadrics is also integrated into the system so as to allow real time collision detection in complex environments. A set of evaluation tests is designed in order to identify the importance of haptic, auditory and multimodal feedback and to compare the MR cane against the existing Virtual Reality cane simulation system.     

电脑三维动画造型设计教学研究

随着科学技术的进步,出现了运用计算机及专门软件设计制作模拟立体影像效果的三维动画形式。在虚拟三维中能够轻松的模拟各种形态及物体的质感,为动画技术开拓了一个全新的动画视觉艺术领域。三维动画主要依赖计算机图像生成技术(简称CG)。因此称计算机动画,1995年第一部完全由制作的动画电影《玩具总动员》诞生以来,电脑三维动画日新月异,三维动画是科学技术与艺术有着密切关系的动画形式,同时对未来的动画创作提出了新的要求。     

分布式虚拟现实仿真系统的时间同步研究

分析了现有分布交互式仿真系统的一些同步方法的特点及其应用于分布式虚拟现实仿真系统的 局限性,并提出了一种自适应调整仿真时钟推进速率的时间同步方法．最后将该方法应用于某石化企业的虚 拟现实仿真系统,证明了其有效性．     

基于视觉的增强现实技术研究综述

增强现实技术是当前计算机视觉领域中的热点问题之一,本文系统综述了基于视觉的增强现实 技术的研究现状．首先,对基于视觉的增强现实技术的研究现状进行了概述;其次,详细地阐述了该领域目 前出现的新技术,包括三维注册技术、摄像机标定技术、跟踪技术、虚实光照的一致性以及AR 实空间建模技 术,继而论述了该领域在研究中存在的问题,并对该领域中需要进一步解决的问题进行了讨论;最后,对增 强现实技术的进一步研究进行了展望．     

虚拟现实技术及建筑设计方案优化

虚拟现实是计算机领域的一门新兴技术。虚拟现实技术是一项综合性建筑设计方法,能够减轻设计人员的劳动强度、缩短设计周期、提高设计质量、节省投资。本文首先介绍了虚拟现实技术的基本概念,重点阐述了虚拟现实技术在建筑设计方案优化中的重要作用,旨在为建筑方案的优化设计提供依据。     

一种基于非线性弹簧模型的虚拟手交互新方法

基于虚拟手的交互技术在人机交互和人机工程学测试等应用中发挥着重要的作用。为了实现直观自然、实时准确、接近真实世界中的虚拟手与虚拟物体的交互,并计算出反馈作用力,首先提出了用非线性弹簧模型计算抓取作用力,使虚拟手和虚拟环境之间实现了基于物理的交互;然后将计算结果以视觉渲染的形式反馈给用户,并对仿真的速率做了定量分析,以便使仿真速率可以达到屏幕刷新频率和力反馈刷新频率的要求。实验结果表明,虚拟手不仅可以直观自然地抓取3维虚拟物体,而且和3维物体之间能够进行实时交互,同时可计算出反馈作用力。     

基于标志点注册及探测球的光源追踪算法

增强现实系统中,解决虚拟物体表面光照情况与真实环境匹配问题关键的一步是进行光源追踪。基于标志点注册及具有漫反射特性的探测球提出一种光源追踪算法。该算法仅对一幅被单一光源照射的标志立方体和探测球图像进行分析,利用图中标志点确定探测球相对照相机的位置、姿态关系,利用探测球表面的亮度信息推算光源向量。该探测球图像要进行一系列图像处理程序,其中等亮度线的提取及拟合是关键步骤。实验结果表明,本文算法能够达到预期效果,较好地实现了光源追踪,适用于各种位置的单一光源照射情况及基于标志点注册的增强现实系统。     

Improving pedestrians’ navigation safety at night by enhancing legibility of foreground and background information on the display

Traffic intersections are dangerous areas for pedestrians at night, primarily when people use their mobile phones while walking; pedestrians’ line of sight switches between their phones and the environment, which causes inattentional blindness during emergencies. The salience of the foreground and background information is different by the lightness conditions; therefore, identifying the lightness level of the foreground and background is critical. In this study, the brightness of urban traffic intersection scenes in the nighttime was analyzed, and improved color tones of the navigation interface for enhancing information recognition were identified. Moreover, identify the balance of visual attention by adjusting lightness and color treatment between foreground and background information. A glance legibility experiment indicated that a warm color tone with contrast and gamma correction under a lighting value of 65 in the LAB color mode is the optimal recognition combination. The results of this study indicated that low gamma under high lighting effectively reduced glare-related distractions and resulted in the lowest error rate in background information recognition. This paper proposes increasing the visual attention of urban pedestrians during nighttime navigation through the balancing of the lighting of the foreground interface and the color treatment of the background. Navigating at nighttime can be safer when their attention toward the environment increases and decreases attention distraction.     

AR-based deep learning for real-time inspection of cable brackets in aircraft

In the process of aircraft assembly, there exist numerous and ubiquitous cable brackets that shall be installed on frames and subsequently need to be manually verified with CAD models. Such a task is usually performed by special operators, hence is time-consuming, labor-intensive, and error-prone. In order to save the inspection time and increase the reliability of results, many researchers attempt to develop intelligent inspection systems using robotic, AR, or AI technologies. However, there is no comprehensive method to achieve enough portability, intelligence, efficiency, and accuracy while providing intuitive task assistance for inspectors in real time. In this paper, a combined AR+AI system is introduced to assist brackets inspection in a more intelligent yet efficient manner. Especially, AR-based Mask R-CNN is proposed by skillfully integrating markerless AR into deep learning-based instance segmentation to generate more accurate and fewer region proposals, and thus alleviates the computation load of the deep learning program. Based on this, brackets segmentation can be performed robustly and efficiently on mobile devices such as smartphones or tablets. By using the proposed system, CAD model checking can be automatically performed between the segmented physical brackets and the corresponding virtual brackets rendered by AR in real time. Furthermore, the inspection results can be directly projected on the corresponding physical brackets for the convenience of maintenance. To verify the feasibility of the proposed method, experiments are carried out on a full-scale mock-up of C919 aircraft main landing gear cabin. The experimental results indicate that the inspection accuracy is up to 97.1%. Finally, the system has been deployed in the real C919 aircraft final-assembly workshop. The preliminary evaluation reveals that the proposed real-time AR-assisted intelligent inspection approach is effective and promising for large-scale industrial applications.     

A state-of-the-art survey on Augmented Reality-assisted Digital Twin for futuristic human-centric industry transformation

The combination of Augmented Reality (AR) and Digital Twin (DT) has begun to show its potential nowadays, leading to a growing research interest in both academia and industry. Especially under the current human-centric trend, AR embraces the potential to integrate operators into the new generation of Human Cyber–Physical System (HCPS), in which DT is a pillar component. Some review articles have focused on this topic and discussed the benefits of combining AR and DT, but all of them are limited to a specific domain. To fill the gap, this research conducts a state-of-the-art survey (till 17-July-2022) from the AR-assisted DT perspective across different sectors of the industrial field, covering a total of 118 selected publications. Firstly, application scenarios and functions of AR-assisted DT are summarized by following the engineering lifecycle, among which production process, service design, and Human–Machine Interaction (HMI) are hot topics. Then, improvements specifically brought by AR are analyzed according to three dimensions, namely virtual twin, hybrid twin, and cognitive twin, respectively. Finally, challenges and future perspectives of AR-assisted DT for futuristic human-centric industry transformation are proposed, including promoting product design, robotic-related works, cyber–physical interaction, and human ergonomics.