Imitative Collaboration: A mirror-neuron inspired mixed reality collaboration method with remote hands and local replicas

Mixed reality can overlay and display 3D digital content in the real world, convey abstract concepts to users, and promote the understanding of complex tasks. However, the abstract graphics overlaid on the physical space may cause a certain cognitive load for local users and reduce the efficiency of collaboration. To improve the efficiency of remote collaboration, we conducted an elicitation study on assembly tasks, explored the user needs for collaboration, and defined the design goals of our remote collaboration method. Inspired by the mirror-neuron mechanism, we present an imitative collaboration method that allows local users to imitate the interaction behavior of remote users to complete tasks. We also propose a series of interaction methods for remote users to select, copy, and interact with the local point clouds to facilitate the expression of collaboration intentions. Finally, the results of a user study evaluating our imitative collaboration method on assembly tasks are reported, confirming that our method improves collaboration efficiency while reducing the cognitive load of local users.     

Cognitive and affective processes for learning science in immersive virtual reality

As immersive virtual reality (IVR) systems proliferate in classrooms, it is important to understand how they affect learning outcomes and the underlying affective and cognitive processes that may cause these outcomes. Proponents argue that IVR could improve learning by increasing positive affective and cognitive processing, thereby supporting improved performance on tests of learning outcome, whereas opponents of IVR contend that it could hurt learning by increasing distraction, thereby disrupting cognitive learning processes and leading to poorer learning outcomes. In a media comparison study, students viewed a biology lesson either as an interactive animated journey in IVR or as a slideshow on a desktop monitor. Those who viewed the IVR lesson performed significantly worse on transfer tests, reported higher emotional arousal, reported more extraneous cognitive load and showed less engagement based on EEG measures than those who viewed the slideshow lesson, with or without practice questions added to the lessons. Mediational analyses showed that the lower retention scores for the IVR lesson were related to an increase in self-reported extraneous cognitive load and emotional arousal. These results support the notion that immersive environments create high affective and cognitive distraction, which leads to poorer learning outcomes than desktop environments.     

基于虚拟现实的复杂场景加载优化算法

目前大规模场景模型生成的需求量日益增加, 现提出了一种基于区域的自动 LOD (Levels Of Details)构建算法. 该算法基于动态网格简化算法, 在游戏设计制作的过程中, 游戏开发人员会经常需要对美工部门人员提供的模型进行优化. 为了可以使模型的面数得到简化, 并且不改变模型的外观. 当今流行的 LOD技术非常擅于处理这种情况, 判断模型与摄像机的距离如果超过一定范围之后, 自动调取不同层次的模型, 当模型距离摄像机很远的情况下使用面数低的模型替换高模, 这样可以提高帧率并且降低摄像机前的三角面以及顶点数从而减少渲染压力. 一般模型的简化分为静态和动态模型的简化.大部分情况下, 程序员会让美工部门提供几套不同面数的模型或者通过模型简化工具对高模进行减面并存成多个Mesh, 并在程序运行的时候, 根据模型与摄像机的距离远近动态的替换Mesh. 这是一种静态的方法.这里将尝试使用一种动态的网格简化和LOD技术相结合的方法. 这种新型算法的大大的简化了操作流程, 美术人员只需要提供一个模型, 程序员可以使用这种方法生成量级不同的低模, 根据摄像机与模型的远近自动的调取不同精度的模型.     

基于VR技术的全息化教学应用研究

目前,虚拟现实技术已经大量运用于教育领域,对于基于VR技术的全息化教学资源的建设与应用研究受到了广大学者的关注,如何运用好这一热点技术是当今教育领域的热门话题。首先阐述了全息化教学的资源应用现状和主要作用,然后介绍了全息化教学在典型专业教学中的应用,最后对全息化教学资源建设与开展提出了合理化建议。     

Multiplane displays based on liquid crystals for AR applications

Multiplane displays are capable of displaying 3D scenes with correct focus cues by creating multilayer 2D images in the display volume. Hence, such a 3D display technique could effectively address the accommodation‐vergence conflict (AVC) problem, which is prevalent in augmented reality (AR) displays. In this paper, we review the recent progress on multiplane AR displays based on liquid crystals (LCs) for AR applications. The working principle of multiplane AR displays is illustrated, the electro‐optical properties of the tunable LC devices are investigated and display prototypes are demonstrated. Finally, we discuss the prospects and challenges of multiplane AR displays based on LCs.     

Differences between oculomotor and perceptual artifacts for temporally limited head mounted displays

We used perceptual and oculomotor measures to understand the negative impacts of low (phantom array) and high (motion blur) duty cycles with a high‐speed, AR‐likehead‐mounted display prototype. We observed large intersubject variability for the detection of phantom array artifacts but a highly consistent and systematic effect on saccadic eye movement targeting during low duty cycle presentations. This adverse effect on saccade endpoints was also related to an increased error rate in a perceptual discrimination task, showing a direct effect of display duty cycle on the perceptual quality. For high duty cycles, the probability of detecting motion blur increased during head movements, and this effect was elevated at lower refresh rates. We did not find an impact of the temporal display characteristics on compensatory eye movements during head motion (e.g., VOR). Together, our results allow us to quantify the tradeoff of different negative spatiotemporal impacts of user movements and make subsequent recommendations for optimized temporal HMD parameters.     

基于Bootstrap方法的密封寿命可靠性评估

针对高可靠、长寿命密封件在小样本试验下的可靠性寿命评估需求,提出一种基于虚拟增广样本和Bootstrap方法的密封寿命小样本数据可靠性评估方法。并以轴用阶梯圈为例,进行寿命可靠性评估。首先通过虚拟增广法将轴用阶梯圈台架寿命试验数据样本数增广至10个,使得样本数满足Bootstrap方法的适用条件;然后再利用Bootstrap方法得到轴用阶梯圈的寿命可靠性评估结果。     

沉浸式艺术审美体验的自我发现与再设计

探讨沉浸式艺术这一新概念，研究其审美体验是如何有助于自我发现并运用于艺术创作再设计中的。沉浸式艺术是一种能够启发感知联觉的审美体验方式，可使人们重新思考自己与“世界”(真实和虚拟)之间的关系。“感知”、“关系”和“转换”是三个相互交织并贯穿全文的主要问题，同时也是沉浸式艺术的研究基础。结合海德格尔“在世界上”(être-au-monde) 的观念来看，与其说“存在”，不如说人们沉浸并感知于这个世界中。然而，人们对周围环境的感知通常是无意识的，对于感知的认识也时常是冷漠和忽视的。沉浸式艺术使这些感觉得以被强调，它突出了个人的感知运动能力，同时也引起了人们对身体本身的重视。又如Bergson所提出的“投机性关注是建立在一种感知机制的基础上的，这种感知机制从根本上允许对世界进行一定行动而不是仅仅了解这个世界”。因此，对于一个完善的沉浸式审美体验过程来说，重要的是使观众自然地参与其中。当无意识的行为转换为肉眼可见的视觉效果时，审美体验将会更加深入人心。因此关于沉浸式艺术作品的创作，可以结合西方艺术家Marcel Duchamp的Ready-made的创作理念和中国道家的“无为”思想，研究怎样将被忽视的日常行为自然地转换为可见的，被重视的视觉效果，从而揭发主体与“世界”之间的多种潜在关系。     

Emerging Thermal Technology Enabled Augmented Reality

In the past decade, remarkable progress has been made in the domain of augmented reality/virtual reality (AR/VR). The need for realistic and immersive augmentation has propelled the development of haptics interfaces-enabled AR/VR. The haptics interfaces facilitate direct interaction and manipulation with both real and virtual objects, thus augmenting the perception and experiences of the users. The level of augmentation can be significantly improved by thermal stimulation or sensing, which facilitates a higher degree of object identification and discrimination. This review discusses the thermal technology-enabled augmented reality and summarizes the recent progress in the development of different thermal technology such as thermal haptics including thermo-resistive heater and Peltier devices, thermal sensors including resistive, pyroelectric, and thermoelectric sensors, which can be utilized to improve the realism of augmentation. The fundamental mechanism, design strategies, and the rational guidelines for the adoption of these technologies in AR/VR is explicitly discussed. The conclusion provides an outlook on the existing challenges and outlines the future roadmap for the realization of next-generation thermo-haptics enabled augmented reality.