Augmented reality technologies,systems and applications

This paper surveys the current state-of-the-art of technology, systems and applications in Augmented Reality. It describes work performed by many different research groups, the purpose behind each new Augmented Reality system, and the difficulties and problems encountered when building some Augmented Reality applications. It surveys mobile augmented reality systems challenges and requirements for successful mobile systems. This paper summarizes the current applications of Augmented Reality and speculates on future applications and where current research will lead Augmented Reality’s development. Challenges augmented reality is facing in each of these applications to go from the laboratories to the industry, as well as the future challenges we can forecast are also discussed in this paper. Section 1 gives an introduction to what Augmented Reality is and the motivations for developing this technology. Section 2 discusses Augmented Reality Technologies with computer vision methods, AR devices, interfaces and systems, and visualization tools. The mobile and wireless systems for Augmented Reality are discussed in Section 3. Four classes of current applications that have been explored are described in Section 4. These applications were chosen as they are the most famous type of applications encountered when researching AR apps. The future of augmented reality and the challenges they will be facing are discussed in Section 5.     

面向移动增强现实的实时深度学习目标检测方法综述

移动增强现实(AR)借助智能移动终端将虚拟信息和真实世界进行实时融合,能否实时准确地对 环境中需要增强的物体进行目标检测直接决定了系统的性能。随着深度学习的快速发展,近年来出现了大量的 基于深度学习的目标检测方法。由于存在移动增强设备计算能力有限、能耗大、模型尺寸大以及卸载任务到边 缘云端的网络延迟严重等问题,将深度学习方法应用于移动 AR 的目标检测是一项具有挑战性的问题。首先从 Two stage 和 One stage 的 2 方面对目前深度学习目标检测算法进行综述;然后对面向移动 AR 的目标检测系统 架构进行归纳分类,分析了基于本地端、云端或边缘端和协作式的移动 AR 目标检测系统并总结了各自的优势 和局限性;最后对移动 AR 中目标检测亟待解决的问题和未来发展方向进行了展望和预测。     

智能手机的移动增强现实技术研究

随着增强现实技术的快速发展以及智能手机技术的革新,移动增强现实(M-AR)技术得以脱离体积庞大的PC机设备的限制,使其向户外和无线化发展成为可能,并由此推动了增强现实技术在智能手机上的应用。针对智能手机的移动增强现实技术在应用发展中所要解决的问题,进行了分析和探讨,较为系统地阐述了该领域最新的发展状况,并展望了该技术未来的发展前景。     

分级的Ad Hoc网络入侵检测系统改进

随着无线网络的快速发展和移动计算应用的快速增加,移动无线网络安全问题愈加突出.入侵检测作为保证网络安全的一种有效手段已经从保护固定有线网络扩展到移动无线网络.作为无线移动网络众多实现方式之一的移动Ad Hoc网络分为平面和分级两种结构.由于其与有线网络存在很大差别,现有针对有线网络开发的入侵检测系统很难适用于移动Ad Hoc网络.本文在描述入侵检测相关技术的基础上改进了分级的AdHoc网络入侵检测系统体系结构,并给出了该系统的分簇算法,使之更好地应用于分级的Ad Hoc网络.     

Augmented reality agents for user interface adaptation

Most augmented reality (AR) applications are primarily concerned with letting a user browse a 3D virtual world registered with the real world. More advanced AR interfaces let the user interact with the mixed environment, but the virtual part is typically rather finite and deterministic. In contrast, autonomous behavior is often desirable in ubiquitous computing (Ubicomp), which requires the computers embedded into the environment to adapt to context and situation without explicit user intervention. We present an AR framework that is enhanced by typical Ubicomp features by dynamically and proactively exploiting previously unknown applications and hardware devices, and adapting the appearance of the user interface to persistently stored and accumulated user preferences. Our framework explores proactive computing, multi‐user interface adaptation, and user interface migration. We employ mobile and autonomous agents embodied by real and virtual objects as an interface and interaction metaphor, where agent bodies are able to opportunistically migrate between multiple AR applications and computing platforms to best match the needs of the current application context. We present two pilot applications to illustrate design concepts. Copyright © 2007 John Wiley & Sons, Ltd.     

A synergetic mechanism for digital library service in mobile and cloud computing environment

Digital library services in the mobile computing have come into our daily life with the development of wireless communication and the manufacture of mobile devices. Digital libraries have collected large-scaled data for providing information service. However, there are still many problems such as limitations of computing on mobile devices and data transmission problems in the wireless network. This paper proposes a synergetic mechanism for digital library to provide information service in the mobile and cloud computing environment, which combines the digital library servers, mobile hosts and personal cloud space into a synergetic work group seamlessly. The proposed mechanism integrates the strong computing and large-scaled storage ability of cloud computing together with the convenience of mobile computing. It could help promoting knowledge sharing and improve work efficiency of users in the mobile and cloud computing environment.     

2003 technology roadmap for semiconductors

This update to the 2001 ITRS roadmap shows the industry shifting its focus toward systems on chip, wireless computing, and mobile applications. Today, the introduction of new technology solutions is increasingly application-driven, with products for different markets using different technology combinations at different times. General-purpose digital microprocessors for personal computers have been joined by mixed-signal systems for wireless communication and embedded applications. Battery-powered mobile devices are as strong a driver as wall-plugged servers. System-on-chip (SoC) and system-in-package (SiP) designs that incorporate building blocks form multiple sources are supplanting in-house, single-source chip designs. The high complexity of SoC design creates design-and-test development-productivity and test-quality challenges.     

Evaluation of mobility and quality of service interaction

With the fast adoption of IP-based communications for mobile computing, users are expecting a similar service in wireless and wired networks. This raises the need for setting guarantees to the quality of the offered service (QoS), despite the technology of the access network (AN) or the mobility of the terminal. As mobile computing is getting more popular on a daily basis, new broadband cellular wireless ANs will appear with overlapping coverage in hot spots. This generates a new challenge for QoS provision, as it will have to deal with fast mobility of terminals. Various QoS architectures have been defined, but none provides full support for guaranteed service levels for mobile hosts (MHs). This paper discusses the problems related to providing QoS to MHs and identifies the existing solutions and future work needed.     

基于改进 L-K 光流的 WebAR 信息可视分析方法

摘 要：信息可视化技术结合移动增强现实(MAR)技术在目标跟踪领域仍然存在设备计算 负载过大的问题。若仍坚持采用同跟踪平面图像特征点的方案来跟踪立体对象各角度的特征点, 则目标跟踪过程所需要获取的多角度特征点数据无疑会加重跟踪过程的计算压力,进而导致移 动设备负载过大,最终影响模型渲染,所渲染的模型常出现剧烈抖动、卡顿或运动滞后于目标 物的现象。针对上述问题,提出了一种基于改进的 L-K (Lucas-Kanade)光流跟踪算法的 WebAR (基于 Web 端的 MAR 技术)解决方案,将特征点的跟踪问题转化为光流估计问题以及一种优化 的三维信息可视化交互策略。实验结果表明,该方法能够提高 MAR 在跟踪目标时的计算效率 和稳定性,丰富信息可视化的呈现效果和交互方式。     

Challenges of computing in mobile cellular environment—a survey

Advances in cellular mobile technology have engendered a new paradigm of computing, called mobile computing. The frequency spectrum allocated to this service is not sufficient with respect to enormous growth of mobile communication users. Tracking down a mobile user in a cellular network which is a collection of geometric areas called cells each serviced by a base station is the other concern to the designer. This service also needs another problem to be solved, that is the access of common information by mobile users. Other than the issues in existing technology, many other issues on developing technology need to be addressed.

The survey is done in two phases. In the first phase a survey of three fundamental problems in mobile computing on existing technology is done. The issues discussed arise from three essential requirements: the efficient management and sharing of the spectrum among the users; to locate a mobile user in the cellular mobile environments; and processing of queries on location dependent data. The second phase highlights on research on different issues such as security, routing etc. in third generation wireless network in developing technology.     

On performance evaluation and design of atomic commit protocols for mobile transactions

The challenges of wireless and mobile computing environments have attracted the attention of researchers to revisit the conventional transaction paradigm. Indeed, this paradigm is an indispensable asset in modern information systems. The atomicity property of a distributed transaction is ensured with the use of an atomic commit protocol (ACP). Due to their great importance for transaction systems, the recent advances in mobile computing development have renewed the interest in the design of ACPs for mobile systems. The work presented in this paper studies the impact of the various and fluctuant parameters of wireless and mobile systems on a set of ACPs for mobile environment. It highlights performance indices which give orientations to the design of an adaptable approach that supports different atomicity notions satisfying a wide range of applications and environment requirements.     

Toward Next-Gen Mobile AR Games

Mobile augmented reality games offer a new and rich game experience allowing players to move and interact in their physical environment with 3D content. The authors review existing approaches to mobile AR games and identify two major trends: small, user-modifiable AR games and larger-scale, event-based AR games that are interwoven with their physical environment.     

Integrating mobile agents into the mobile middleware

Mobile agents are a new paradigm for distributed computing that is especially well suited for mobile computing over global wireless networks. This paper describes the approach taken in the ACTS On TheMove project to integrate a mobile agent system into the Mobile Application Support Environment (MASE), a middleware for mobile computing. In this project, an existing mobile agent system was adapted for the requirements of mobile computing. We present the changes that had to be made to the agent system to adapt it to the wireless communication. We also present some of the application areas where a mobile agent system is suitable for mobile communication. We describe an agent based pre-fetcher application where an agent operaes disconnected from the user on the fixed network and prepares web pages for the anticipated next connection of the user using the Quality-of-Service trading functions available in MASE.     

Binocular mobile augmented reality based on stereo camera tracking

Mobile augmented reality (AR) applications have become feasible with the evolution of mobile hardware. For example, the advent of the smartphone allowed implementing real-time mobile AR, which triggered the release of various applications. Recently, rapid development of display technology, especially for stereoscopic displays, has encouraged researches to implement more immersive and realistic AR. In this paper, we present a framework of binocular augmented reality based on stereo camera tracking. Our framework was implemented on a smartphone and supports autostereoscopic display and video see-through display in which a smartphone can be docked. We modified edge-based 3-D object tracking in order to estimate poses of left and right cameras jointly; this guarantees consistent registration across left and right views. Then, virtual contents were overlaid onto camera images using estimated poses, and the augmented stereo images were distorted to be shown through a video see-through display. The feasibility of the proposed framework is shown by experiments and demonstrations.     

移动自组网软件平台的研究与设计

终端设备的独有特性包括它们的移动性、个性化和位置感知,形成了新型的无线应用,能满足普遍存在的移动计算需求。展示一种在移动自组网环境下的无线终端设备。终端设备选择在Linux嵌入式平台进行开发。在该设备上,实现了AODV、MAODV路由算法并在NS-2上进行了路由协议性能的比较和分析。最后给出了终端设备原型的实现,并且提出了未来的改进方向和应用场景。     

Information at a glance [augmented reality user interfaces]

What if we could visualize and interact with information directly in the context of our surroundings? Our research group is exploring how augmented reality (AR) could someday make this possible. AR integrates a complementary virtual world with the physical world-for example, by using head-tracked see-through head-worn displays to overlay graphics on what we see. Instead of looking back and forth between the real world and a PDA, we look directly at the real world and the virtual information overlaid on it. At the heart of this approach is context-aware computing, computing systems that are sensitive to the context in which they operate, ranging from human relationships to physical location. For example, information might be tied to specific locations within a global, Earth-centered, coordinate system. How can we design effective mobile AR user interfaces? We've been trying to answer this question in part by developing experimental AR research prototypes. In AR, as in work on information visualization using desktop technologies, the amount of information available can far exceed what a system can legibly display at a given time, necessitating information filtering. Julier et al. (2000) have developed information filtering techniques for AR that depend on the user's goals, object importance, and proximity. We assume that a system can accomplish information filtering of this sort and that our system is displaying everything it should.     

边缘计算中任务卸载研究综述

近年来,随着移动智能设备的普及以及5G等无线通信技术的发展,边缘计算作为一种新兴的计算模式被提出,作为传统的云计算模式的扩展与补充.边缘计算的基本思想是将移动设备上产生的计算任务从卸载到云端转变为卸载到网络边缘端,从而满足实时在线游戏、增强现实等计算密集型应用对低延迟的要求.边缘计算中的计算任务卸载是一个关键的研究问题...     

Intrusion Detection in Ad-hoc Networks

The rapid increase of wireless networks and mobile computing applications has changed the landscape of networks security. The traditional way to protect networks with firewalls and encryption software is no longer sufficient and effective. We need to search for new techniques to protect the wireless networks and mobile computing application. In this paper, we introduce the demands of ad-hoc environment. We focus on two areas of ad-hoc networks, wireless firewall and wireless intrusion detection. Furthermore, we particularly analyze the architecture, the problems and the challenges of current IDS techniques for wireless ad-hoc networks.     

Usability Principles for Augmented Reality Applications in a Smartphone Environment

Through the rapid spread of smartphones, users have access to many types of applications similar to those on desktop computer systems. Smartphone applications using augmented reality (AR) technology make use of users' location information. As AR applications will require new evaluation methods, improved usability and user convenience should be developed. The purpose of the current study is to develop usability principles for the development and evaluation of smartphone applications using AR technology. We develop usability principles for smartphone AR applications by analyzing existing research about heuristic evaluation methods, design principles for AR systems, guidelines for handheld mobile device interfaces, and usability principles for the tangible user interface. We conducted a heuristic evaluation for three popularly used smartphone AR applications to identify usability problems. We suggested new design guidelines to solve the identified problems. Then, we developed an improved AR application prototype of an Android-based smartphone, which later was conducted a usability testing to validate the effects of usability principles.     

一个新的移动计算的嵌入式GIS模型的研究

针对嵌入式GIS应用在无线互联网络环境下的带宽限制、数据析取量大等问题,采用了移动Agent分布式计算理论与技术,提出了一种新型的移动计算环境的嵌入式GIS模型,分析了该模型中各子模块的主要功能及运行机制,并将该模型应用在某省地震应急指挥系统中,通过离线在GIS客户端工作,可以在线实时发送灾害损失调查信息。实验表明,与传统的分布式计算模型相比较,嵌入了支持移动Agent计算模型的GIS在无线互联网络中具有高效的处理机制和良好的适用性。