利用自然特征的增强现实注册算法

在投影重现技术的基础上提出了一种利用自然特征的注册算法.这种算法由两步组成:嵌入和重现.嵌入中指定四个点,这四点在将叠加虚拟物体的地方建立世界坐标系.在重现中,用KLT特征跟踪器来跟踪视频中相应的自然特征,用已跟踪的自然特征来估计图像序列中相应的投影矩阵,接着,用投影重现技术变换所指定的四个点,从而计算出增强矩阵.还提出一种估算投影矩阵的强有力的方法.     

增强现实跟踪预测方法研究

为提高增强现实系统中标记跟踪注册的实时性,本文基于视频帧图像块匹配运动估计方法,通过连续帧间运动相关性预测标记运动方向,在预测方向区域检测标记,降低了全帧检测标记的时间复杂性。基于 ARToolKit,验证了本方法可显著提高标记跟踪的时间性能。     

基于空间几何结构的特征跟踪算法

针对传统的基于标记的增强现实系统场景受限等缺点,提出一种基于特征空间几何结构的无标记跟踪算法。在传统的金字塔Kanade-Lucas-Tomasi(KLT)跟踪算法基础上,通过建立图像的多尺度空间模型并在多尺度空间模型中对图像进行实时跟踪,同时根据图像特征间特有的空间几何结构信息优选跟踪特征点,解决了在多尺度变化情况下视频图像特征跟踪稳定性问题。实验结果表明,提出的跟踪算法在给定的数据库上性能高效稳定,与同类跟踪算法相比跟踪精度大幅提高,每帧重投影错误率均小于1像素,保持在亚像素级别。     

基于增强现实的消防系统跟踪技术研究

增强现实技术是虚拟现实技术发展的一个重要分支,是把计算机产生的虚拟物体或其他信息合成到用户看到的真实世界中的一种技术。它具有虚实结合、实时交互、三维注册的新特点。本文提出了将增强现实技术应用于消防系统的新思路和新方法。以期改善现有的消防监控系统的功能,为消防人员快速和准确的决策提供重要的帮助。     

基于SURF的增强现实标识物跟踪注册

针对基于标识物的增强现实跟踪注册方法对复杂环境的适应能力和鲁棒性的不足,提出一种用SURF实现标识物跟踪注册的改进算法。用SURF对平面标识物的特征点进行检测与描述,采用K-means算法对检测出的标识物特征点集合进行聚类分析得到其聚类中心,结合对视频图像中标识物的阈值分割与连通域分析,以聚类中心构建标识物的SURF特征点坐标系,通过矩阵变换实现标识物的跟踪注册。实验结果表明,该算法的增强现实系统具备较好的鲁棒性、稳定性和实时性。     

增强现实技术的研究

增强现实技术是近年来逐渐发展起来的新兴研究领域。本文概要的介绍了在投影重现技术的基础上提出的一种利用自然特征的注册算法。这种算法由两步组成：嵌入和重现。嵌入中指定四个点,这四点在将叠加虚拟物体的地方建立世界坐标系。在重现中。用KLT特征跟踪器来跟踪视频中相应的自然特征,用已跟踪的自然特征来估计图像序列中相应的投影矩阵。     

基于BRISK特征的增强现实系统设计

目前,基于特殊标志的增强现实系统,不够美观,且不适用室外;而基于自然特征的传统算法速度慢,提出了一种基于BRISK特征检测提取的增强现实系统。BRISK采用二进制的描述子以及汉明距离匹配,以给定半径围绕关键点周围的圆进行均匀采样,显著减少采样点的数量,从而大大改善了运行速度,且该系统采用自然场景中的物体作为目标,省去了不美观的标志。实验表明,该系统在很短的时间便可达到稳定结果,在室外以及遮挡部分标志物也能稳定工作。     

增强现实中的跟踪技术

增强现实是一种正在发展的新技术,它将由计算机产生的虚拟场景或信息准确叠加到真实环境中,可以增强用户对真实世界的感知与交互能力;对用户视场及视点的跟踪是增强现实中实现虚、实场景配准的关键技术之一;通过对增强现实中跟踪技术性能要求的讨论,介绍了基于磁场、声学、惯性、光学传感等多种跟踪技术,分析了各种方法的跟踪性能与局限性,认为以基于视觉跟踪为主的混合跟踪技术将是增强现实系统的主流跟踪技术,重点论述了基于视觉的跟踪与基于视觉一惯性的混合跟踪技术及其有待解决的问题,并针对户外增强现实中的跟踪技术做了专门讨论。     

基于机器学习的自然特征匹配方法

针对增强现实中的三维注册问题,提出一种基于机器学习的图像自然特征点识别方法。基于高斯混合模型进行样本选择,利用模式识别中的分类方法替代特征向量的最近邻匹配,将计算负担从实时阶段转移到训练阶段,利用各匹配点对之间的相似度计算核密度估计的权值,实现相关平面目标的跟踪。实验结果表明,该方法实时性好、相机位姿估计精确,对光照、遮挡、透视等变化具有较强的鲁棒性。     

增强现实中三维跟踪注册技术概述

三维跟踪注册技术是增强现实领域中的重要关键技术，通过对现实场景中的图像或物体进行跟踪与定位，将虚拟物体按照正确的空间透视关系叠加到真实场景当中。综述了增强现实中的三维跟踪注册技术（基于计算机视觉的跟踪注册技术、基于硬件传感器的跟踪注册技术以及混合跟踪注册技术），详细阐述了不同跟踪注册技术的优势与不足，并介绍了不同跟踪注册技术的当前应用现状，随后探讨了跟踪注册技术的发展趋势与存在的难题，对三维跟踪注册技术的进一步研究进行了展望。     

Real‐time recognition and tracking for augmented reality books

An augmented reality book (AR book) is an application in which such multimedia elements as virtual 3D objects, movie clips, or sound clips are augmented to a conventional book using augmented reality technology. It can provide better understanding about the contents and visual impressions for users. For AR books, this paper presents a markerless tracking method, which recognizes and tracks a large number of pages in real‐time, even on PCs with low computation power. For fast recognition with respect to a large number of pages, we propose a generic randomized forest that is an extension of a randomized forest. In addition, we define the spatial locality of the subregions in an image to resolve the problem of a dropping recognition rate under a complex background. For tracking with minimal jittering, we also propose the adaptive keyframe‐based tracking method, which automatically updates the current frame as a keyframe when it describes the page better than the existing one. Copyright © 2011 John Wiley & Sons, Ltd.     

The integration of optical and magnetic tracking for multi-user augmented reality

Multi-user augmented reality systems are especially dependent on precise registration. In this paper, we present a hybrid tracking system that combines optical and magnetic tracking. The magnetic tracking is used to give a robust estimate of position and orientation which then can be refined in realtime by optical tracking. The system is more precise than a magnetic tracker and both faster and more reliable than an optical tracker.     

增强现实中基于视觉与磁力跟踪器的三维注册方法

讨论了如何实现了一种基于三个标志点的视觉式三维注册方法，对电磁式三维注册方法进行了必要的说明，给出了实验平台，同时对实验结果进行了必要的分析说明。实验表明，此方法比较有效。     

Multi-sensor based real-time 6-DoF pose tracking for wearable augmented reality

Wearable augmented reality (WAR) combines a live view of a real scene with computer-generated graphic on resource-limited platforms. One of the crucial technologies for WAR is a real-time 6-DoF pose tracking, facilitating registration of virtual components within in a real scene. Generally, artificial markers are typically applied to provide pose tracking for WAR applications. However, these marker-based methods suffer from marker occlusions or large viewpoint changes. Thus, a multi-sensor based tracking approach is applied in this paper, and it can perform real-time 6-DoF pose tracking with real-time scale estimation for WAR on a consumer smartphone. By combining a wide-angle monocular camera and an inertial sensor, a more robust 6-DoF motion tracking is demonstrated with the mutual compensations of the heterogeneous sensors. Moreover, with the help of the depth sensor, the scale initialization of the monocular tracking is addressed, where the initial scale is propagated within the subsequent sensor-fusion process, alleviating the scale drift in traditional monocular tracking approaches. In addition, a sliding-window based Kalman filter framework is used to provide a low jitter pose tracking for WAR. Finally, experiments are carried out to demonstrate the feasibility and robustness of the proposed tracking method for WAR applications.     

平板图案的跟踪及其在增强现实中的应用

介绍一种实时的基于单摄像机的平板图案跟踪算法。该算法可以在增强现实应用中用于摄像机定位和虚拟物体的放置。针对跟踪中由运动模糊和目标较小所引起的跟踪失败情况做出了讨论,提出结合使用LK跟踪算法和基于匈牙利算法的角点匹配来解决这些问题。还提出使用基于约束的非线性优化来降低噪声对摄像机方位计算的影响。实验结果表明,该算法能够在复杂情况下,可靠地跟踪目标图案,获取准确平滑的摄像机定标结果。     

A method to measure the uniformity of the virtual image distance in an augmented reality or virtual reality device

The virtual image distance in an augmented reality (AR) or virtual reality (VR) device is an important factor in determining its performance. In this paper, a method for measuring the virtual image distance and its uniformity is proposed. The setup for measurement consists of a two-dimensional spatial sensor array on the translational stage and a pinhole array plate placed in front of the AR or VR device. As the distance between the pinhole plate and the two-dimensional spatial sensor array were changed, the positions of the rays through each pinhole were measured by a two-dimensional spatial sensor array. The ray trajectories through each pinhole were obtained by fitting these positions to straight lines. The relative distances between these ray trajectories were calculated with respect to the distance from the pinhole plate. This method is effective for measuring the uniformity, such as the azimuthal dependence of the virtual image distance or the dependence of the virtual image distance on the distance from the optical axis of the VR lens.     

增强现实游戏的场景重建和运动物体跟踪技术

针对增强现实游戏应用,介绍了一种基于自然特征的实时跟踪算法,它可以在一个未知但纹理丰富的环境中,不需要任何预先的学习,对相机和若干出现在相机视野里的刚体进行并行跟踪,获得相机和各个刚体的姿态和运动信息,可以在刚体移出相机视野以及相机剧烈运动导致跟踪丢失的情况下进行自动恢复。基于静态环境中并行相机跟踪和三维重建的算法框架进行扩展和改进,引入了用于交互的运动刚体。结果表明,利用现有的多核处理技术,在含有运动物体的环境中进行相机和运动物体的并行跟踪是可行的,为增强现实环境中同时支持显示和交互提出了廉价易行的解决方案。     

Real‐time generation of augmented video sequences by background tracking

We present a real‐time system that outputs a multi‐layer augmented video from a normal video stream. The input sequence is captured in a known environment: a panoramic image (the reference background) is provided before shooting. We use background tracking to register each input frame with this reference, and background subtraction to segment the foreground objects. Our background tracking method is a coarse‐to‐fine integration of three state‐of‐the‐art algorithms that we make resistant to occlusions. In particular, we introduce an algebraic technique to properly adapt the Jurie and Dhome (JD) tracker (the most robust of them). We report experimental results on real and synthetic data which validate our approach. We generate our augmented video sequences by compositing layers: a natural or synthetic background and several natural or synthetic foregrounds. Copyright © 2006 John Wiley & Sons, Ltd.     

基于投影技术的增强现实注册方法

注册技术是实现增强现实应用系统的关键问题之一。实现了一种利用投影技术改进了的注册方法。这种注册方法主要包含4个步骤：（1）检测标识和特征点的位置;（2）利用投影技术跟踪摄像机;（3）计算模型视图矩阵;（4）绘制虚拟物体。在初始阶段,指定4个点建立世界坐标系,虚拟物体将会被叠加到这个坐标系上;在注册过程中,利用投影技术跟踪特征点的位置,并计算用于增强的模型视图转换。这种注册方法可以为一般的室内增强现实系统提供所需的精确度和实时性。     

Handling occlusions in video‐based augmented reality using depth information

Augmented Reality (AR) composes virtual objects with real scenes in a mixed environment where human–computer interaction has more semantic meanings. To seamlessly merge virtual objects with real scenes, correct occlusion handling is a significant challenge. We present an approach to separate occluded objects in multiple layers by utilizing depth, color, and neighborhood information. Scene depth is obtained by stereo cameras and two Gaussian local kernels are used to represent color, spatial smoothness. These three cues are intelligently fused in a probability framework, where the occlusion information can be safely estimated. We apply our method to handle occlusions in video‐based AR where virtual objects are simply overlapped on real scenes. Experiment results show the approach can correctly register virtual and real objects in different depth layers, and provide a spatial‐awareness interaction environment. Copyright © 2009 John Wiley & Sons, Ltd.