视线跟踪技术研究

利用跟踪角膜反射-瞳孔中心的技术,构建了头部静止和头部自由运动两套视线跟踪系统,实时获取用户注视点的信息,通过电磁式位置跟踪器和共面彩色四点位置跟踪算法较好地解决了用户头部小范围运动问题,并且对系统的误差进行了详细分析.实验验证结果表明,头部静止视线跟踪系统实时跟踪误差小于1°,头部自由运动视线跟踪系统实时跟踪误差小于1cm,达到了良好的视线跟踪效果,为视线跟踪技术与人机交互设备的集成和广泛应用奠定了良好的基础.     

增强现实辅助维修技术研究进展

增强现实技术应用于复杂装备维修,可增加维修保障工作信息量与对复杂维修任务及维修过程的理解能力,提高维修保障效率。在分析当前典型增强现实原型系统基础上,研究了增强现实技术在复杂装备维修保障中应用的可行性,提出了增强现实装备维修中关键技术的解决途径,并对增强现实技术的发展趋势进行了展望。     

增强现实辅助装配技术综述

目的 增强现实技术是一种将虚拟信息与真实环境相融合的技术,增强装配是指将增强现实技术应用到装配领域,旨在提高装配效率与质量、降低装配培训成本.方法 对增强现实辅助装配技术进行了介绍,并对增强现实三大关键技术(跟踪配准技术、实时交互技术、虚实融合技术)及其在辅助装配系统中的实现方法进行了详细阐述,然后分类介绍了增强现实辅助装配实例,最后提出了在实际应用中面临的问题.结论 增强现实技术在辅助装配时充分发挥作用的前提是必须要有完善的装配信息模型;目前受硬件的限制,头戴式显示器只能在便携性与图形性能之间取一个平衡;增强装配引导系统的最终使用对象是工人,因此构建一个用户友好型增强装配系统十分重要.     

人机交互中的视线跟踪技术

介绍视线跟踪技术的基本原理及其在人仙交互技术中的应用,并结合所进行的多通道用户界面的研究工作,阐述视线跟踪技术在多通道用户界面中的应用与相应的多通道整合方法。     

视线跟踪技术及其应用

本文介绍了研究、应用视线跟踪技术的必要性,回顾了视线跟踪技术的研究历程,概述了主要的视线跟踪技术及其原理,比较了各种视线跟踪技术的优缺点。重点探讨了当前常用的基于视频的瞳孔－角膜高光向量法的原理和技术,并介绍了视线跟踪技术的研究方向和发展趋势。最后对视线跟踪技术在人机交互、智能机器等领域的应用前景进行了介绍和展望。     

增强现实环境下的产品装配引导技术

以增强现实环境下引导产品装配为目标,建立了面向增强装配过程的统一信息模型,管理文字、几何和产品装配特征等可视化引导信息。采用基于标志物的视觉跟踪技术实现虚拟零件和视频中真实零件的注册定位,通过建立虚拟和真实装配场景的深度图处理增强装配场景中虚实物体的遮挡关系。利用虚实零件的注册位置把装配引导信息叠加到装配视频场景中。并开发了演示系统,分析和说明了增强现实环境下引导产品进行装配的过程。     

眼动交互在大屏手机操作中的应用趋势

目的探讨超出单手手势操作范围的大屏手机新的交互方式和趋势。方法以视线跟踪方法和视线控制技术为基础,阐明"眼动交互"对下达任务指令、识别用户身份、识别用户兴趣点、增强游戏体验等多种手机操作的适应性。同时,探讨了"眼动交互"高效率、直觉性、可识别情感等诸多优势,以及易疲劳、"米达斯接触"、眼动识别精度等可能存在的问题。结论新的手机屏幕尺寸需要新的交互形式与之相适应,眼动交互将成为人与大屏手机交互的有益补充。视线辅助交互方式将成为未来手机和平板电脑操作的新趋势。     

增强现实技术在远程现实中的应用研究

设计了基于移动机器人的远程现实系统,辅助机器人遥操作.为提高人机交互能力,把增强现实技术应用到远程现实当中,根据增强现实中三维注册的原理,推导了双曲面全景成像中基于视觉的注册算法,实现了三维虚拟机器人在全景图像中的注册定位.为了提供更加直观的人机交互界面,采用一种快速算法把圆形全景图进行近似的柱面展开,并将"增强远程现实"应用于展开的图像界面中.实验结果表明,增强远程现实改善了场景的视觉感官效果、增加了辅助信息,提高了人机交互能力.     

基于增强现实的产品展示APP设计研究

目的探求以增强现实技术为基础的移动端产品展示APP设计模式。方法从用户体验和产品虚拟视觉信息设计两方面展开研究。结果结合家电产品展示APP开发案例,在移动设备环境下,利用增强现实开发工具设计了增强现实产品展示系统。结论虚拟现实技术为移动展示设计提供了一种用户体验更好的展示形式,能够将虚拟的产品数字化模型和真实环境结合起来;也为产品设计企业提供了可用性更高的展示系统平台,并且为虚拟展示系统的设计提供了新思路和方向。     

增强现实技术在交通领域应用的可行性分析

针对人们较为关注的交通安全、拥堵、交通时间合理化等问题,本文进行了现有交通问题的调研,并探讨了如何将较为成熟的增强现实技术运用于交通系统中.通过调研,作者们总结了在交通领域中应用AR技术的可行性包括:360度的实景实时预览、导航创新,以及提供准确的驾驶指导,但同时也有着技术、资源开发、推广普及的应用挑战.结合用户体验、情感化设计方法和趋势分析,作者们提出了AR头盔在交通领域的可行性应用方案,以实现可持续性的交通发展.     

基于眼动追踪的智能电视界面可用性评估研究

目的 分析智能电视界面交互设计的合理性,以及眼动追踪在电视界面可用性评估中的可行性。方法 采用主客观结合的可用性评估研究方法,对智能电视界面设计进行评估与优化。以TCL-V7300智能电视为实验对象,使用Tobii X120眼动仪对45名被试进行眼动测试,分为自由浏览界面和用户任务测试两个测试阶段。客观可用性评估采用基于眼动追踪得到的眼动指标(热点图、AOI首次注视时间、AOI注视率、注视轨迹)和行为指标(任务完成时间、任务成功率)进行客观结果分析;主观可用性评估通过用户访谈,获取被试对测试点的理解和使用感受。最终针对智能电视界面的可用性问题,进行了界面优化设计及效果评估。结论 主客观可用性评估测试符合眼动追踪实验设计原理,是具有普适性的智能电视界面可用性评估方法。     

Optical eye tracking system for noninvasive and automatic monitoring of eye position and movements in radiotherapy treatments of ocular tumors

A noninvasive eye tracking system based on infrared 3-D video-oculographic techniques is proposed for the automatic monitoring of eye position and orientation in external beam radiotherapy of ocular tumors. The presented method can be applied for the real-time estimation of lesion position and tumor-beam misalignments, allowing automatic patient setup and eye movement gated treatments. A prototypal eye tracker was developed and tested on five subjects, achieving gaze estimation errors of 0.5° and eye monitoring frequencies of 125 Hz. The proposed application can potentially improve quality and efficacy of ocular radiotherapy treatments, currently based on invasive, qualitative, and manual control procedures.     

RETRACTED: Implementation System of Human Eye Tracking Algorithm Based on FPGA

With the high-speed development of transportation industry, highway traffic safety has become a considerable problem. Meanwhile, with the development of embedded system and hardware chip, in recent years, human eye detection eye tracking and positioning technology have been more and more widely used in man-machine interaction, security access control and visual detection.
In this paper, the high parallelism of FPGA was utilized to realize an elliptical approximate real-time human eye tracking system, which was achieved by the series register structure and random sample consensus (RANSAC), thus improving the speed of image processing without using external memory. Because eye images acquired by the camera often generate a lot of noises due to uneven light and dark background, the preprocessing technologies such as color conversion, image filtering, histogram modification and image sharpening were adopted. In terms of feature extraction of images, the eye tracking algorithm in this paper adopted seven-section rectangular eye tracking characteristic method, which increased a section between the mouth and the nose on the basis of the traditional six-section method, so its recognition accuracy is much higher. It is convenient for the realization of hardware parallel system in FPGA. Finally, aiming at the accuracy and real-time performance of the design system, a more comprehensive simulation test was carried out.
The human eye tracking system was verified on DE2-115 multimedia development platform, and the performance of VGA (resolution: 640×480) images of 8-bit grayscale was tested. The results showed that the detection speed of this system was about 47 frames per second under the condition that the detection rate of human face (front face, no inclination) was 93%, which reached the real-time detection level. Additionally, the accuracy of eye tracking based on FPGA system was more than 95%, and it has achieved ideal results in real-time performance and robustness.     

Influence of the gaze-stabilizing eye movements on the quality of the retinal image of the human eye

Abstract

In this work we have studied the influence of the gaze stabilizing movements of the eye on the quality of the retinal image of the human eye obtained by double pass methods. The results obtained agree with the expected differences between the coherent and incoherent behaviour of the optical system of the eye. The movements-free retinal image is obtained from a typical retinal image by considering a filter function in the frequency domain which characterizes the effect of the considered movements.     

Broadband optical antireflection enhancement by integrating antireflective nanoislands with silicon nanoconical-frustum arrays

Based on conventional colloidal nanosphere lithography, we experimentally demonstrate novel graded-index nanostructures for broadband optical antireflection enhancement including the near-ultraviolet (NUV) region by integrating residual polystyrene antireflective (AR) nanoislands coating arrays with silicon nano-conical-frustum arrays. This is a feasible optimized integration method of two major approaches for antireflective surfaces: quarter-wavelength AR coating and biomimetic moth's eye structure.     

基于眼动仪的非物质文化遗产平面视觉体验研究

目的通过可用性与用户体验设计中的研究方法,研究非物质文化遗产平面视觉的体验设计,得到非物质文化遗产平面设计的视觉构建方式与用户体验需求。方法通过眼动仪实验与访谈获得用户注视非遗平面海报的热点图、轨迹图和注视区域图,从用户体验与可用性角度,基于眼动实验的有效数据详细探讨针对可视性非遗文化的体验现状和视觉构建。结果从可用性的角度出发提出针对非物质文化遗产平面设计的体验需求,结合眼动实验的定量分析结果与访谈用户的定性分析结果,提出针对非遗平面设计视觉体验的若干合理性建议。结论基于眼动实验结果提出的非遗平面设计视觉体验构建有助于促进非物质文化遗产信息的高效率传递,在可用性的基础上改进用户的视觉体验,助力非遗文化传播。     

不同认知难度影响因素下数据信息搜索的视觉生理反应规律

目的 数字化产线数据监控界面中的数据图表呈现方式对监测员认知绩效的影响十分关键.以数据形式、任务种类及颜色和呈现方式为变量,依次展开行为反应与眼动追踪实验.方法 以产线生产制造过程中的损失工时数据为实验材料设计实验,通过记录行为反应数据中的反应时间和正确率,以及眼动追踪数据中的凝视时间和瞳孔直径大小指标,分析并讨论在不同影响因素下具有认知难度差异的数据图表认读实验中,反应时间与正确率、凝视时间与瞳孔直径大小间的反应变化一致性规律.结果 数据形式、任务种类对行为反应指标,以及呈现方式、颜色对视觉反应指标均具有显著性影响.结论 随着数据图表不同影响因素下的认知难度差异变化,行为反应体现为正确率与反应时间呈一定程度负相关;视觉反应指标体现为凝视时间与瞳孔直径变化的一致性,并且瞳孔直径变化对颜色因素具有更高敏感度.该结论能在数据图表认知绩效的评价与设计优化中起到一定参考作用.     

A Pupil-Positioning Method Based on the Starburst Model

Human eye detection has become an area of interest in the field of computer vision with an extensive range of applications in human-computer interaction, disease diagnosis, and psychological and physiological studies. Gaze-tracking systems are an important research topic in the human-computer interaction field. As one of the core modules of the head-mounted gaze-tracking system, pupil positioning affects the accuracy and stability of the system. By tracking eye movements to better locate the center of the pupil, this paper proposes a method for pupil positioning based on the starburst model. The method uses vertical and horizontal coordinate integral projections in the rectangular region of the human eye for accurate positioning and applies a linear interpolation method that is based on a circular model to the reflections in the human eye. In this paper, we propose a method for detecting the feature points of the pupil edge based on the starburst model, which clusters feature points and uses the RANdom SAmple Consensus (RANSAC) algorithm to perform ellipse fitting of the pupil edge to accurately locate the pupil center. Our experimental results show that the algorithm has higher precision, higher efficiency and more robustness than other algorithms and excellent accuracy even when the image of the pupil is incomplete.     

Compact scanning laser ophthalmoscope with high-speed retinal tracker

The effectiveness of image stabilization with a retinal tracker in a multifunction, compact scanning laser ophthalmoscope (TSLO) was demonstrated in initial human subject tests. The retinal tracking system uses a co confocal reflectometer with a closed-loop optical servo system to lock onto features in the fundus. The system is multifarious and modular to allow configuration for many research a clinical applications. Adult volunteers were tested without mydriasis to optimize the tracking instrumentation and to characterize imaging performance. The retinal tracking system achieves a bandwidth of greater than 1 kHz, which permits tracking at rates that greatly exceed the maximum rate of motion of the human eye. The TSLO system stabilized images to an accuracy of 0.05 deg in all test subjects during ordinary saccades with a velocity up to approximately 500 deg/s. Feature lock was maintained for minutes despite subject eye blinking. Even when nearly 1000 frames were coadded, image blur was minimal. Successful frame coaddition allowed image acquisition with decreased noise in low-light applications. The retinal tracking system significantly enhances the imaging capabilities of the scanning laser ophthalmoscope.     

A holographic waveguide based eye tracking device

We demonstrated the feasibility of using a holographic waveguide imager for eye tracking. A holographic waveguide placed in front of the eye was used to capture images of the anterior segment of the eye and to guide the images to a camera distant from the eye. The pupil centre (PC) and corneal reflection (CR) of the eye was used to compute eye position. A custom-built model eye was used to validate the prototype eye tracker. A linear relationship between the angular eye position and the PC/CR vector was found over 60 horizontal degrees and 40 vertical degrees. The tracking accuracy and precision were 0.72 degree and 0.50 degree over these tracking ranges. These results confirmed that holographic waveguide could be a viable platform for developing compact, wearable, see-through eye trackers that can continuously monitor eye movements during real life tasks and thus can facilitate diagnosis of oculomotor disorders.