非接触动态实时视线跟踪技术

视线跟踪技术是智能眼动操作系统的关键技术,是实现先进眼动操作系统作为高级人机交互应用的基础和前提。较为完整地阐述了非接触式视线跟踪技术的发展历程,并详细介绍了现有的实现视线或注视点实时动态跟踪测量的非接触视线跟踪技术,包括2D视线跟踪方法、3D视线跟踪方法和基于3D模型的视线跟踪方法。通过分析和比较现有的三类方法的最新进展,介绍了视线跟踪技术目前面临的科学问题,提出了基于双目立体视觉的头戴式自由空间视线跟踪测量方法,指出了视线跟踪技术应满足基于眼动操作系统的智能人机交互方法向自由空间操作发展的需求,朝着高精度、易配置、更大视线活动范围的自由空间视线测量方向发展。     

基于瞳孔-角膜反射技术的视线跟踪方法

视线跟踪是基于多通道的人机交互技术的重要研究内容．而基于瞳孔-角膜反射技术的视线方向是目前应用最广泛的视线跟踪技术之一。瞳孔-角膜反射技术的主要目的是提取人眼图像中瞳孔-角膜反射向量作为视线方向计算模型所需的视觉信息,通过搭建红外光源设备提取瞳孔-角膜反射向量构建基于瞳孔-角膜反射技术的视线跟踪系统,为面向人机交互的视线跟踪研究提供可行的低成本解决方案。     

基于瞳孔角膜反射技术的视线估计方法

作为信息获取与人机交互的一种新型方式,视线跟踪技术已经成为计算机视觉领域的热门研究方向。视线跟踪的核心技术是视线估计。针对现有视线估计方法标定复杂、限制头部运动等问题,提出了一种改进的基于二维瞳孔角膜反射技术的视线估计方法。在单相机单光源条件下,通过建立瞳孔角膜反射模型、补偿个体差异误差、补偿头部运动误差等步骤实现单点标定视线估计。实验结果表明,用该算法估计视线,在一定范围内,头部移动不会带来精度的明显下降。     

视线追踪系统中注视点估计方法研究

在回顾视线追踪技术发展历程的基础上,对该技术的研究方向和几种主要的视线跟踪方法进行了简单阐述。重点介绍了基于瞳孔-角膜反射法的视线追踪技术的原理及其硬件组成,尤其对现有视线跟踪系统中比较成熟的注视点估计算法进行了归纳总结和原理剖析。对二维和三维的注视点估计算法的精度和用户自由度进行了进一步的横向比较。最后指出了视线追踪技术存在的缺陷,并对其在人机交互、智能机器、虚拟现实等领域的应用前景进行了展望。     

面向多设备交互的眼动跟踪方法

当前,越来越多的人机交互应用需要依靠多个设备共同完成,传统针对单个设备的眼动跟踪方法已很难适应多设备交互的需求.为此,提出一种面向多设备交互的眼动跟踪方法.针对用户眼球运动幅度显著变大给图像识别带来的影响,采用待选瞳孔区域和瞳孔中心识别相结合的方法识别瞳孔;同时对普洱钦斑位置进行预测,插补识别过程中丢失的普洱钦斑;在此基础上,建立瞳孔-普洱钦斑反射向量.另一方面,利用边缘检测方法识别设备屏幕,并通过建立不同设备屏幕的顶点位置列表,比较屏幕形状和面积以区分不同设备;再根据瞳孔-普洱钦斑反射向量进行眼动注视点坐标拟合计算,并结合头部运动误差补偿方法提高多设备之间眼动注视点坐标的计算精度.最后设计开发了头戴式眼动跟踪系统Multi Gaze,用户测试结果表明,文中方法在多设备交互环境下能有效地提高注视点计算精度.     

基于特征的视线跟踪方法研究综述

针对基于特征的视线跟踪方法进行了综述.首先对视线跟踪技术的发展、相关研究工作和研究现状进行了阐述; 然后将基于特征的视线跟踪方法分成了两大类:二维视线跟踪方法和三维视线跟踪方法, 从硬件系统配置、误差主要来源、头部运动影响、优缺点等多个方面重点分析了这两类视线跟踪方法, 对近五年现有的部分基于特征的视线跟踪方法进行了对比分析, 并对二维视线跟踪系统和三维视线跟踪系统中的几个关键问题进行了探讨; 此外, 介绍了视线跟踪技术在人机交互、医学、军事、智能交通等多个领域的应用; 最后对基于特征的视线跟踪方法的发展趋势和研究热点进行了总结与展望.     

一种新的基于瞳孔-角膜反射技术的视线追踪方法

针对现有单相机单光源视线追踪系统存在的几个问题:精度不高、头动受限以及标定复杂,提出了一种新的基于瞳孔-角膜反射(PCCR)技术的视线追踪方法.通过提出的瞳孔边缘滤波算法(RDPEF)和三通道伪彩色图(TCPCM)解决了近红外条件下瞳孔定位误差较大、瞳孔跟踪鲁棒性较差的问题,进而提高了视线特征提取的精度.通过提出的头部位置补偿方法以及个体差异转化模型,使二维映射模型允许使用者头部运动并且只需要单点标定.该方法提高了单相机视线追踪的精度和应用范围,为面向人机交互的视线追踪系统提供了有效的低成本解决方案.     

眼动跟踪系统中的检测装置

眼动跟踪技术被广泛的应用于工程心理学和人机交互等领域，本文从检测装置、原始数据、检测算法的角度对眼动跟踪技术进行了分类，并对系统各类检测装置进行了详细介绍。     

基于双眼同步运动特征约束的Kalman瞳孔跟踪算法

针对注视点研究中,红外光照明下双眼瞳孔运动的定位跟踪存在误差的问题,以双眼实时图像为研究对象,提出一种基于双眼同步运动特征约束的瞳孔跟踪算法.根据人类双眼在注视过程中的同步运动特征,把双眼瞳孔间距矢量作为隐式参数进行估计,简化包含左右眼位置、速度和双眼瞳孔间距的模型为统一的双眼同步跟踪模型,运用Kalman滤波器实现了运动特征估计和状态跟踪.实验采用自制的头戴式注视点传感装置进行眼部图像的采集.实验表明,该算法跟踪精度高,抗干扰能力强.相较于传统的以左右瞳孔位置与速度以及左右眼相对位置为状态量的算法,本文算法在位置跟踪和速度跟踪的鲁棒性上有明显改善,算法计算量也明显减少.另外,经过本文算法处理后的注视点位置估计精度大大提高,为注视点在人机交互领域中的进一步应用奠定了基础.     

眼动仪与视线跟踪技术综述

文章在回顾视线跟踪技术的研究历程基础上,定义了视线跟踪的基本概念和参数。分析了六种主要视线跟踪技术原理,比较了每种技术的优、缺点。介绍了眼动仪硬件设备的研制和发展状况,对比了几种主要的眼动仪性能。最后,探讨了视线跟踪数据的处理软件和方法,并对视线跟踪技术的应用前景进行总结和展望。     

An integrated head pose and eye gaze tracking approach to non-intrusive visual attention measurement for wide FOV simulators

Eye gaze tracking is very useful for quantitatively measuring visual attention in virtual environments. However, most eye trackers have a limited tracking range, e.g., ±35° in the horizontal direction. This paper proposed a method to combine head pose tracking and eye gaze tracking together to achieve a large range of tracking in virtual driving simulation environments. Multiple parallel multilayer perceptrons were used to reconstruct the relationship between head images and head poses. Head images were represented with the coefficients extracted from Principal Component Analysis. Eye gaze tracking provides precise results on the front view, while head pose tracking is more suitable for tracking areas of interest than for tracking points of interest on the side view.     

A CNN based real-time eye tracker for web mining applications

Multimedia Tools and Applications - Eye gaze tracking is an increasingly important technology in the field of human-computer interaction. Individuals’ preferences, tendencies, and attention...     

Hybrid regression and isophote curvature for accurate eye center localization

Multimedia Tools and Applications - The eye center localization is a crucial requirement for various human-computer interaction applications such as eye gaze estimation and eye tracking. However,...     

Eye tracking as an MT evaluation technique

Eye tracking has been used successfully as a technique for measuring cognitive load in reading, psycholinguistics, writing, language acquisition etc. for some time now. Its application as a technique for measuring the reading ease of MT output has not yet, to our knowledge, been tested. We report here on a preliminary study testing the use and validity of an eye tracking methodology as a means of semi-automatically evaluating machine translation output. 50 French machine translated sentences, 25 rated as excellent and 25 rated as poor in an earlier human evaluation, were selected. Ten native speakers of French were instructed to read the MT sentences for comprehensibility. Their eye gaze data were recorded non-invasively using a Tobii 1750 eye tracker. The average gaze time and fixation count were found to be higher for the “bad” sentences, while average fixation duration and pupil dilations were not found to be substantially different for output rated as good and output rated as bad. Comparisons between HTER scores and eye gaze data were also found to correlate well with gaze time and fixation count, but not with pupil dilation and fixation duration. We conclude that the eye tracking data, in particular gaze time and fixation count, correlate reasonably well with human evaluation of MT output but fixation duration and pupil dilation may be less reliable indicators of reading difficulty for MT output. We also conclude that eye tracking has promise as a semi-automatic MT evaluation technique, which does not require bi-lingual knowledge, and which can potentially tap into the end users’ experience of machine translation output.     

Pupil localization algorithm combining convex area voting and model constraint

Locating the center of the eyes plays a significant role in many computer vision applications and research, such as face alignment, face recognition, human-computer interaction, control devices for disabled people, user attention and gaze estimation. The disturbances such as occlusions by eyelashes or eyelids, uneven spots and spectacle frames of glasses affect the accuracy and stability of eye center location. This paper presents a hybrid eye center locating methodology for infrared eye images. The pupil edge points are extracted by Starburst algorithm, and when we get the position and the gradient of the edge points, the approximate pupil boundary is determined by a convex region voting methods. After that, the boundary edge points are iteratively optimized by fitting an ellipses modeling constraint. Finally, the pupil is located correctly. Experiment shows that this algorithm has performance advantages compared with some state of the art approaches in pupil localization accuracy, iteration times and their performance. This algorithm combining convex area voting and model constraint has strong robustness, high accuracy and speed in real environments with occlusions and distortion pupil.     

Accurate and Robust Eye Center Localization via Fully Convolutional Networks

Eye center localization is one of the most crucial and basic requirements for some human-computer interaction applications such as eye gaze estimation and eye tracking. There is a large body of works on this topic in recent years, but the accuracy still needs to be improved due to challenges in appearance such as the high variability of shapes, lighting conditions, viewing angles and possible occlusions. To address these problems and limitations, we propose a novel approach in this paper for the eye center localization with a fully convolutional network (FCN), which is an end-to-end and pixels-to-pixels network and can locate the eye center accurately. The key idea is to apply the FCN from the object semantic segmentation task to the eye center localization task since the problem of eye center localization can be regarded as a special semantic segmentation problem. We adapt contemporary FCN into a shallow structure with a large kernel convolutional block and transfer their performance from semantic segmentation to the eye center localization task by fine-tuning. Extensive experiments show that the proposed method outperforms the state-of-the-art methods in both accuracy and reliability of eye center localization. The proposed method has achieved a large performance improvement on the most challenging database and it thus provides a promising solution to some challenging applications.