采用手指的三维人机交互方法

为了探索和实现和谐自然的人机交互方式,提出了一种新的三维人机交互方法,该方法利用单个摄像头捕捉人的手指及其阴影的运动,实时进行图像分析处理,检测指尖的位置.并利用手指的指尖和阴影的指尖的距离计算指尖的高度,从而还原指尖的在空间中的移动.最后使用Kalman滤波来使指尖的运动更平滑,使三维交互更自然.该方法对软硬件要求低,易于实现.实验结果表明:该方法在手指跟踪和指尖检测上可达到较高的准确率,可实现自然友好的三维人机交互,并可应用于虚拟现实或三维游戏中.     

手指书写:一种虚拟文字识别人机交互新方法

本文提出了一种全新的手指书写虚拟文字识别系统,该系统利用摄像头捕捉人手指的运动轨迹,通过手指跟踪及检测算法,恢复出手指虚拟"书写"文字的二维图像数据(称之为虚拟文字),再进行识别输出.文中对单层函数连接神经网络进行改进并用来进行高准确度的运动手指尖的预测及跟踪,给出了一种基于数学形态学及模板匹配的简单有效的手指检测方法,提出了基于运动手指跟踪的"虚拟文字"恢复方法.实验结果表明:系统方案可行,手指跟踪及检测准确率高,对手指"书写"的数字、英文等虚拟文字识别率能达到95％以上.     

一种基于单摄像头的虚拟键盘

提出了一种基于单摄像头的虚拟键盘的实现方法,利用手指在摄像头下的位置和动作,完成类似于键盘的人机交互。该方法只使用一个普通的摄像头,结合人手的颜色和轮廓信息,实现对人手的跟踪,实时判断人手指的位置和动作,以手指敲击键盘的动作为标准,实现一种无需实体的虚拟键盘。     

非接触式掌纹识别技术中关键点的定位方法

在掌纹识别技术中,关键点的定位起到了至关重要的作用.为了提高用户的接受度,采用了非接触式的掌纹识别技术.针对关键点定位的准确性影响识别精度,提出基于非接触式掌纹图像的关键点定位方法,其中包括手指张开时和手指并拢时两种情况.首先通过预处理提取手形的外侧轮廓,然后采用基于角度和方向的跟踪方法来初定位手指指尖点和手指间的凹点...     

面向投影环境的计算机视觉交互信息获取

针对面向投影环境的视觉交互信息获取问题,提出了一种基于前景检测和立体视觉的体感交互信息获取方法.该方法使用双摄像头实时完成投影环境下的人体前景检测、姿势识别以及三维空间定位,能够为人机交互提供人体位置信息、姿势信息.为了验证该方法的有效性,设计并实现了一套虚拟场景视点控制系统.实验证明,该方法能够满足用户与虚拟场景实时交互的需要.     

基于Kinect的手势识别及在虚拟装配技术中的应用

为了实现在Virtools环境下自然方便的人机交互过程,设计开发了基于Kinect的虚拟装配交互技术。该技术通过三维多手指检测并结合Kalman滤波来稳定跟踪指尖,同时基于指尖特征自定义了多种装配所需的手势;以Mir-crosoft Visual Studio 2010为开发工具,设计了手势操控相关功能块的编辑后集成于Virtools环境中,实现了手势在虚拟装配中的交互控制。实例证明,该技术能很好地完成虚拟装配过程,效果良好。     

基于ARM的嵌入式视频采集系统的设计与实现

针对USB摄像头的广泛应用,提出一种以S3C6410微处理器为核心的嵌入式视频图像采集系统设计方案,可将摄像头采集的视频图像在LCD屏幕上实时显示。该系统利用了嵌入式Linux内核下UVC驱动模型,通过LCD驱动移植,并采用Libjpeg库对采集的数据进行转换,最终在此基础上完成了对软件系统框架的设计。实验结果表明,该系统可以实现视频图像的数据采集并可在LCD显示屏上实时显示,可以方便地应用到各种嵌入式USB摄像头设备中,且实时性良好。     

基于OMAP3530的嵌入式人流关注方向检测系统

基于OMAP3530实现了人脸检测与方向推定系统.该系统通过USB摄像头采集人群图像,通过改进的Adaboost算法进行人脸检测,再通过SVR对人脸进行方向推定.所有的图像及计算结果可以通过网络传输到远程计算机.在远程计算机上实现了图形交互的控制界面,可以显示监测画面与推定结果.本系统还能实时解码播放标清的视频.经测试...     

基于计算机视觉的3D手势交互系统

随着计算机的广泛发展,键盘、鼠标等传统的人机交互方式很难满足用户自然、便捷的交互需求。研究手势建模、人手跟踪和手势交互系统的应用成为热点趋势。提出了一种简化的2D人手模型,该模型将人手建模为掌心点和5根手指,同时设计了一种基于粒子群优化(PSO)算法的人手跟踪方法,通过建模人手的生理和运动学约束关系,实现了基于2D/3D人手模型的PSO人手跟踪,该手势交互系统框架更具适用性和扩展性,融合了语义和反馈信息,提高了人手跟踪的鲁棒性和手势识别的准确度。     

数字全息光电再现实像与人的交互

为了提高交互的自然性,提出用正交双目摄像机检测空间中的手指作为输入,引导全息影像显示的交互方法.在介绍交互原理的基础之上,分析了手指运动和像的变化,建立了两者的映射关系.在交互的实现上,通过计算全息预先得到场景的数字全息图序列,然后根据检测到的手指信息加载相应的全息图进行光电再现,即可达到数字全息光电再现实像的动态交互显示的效果.最后,孔雀全息再现像与人的交互实例验证了提出方法的有效性和可靠性.     

Vision‐Based Finger Action Recognition by Angle Detection and Contour Analysis

In this paper, we present a novel vision‐based method of recognizing finger actions for use in electronic appliance interfaces. Human skin is first detected by color and consecutive motion information. Then, fingertips are detected by a novel scale‐invariant angle detection based on a variable k‐cosine. Fingertip tracking is implemented by detected region‐based tracking. By analyzing the contour of the tracked fingertip, fingertip parameters, such as position, thickness, and direction, are calculated. Finger actions, such as moving, clicking, and pointing, are recognized by analyzing these fingertip parameters. Experimental results show that the proposed angle detection can correctly detect fingertips, and that the recognized actions can be used for the interface with electronic appliances.     

利用平面间单应关系的指示位置判别方法

在基于计算机视觉技术的非接触式人机交互系统中,为了快速推断使用者指示的目标位置,提出一种无需显式求解摄像机参数的指示位置判别方法.利用目标平面上的已知点及其对应的摄像机成像点,求解目标平面和摄像机像平面间的单应矩阵,将目标平面卜相交于指示点的两条直线与像平面上的对应直线联系起来,从而通过检测图像中的特定直线推断指示点的...     

A new wearable input device: SCURRY

A new wearable input device named SCURRY, developed by the Samsung Advanced Institute of Technology, is introduced in this paper. Based on inertial sensors, this device allows a human operator to select a specified character, an event, or an operation as the input he/she wants spatially through both hand motion and finger clicking. It is a glovelike device, which can be worn on the human hand, composed of a base module, including one controller and two angular-velocity sensors (gyroscopes) on the back of the hand, and four ring-type modules (rings), including two-axis acceleration sensors (accelerometers) on four fingers. The base and the ring modules are integrated modules containing sensors, a transceiver or receiver for communication, and a microcontroller, which makes the device compact and light. The two gyroscopes embedded in the base module have a role in detecting the direction (up, down, right, and left) of the hand motion, and the accelerometers have a role in detecting finger motion generated by finger clicking. An algorithm for the exact finger-click recognition composed of three parts (feature extraction, valid-click discrimination, and crosstalk avoidance) is proposed to improve the recognition performance of finger clicking on SCURRY. The experimental results and discussions are presented. SCURRY can be used as a wearable mouse spatially, by allowing any three fingers to be operated as the left, middle, and right mouse buttons, and in a similar manner, as a wearable keyboard, as it allows a human operator to point and select any character, event, or operation by his hand motion and finger clicking.     

用计算机VGA显示器复现指定颜色的研究

如能用计算机控制在普通ＶＧＡ显示器上准确地显示出指定的颜色，那么计算机显示系统就将成为色度学、彩色视觉、印刷、印染等领域方便的、价格低廉的研究手段，为此要对计算机显示系统的颜色空间进行标定，这时遇到的主要困难是显示器显示特性的非线性，以及Ｒ、Ｇ、Ｂ三个通道之间的交联作用，我们通过对几种不同瑾显示的研究，对Ｒ、Ｇ、Ｂ三角交联规律作了探索并提出了存在三色交联时的显示特性表示公式和参数标定方法，从而实现     

Fine‐Motion Estimation Using Ego/Exo‐Cameras

Robust motion estimation for human–computer interactions played an important role in a novel method of interaction with electronic devices. Existing pose estimation using a monocular camera employs either ego‐motion or exo‐motion, both of which are not sufficiently accurate for estimating fine motion due to the motion ambiguity of rotation and translation. This paper presents a hybrid vision‐based pose estimation method for fine‐motion estimation that is specifically capable of extracting human body motion accurately. The method uses an ego‐camera attached to a point of interest and exo‐cameras located in the immediate surroundings of the point of interest. The exo‐cameras can easily track the exact position of the point of interest by triangulation. Once the position is given, the ego‐camera can accurately obtain the point of interest's orientation. In this way, any ambiguity between rotation and translation is eliminated and the exact motion of a target point (that is, ego‐camera) can then be obtained. The proposed method is expected to provide a practical solution for robustly estimating fine motion in a non‐contact manner, such as in interactive games that are designed for special purposes (for example, remote rehabilitation care systems).     

基于混合遗传算法的对极几何估计

在未定标系统中,对极几何约束给出了图像间的全部信息,成为解决许多视觉问题的关键环节.本文提出了一种基于混合遗传算法的对极几何估计方法,它利用每个基因代表一个匹配点,每条染色体作为对极几何估计最小子集.此方法在很大程度上减小了出格点对估计过程的影响,能够较好地汇聚到全局(或近似全局)最优解.模拟数据和真实图像的实验结果都表明,本文所给出的方法能够有效地检测和删除错定位和误匹配点,提高了对极几何估计的鲁棒性和精度.     

What and how well you exercised? An efficient analysis framework for fitness actions

Human action analysis has been an active research area in computer vision, and has many useful applications such as human computer interaction. Most of the state-of-the-art approaches of human action analysis are data-driven and focus on general action recognition. In this paper, we aim to analyze fitness actions with skeleton sequences and propose an efficient and robust fitness action analysis framework. Firstly, fitness actions from 15 subjects are captured and built to a fitness action dataset (Fitness-28). Secondly, skeleton information is extracted and made alignment with a simplified human skeleton model. Thirdly, the aligned skeleton information is transformed to an uniform human center coordinate system with the proposed spatial–temporal skeleton encoding method. Finally, the action classifier and local–global geometrical registration strategy are constructed to analyze the fitness actions. Experimental results demonstrate that our method can effectively assess fitness action, and have a good performance on artificial intelligence fitness system.     

电视机手势遥控系统设计

提出了一种基于手势识别的交互方式用于遥控电视机,系统利用CMOS图像传感器捕捉用户手势信息,结合采集到的人手运动轨迹和手势识别技术,与标准手势的样本信息进行比对,从而判断出与之对应的控制信号,最后通过红外发射器完成对电视机各项基本功能的调控,实现了自然友好的人机交互操作,该系统使人们摆脱了传统的遥控器,可用于数字娱乐、...     

一种新型交互电视遥控器软硬件设计研究

针对传统电视遥控器在人机交互中制约屏幕内容表现能力的问题,引入了交互电视的概念,并设计了一种触摸式电视遥控器,用户通过点击触摸屏上的图形按钮实现对电视机的控制和与电视屏幕的自由交互。较之传统电视遥控器,触摸式电视遥控器设计更加智能化,人机交互更加人性化,操作更加方便,对未来电视遥控器的设计具有一定的参考价值。