基于虚拟现实的机器人智能控制系统

本文基于虚拟现实技术特点,构建了虚拟现实环境下的机器人智能控制系统,将Eon Studio与VC++可视化结合构建人机交互平台,将系统分为人机交互系统和遥控机器人系统部分,采用3DS MAX建立虚拟场景和机器人,基于TCP/IP协议的无线局域网技术进行数据交互,并利用EonX空间进行Eon和VC++6.0的通信.通过实...     

实时更新的全局一致三维栅格建图

在未知的三维环境中,移动机器人自主导航通常需要实时构建与环境全局一致的栅格地图,而现有大部分系统缺少地图更新策略,构建的栅格地图与实际环境不一致.文中将同步定位与建图模块获得的环境信息以点云形式提供给栅格建图模块处理,同时提出基于关键帧的高效数据结构和地图实时更新策略,实时构建可用于移动机器人自主导航的全局一致的地图.室内动态的实验数据测试表明,文中方法可以有效实时更新地图,生成与环境一致的三维栅格地图,支持其后续的自主导航操作.     

基于特征线段匹配的救援机器人建图方法

针对救援机器人的环境识别及其建图(SLAM)问题,提出了一种基于特征 线段匹配的方法。通过激光雷达获取环境信息,采用特征线段提取匹配的方法提高了系统运 行速度,在救援机器人移动过程中,系统能够及时、准确地进行全局地图更新。在救援环境 中,利用救援机器人进行环境识别及建图,实验结果表明：采用基于特征线段匹配方法实现 建图,能够得到较完整的环境地图,其方法具有很好的实用性。     

可变形灾难救援机器人控制站系统的设计与实现

针对灾难救援应用领域具体需求,提出了控制站系统的设计原则.基于人机交互技术,设计了可变形灾难救援机器人控制站系统,该系统具有感知信息完整、操控灵活、界面友好、交互性强等特点.通过灾难救援模拟环境进行实验,验证丁该控制站系统可以实现机器人在复杂环境中的运动控制、多通道信息交互等功能,在灾难救援等领域具有可行性及有效性.     

基于ORB-SLAM2的四足机器人定位和建图

四足机器人被认为是灾后救援、野外探索以及危险环境巡逻搜查的最佳移动平台,而定位与建图又是机器人在复杂地势环境进行自主行走的前提。搭建了一个基于四连杆并联机构的四足机器人运动平台,并且针对该四足机器人设计了相应的运动控制算法。为解决四足机器人在复杂环境中的地图构建与定位难题,采用ORB-SLAM2算法进行四足机器人的三维位姿估计,同时构建一个线程用于三维稠密点云信息的获取与拼接,并最终实现了在复杂环境中的四足机器人定位与建图功能。     

基于三维实时渲染技术的虚拟火灾训练系统设计

基于三维实时渲染技术的火灾训练系统包括:建筑三维地图构造和显示及与用户的交互,火灾的模拟,指导逃生和救援决策。探讨了利用实时三维绘制技术、人工智能和模式识别的相关算法结合火灾的危害模型建立虚拟火灾训练系统的途径。通过研究提出了采用虚拟现实来创建火灾和逃生救援的软件系统的设计方案,以及将OpenGL与DirectX相结合在Windows平台上实现基于C/S结构下的虚拟火灾训练系统的技术。     

VR环境下基于Leap Motion的三维模型空间位姿自适应调整方法

针对目前基于Leap Motion的人机交互研究中存在的虚拟手与三维模型相互干涉、三维模型与虚拟手空间位姿同步率低的问题,提出一种基于Leap Motion的三维模型空间位姿自适应调整方法.通过将物理交互方法与启发式交互方法相结合,实现基于虚拟手位姿信息的三维模型空间位姿自适应实时精确调整,使人机交互仿真过程更加逼真,提升用户的交互式体验感.借助HTC VIVE所搭建的沉浸式虚拟现实环境,验证了该方法的可行性.     

基于ROS和SLAM的全向移动语音机器人设计

针对传统嵌入式单片机控制的移动机器人交互少、自主运行能力不足的问题,设计并构建了语音启动的基于ROS元操作系统的移动机器人系统.以Linux系统的微处理器作为核心控制平台,STM32单片机作为下位机,结合激光雷达、GY-85等器件,根据混合硬件架构思想设计了一款全向移动的智能语音机器人.该机器人利用激光雷达采集环境信息,并用hector SLAM算法进行建图,利用AMCL算法进行定位和导航,并且采用了麦克纳姆轮底盘进行全方位的移动.对机器人的语音交互、实时定位和建图的功能进行了实地实验.实验结果表明,该移动机器人具有良好的语音交互、建图精度和系统特性,可有效完成建图定位和导航功能.     

基于人工引导的机器人建图技术

移动机器人能够创建精确的环境地图,是其具有准确的定位能力以及完成其他任务的前提。因此地图创建技术是移动机器人的关键技术。提出了一种基于人工引导方式的地图创建技术。该技术一方面弥补了传统机器人建图过程中自动搜索路径低效率的弱点,另一方面通过人机交互,机器人可以在建图的过程中记住关键的路径点,建立栅格地图与拓扑地图的混合地图,为移动机器人将来的导航奠定基础。     

基于LabVIEW的钻井远距离穿针可视化系统

通过分析现有的煤层气开发中的远距离穿针工艺的功能特点,提出了在虚拟现实生成工具-Eon Studio中,利用Script节点实现与外部框架LabVIEW进行数据交换和人机交互的思想.以LabVIEW为平台,开发出了具有交互功能的钻井远距离穿针三维可视化系统,该系统具有兼容性好、逼真度高等优点.文中详细论述了系统的结构及工作流程、远距离穿针建模及其三维可视化的实现方法.     

Digital Twin for Human-Robot Interactive Welding and Welder Behavior Analysis

This paper presents an innovative investigation on prototyping a digital twin(DT)as the platform for human-robot interactive welding and welder behavior analysis.This humanrobot interaction(HRI)working style helps to enhance human users'operational productivity and comfort;while data-driven welder behavior analysis benefits to further novice welder training.This HRI system includes three modules:1)a human user who demonstrates the welding operations offsite with her/his operations recorded by the motion-tracked handles;2)a robot that executes the demonstrated welding operations to complete the physical welding tasks onsite;3)a DT system that is developed based on virtual reality(VR)as a digital replica of the physical human-robot interactive welding environment.The DT system bridges a human user and robot through a bi-directional information flow:a)transmitting demonstrated welding operations in VR to the robot in the physical environment;b)displaying the physical welding scenes to human users in VR.Compared to existing DT systems reported in the literatures,the developed one provides better capability in engaging human users in interacting with welding scenes,through an augmented VR.To verify the effectiveness,six welders,skilled with certain manual welding training and unskilled without any training,tested the system by completing the same welding job;three skilled welders produce satisfied welded workpieces,while the other three unskilled do not.A data-driven approach as a combination of fast Fourier transform(FFT),principal component analysis(PCA),and support vector machine(SVM)is developed to analyze their behaviors.Given an operation sequence,i.e.,motion speed sequence of the welding torch,frequency features are firstly extracted by FFT and then reduced in dimension through PCA,which are finally routed into SVM for classification.The trained model demonstrates a 94.44%classification accuracy in the testing dataset.The successful pattern recognition in skilled welder operations should benefit to accelerate novice welder training.     

How to include User eXperience in the design of Human-Robot Interaction

In recent years Human-Robot Collaboration (HRC) has become a strategic research field, considering the emergent need for common collaborative execution of manufacturing tasks, shared between humans and robots within the modern factories. However, the majority of the research focuses on the technological aspects and enabling technologies, mainly directing to the robotic side, and usually neglecting the human factors. This work deals with including the needs of the humans interacting with robots in the design in human-robot interaction (HRI). In particular, the paper proposes a user experience (UX)-oriented structured method to investigate the human-robot dialogue to map the interaction with robots during the execution of shared tasks, and to finally elicit the requirements for the design of valuable HRI. The research adopted the proposed method to an industrial case focused on assembly operations supported by collaborative robots and AGVs (Automated Guided Vehicles). A multidisciplinary team was created to map the HRI for the specific case with the final aim to define the requirements for the design of the system interfaces. The novelty of the proposed approach is the inclusion of typically interaction design tools focusing in the analysis of the UX into the design of the system components, without merely focusing on the technological issues. Experimental results highlighted the validity of the proposed method to identify the interaction needs and to drive the interface design.     

Evaluating the Robot Personality and Verbal Behavior of Domestic Robots Using Video-Based Studies

Robots are increasingly being used in domestic environments and should be able to interact with inexperienced users. Human–human interaction and human–computer interaction research findings are relevant, but often limited because robots are different from both humans and computers. Therefore, new human–robot interaction (HRI) research methods can inform the design of robots suitable for inexperienced users. A video-based HRI (VHRI) methodology was here used to carry out a multi-national HRI user study for the prototype domestic robot BIRON (BIelefeld RObot companioN). Previously, the VHRI methodology was used in constrained HRI situations, while in this study HRIs involved a series of events as part of a 'hometour' scenario. Thus, the present work is the first study of this methodology in extended HRI contexts with a multi-national approach. Participants watched videos of the robot interacting with a human actor and rated two robot behaviors (Extrovert and Introvert). Participants' perceptions and ratings of the robot's behaviors differed with regard to both verbal interactions and person following by the robot. The study also confirms that the VHRI methodology provides a valuable means to obtain early user feedback, even before fully working prototypes are available. This can usefully guide the future design work on robots, and associated verbal and non-verbal behaviors.     

Trust as indicator of robot functional and social acceptance. An experimental study on user conformation to iCub answers

To investigate the dynamics of human-robot acceptance, we carried out an experimental study with 56 adult participants and the iCub robot. Trust in the robot has been considered as a main indicator of acceptance and measured by the participants' conformation to the iCub's answers to questions on functional and social tasks characterized by perceptual and socio cognitive uncertainty. In particular, we were interested in understanding whether (i) trust in functional savvy is a prerequisite for trust in social savvy, and (ii) to what extent factors such as participants' desire for control, attitude towards social influence of robots, and imagined collaborative vs. competitive scenario, may influence their trust in the iCub. We found that participants conformed more to the iCub's answers in the functional than in the social tasks. Moreover, the few participants conforming to the iCub's answers in the social task also conformed less in the functional issues. Trust in the robot's functional savvy does not thus seem to be a pre-requisite for trust in its social savvy. Finally, the examined factors did not influence the trust in iCub. Results are discussed with relation to methodology of human-robot interaction (HRI) research.     

Reading a robot's mind: a model of utterance understanding based on the theory of mind mechanism

The purpose of this paper is to construct a methodology for smooth communication between humans and robots. Here, focus is on a mindreading mechanism, which is indispensable in human-human communication. We propose a model of utterance understanding based on this mechanism. Concretely speaking, we apply the model of a mindreading system to a model of human-robot communication. Moreover, we implement a robot interface system that applies our proposed model. The characteristic of our interface system is its ability to construct a relationship between a human and a robot by a method of having an agent, which interacts with the person, migrate from the mobile PC of the person to the robot. Psychological experiments were carried out to explore the validity of the following hypothesis: By reading a robot's mind based on such a relationship, a person can estimate the robot's intention with ease and, moreover, the person can even understand the robot's unclear utterances made by synthesized speech sounds. The results of the experiments statistically supported our hypothesis.     

满足不同交互任务的人机共融系统设计

人与机器人共同协作的灵活生产模式已经成为工业成产的迫切需求,因此,近年来人机共融系统方面的研究受到了越来越多关注.设计并实现了一种满足不同交互任务的人机共融系统,人体动作的估计和机器人的交互控制是其中的关键技术.首先,提出了一种基于多相机和惯性测量单元信息融合的人体姿态解算方法,通过构造优化问题,融合多相机下的2D关节检测信息和所佩戴的惯性测量单元测量信息,对人体运动学姿态进行优化估计,改善了单一传感器下,姿态信息不全面以及对噪声敏感的问题,提升了姿态估计的准确度.其次,结合机器人的运动学特性和人机交互的特点,设计了基于目标点跟踪和模型预测控制的机器人控制策略,使得机器人能够通过调整控制参数,适应动态的环境和不同的交互需求,同时保证机器人和操作人员的安全.最后,进行了动作跟随、物品传递、主动避障等人机交互实验,实验结果表明了所设计的机器人交互系统在人机共融环境下的有效性和可靠性.     

基于深度图像与三维栅格离线映射的机械臂环境建模方法

为确保动态非结构化环境中人、机器人、环境3者的安全,提出一种基于深度图像与三维栅格离线映射的机械臂环境建模方法,该方法分为离线映射与在线更新两个步骤.离线映射首先将机器人工作空间划分成三维栅格,然后利用标定得到的RGB-D相机内外参数矩阵离线计算深度图像与三维栅格之间的映射关系并保存;在线更新是利用帧差法和查询离线映射表的方式更新三维栅格中的环境信息.为全面描述机器人的工作空间,进一步扩展此方法,提出多传感器信息融合以及从环境模型中滤除机械臂本体的方法.整套环境建模方法具有描述能力强、模型精度一致、可实现多传感器信息融合以及可在线更新的优点.最后,分别通过仿真实验、基于两个Kinect相机和7自由度KUKA IIWA机械臂的实际建模与末端避障实验,验证所提出方法的有效性.     

虚拟现实技术在柔性上肢康复机器人中的应用

根据末端牵引式和外骨骼式上肢康复机器人的特性,研制了一种新型的柔性上肢康复机器人。机器人的康复训练系统结合了主动和被动模式的要素,将虚拟现实（VR）技术引入上肢康复机器人,通过现实环境中的光学3D位置捕获以及VR环境中的3D位置感知,设计了虚拟动态模型交互性节点和碰撞检测实验,实现虚拟现实交互,提高虚拟模型运动实时效果和上肢康复训练精度。VR和新颖的康复机器人的集成为具有特定任务的患者提供了有效的训练。     

Whole-body motion planning and control of a quadruped robot for challenging terrain

Quadruped robots working in jungles, mountains or factories should be able to move through challenging scenarios. In this paper, we present a control framework for quadruped robots walking over rough terrain. The planner plans the trajectory of the robot's center of gravity by using the normalized energy stability criterion, which ensures that the robot is in the most stable state. A contact detection algorithm based on the probabilistic contact model is presented, which implements event-based state switching of the quadruped robot legs. And an on-line detection of contact force based on generalized momentum is also showed, which improves the accuracy of proprioceptive force estimation. A controller combining whole body control and virtual model control is proposed to achieve precise trajectory tracking and active compliance with environment interaction. Without any knowledge of the environment, the experiments of the quadruped robot SDUQuad-144 climbs over significant obstacles such as 38 cm high steps and 22.5 cm high stairs are designed to verify the feasibility of the proposed method.