Aligning Education with Vision 2030 Using Augmented Reality

Vision 2030 requires a new generation of people with a wide variety of abilities, talents, and skills. The adoption of augmented reality (AR) and virtual reality is one possible way to align education with Vision 2030. Immersive technologies like AR are rapidly becoming powerful and versatile enough to be adopted in education to achieve this goal. Technologies such as AR could be beneficial tools to enhance maintainable growth in education. We reviewed the most recent studies in augmented reality to check its appropriateness in aligning with the educational goals of Vision 2030. First, the various definitions, terminologies, and technologies of AR are described briefly. Then, the specific characteristics and benefits of AR systems are determined. There may be a significance of the pedagogical method used by adapting the AR scheme and the consistency of the equipment and learning experiences. Therefore, three kinds of instructional methods that stress roles, location, and tasks were evaluated. The kind of learning that is offered by the distinct kinds of AR approaches is elaborated upon. The technological, pedagogical, learning problems experienced with AR are described. The potential solutions for a few of the issues experienced and the topics for subsequent research are presented in this article.     

A novel vision-based method for 3D profile extraction of wire harness in robotized assembly process

Automating stages for deformable objects in the production line, in which assembling a wire harness into a predefined position is a complex task owing to the specialized characteristics of the objects. Besides a few automatized systems proposed in the other studies to implement this task under simplified setup conditions, a significant portion of this process remains to be completed manually in industrial environments. To construct an automatic wire harness assembly system, the development of a method that can automatically detect the wire harness profile in a 3D environment and, consequently, guide robot arms to implement assembly tasks is indispensable. Therefore, this study presents an approach that satisfies this requirement, which not only proposes a deep learning-based system to detect the wire profile, but also improves the accuracy of the detected results through a correction method according to the depth values of contiguous areas. The verification of the approach in a robot system that highlights its usefulness and practicality demonstrates the potential of the proposed method to replace people and consequently, reduce labour costs in factory environments.     

深度学习的图像实例分割方法综述

实例分割是一项具有挑战性的任务,需要同时进行实例级和像素级的预测,在自动驾驶、视频分析、场景理解等方面应用广泛.近年来,基于深度学习的实例分割方法迅速发展,如两阶段检测器Faster R-CNN扩展出的聚焦于网络的精度而非速度的强大实例分割基准Mask R-CNN,一度成为实例分割的标杆.利用高速检测的单阶段检测器延伸出的实例分割算法YOLACT填补了实时实例分割模型的空白,具有较高的研究和应用价值.本文首先对实例分割算法进行了类别划分,然后对一些代表性的算法及其改进算法进行了深入分析,并阐述了相关算法的优缺点,最后对实例分割方法未来的发展进行了展望.     

基于Matlab实时运动目标跟踪检测系统

运动目标的检测跟踪是视频理解技术和计算机视觉的研究热点,其在解决智能视频监控,人机交互,智能交通系统等领域有着广泛而重要的应用,基于此利用matlab平台构建出USB摄像头实时图像采集处理系,从视频流采集到处理综合利用了背景估测,图像分割,目标检测与跟踪算法准确高效地检测出环境场景中的动态目标,并成功地对其进行实时追踪。利用matlab的simulink模块编程实现提取视频流YcbCr输入系统进行运算处理,并改进了背景估测和目标检测算法,提高系统的实时性。最终利用多次试验,对室内和室外运动目标实现检测跟踪,验证了系统处理实际问题的可靠性能。     

基于计算机视觉的油封尺寸检测系统设计

针对油封的大批量、多品种、流水线作业的生产特点以及"零废品率"的检测要求,利用机器视觉检测和计算机图象处理技术,研究开发了适应大批量生产和在线实时检测的油封尺寸机器视觉检测系统;建立了系统软硬件结构,分析了系统的组成和工作原理及工作过程,并对图像处理算法进行了设计;系统标定后的实验检测结果证明,该检测系统能实现产品100%检测的生产目标,具有非接触、在线实时、精度适中、成本低等特点,具有较好的生产通用性。     

Theory of edge perception for computer vision feedback control

In this paper, the authors address the problem of edge-perception for its applications to vision-feedback control in robotic systems.In natural vision, the recognition of objects takes place through the process consisting of eye system, neural networks and cognition. The cognitive process, in turn yields a phenomenon known as perception. This is the phenomenon of perception of physical attributes, such as edges, color and texture, etc., which is responsible for the recognition of objects through the natural vision processes.In this paper, we make an attempt to postulate the theory of perception for gray-level images. The gray-level images, when going through the cognitive and perception processes, are contaminated by the uncertainty; here we call it cognitive uncertainty.The studies in this paper are confined to the phenomenon of edge-perception for two-dimensional gray-level images, however, these studies can be extended to other types of visual attributes both in two-dimensional and three-dimensional spaces. Indeed, the perception of these attributes, which attempts to emulate the human vision system, may help in the design of a truly robust computer vision-feedback control system for robotic applications.     

激光焊接对接拼缝测量的微景深方法

对于复杂微细、错边量小的激光焊接拼缝测量,现有的视觉传感器方法不能稳定、可靠地提取出拼缝的中心位置、拼缝宽度等信息。为此,提出了基于微景深的激光焊接对接拼缝测量方法,该方法采用高倍光学放大镜头、工业CCD(Charge Coupled Device)/CMOS(Complementary Metal-Oxide-Semiconductor Transistor)相机和LED(Light-Emitting Diode)外部照明装置,以光学成像光轴与被测表面法矢呈45°的方式,组成的对接拼缝的非接触测量系统,既解决了显微放大时景深很小、测量范围小的问题,又解决了狭窄拼缝高光学放大倍数拼缝检测的难题。实验结果表明,该系统可快速准确地提取出拼缝中心坐标、拼缝宽度以及拼缝局部表面法矢。拼缝宽度测量精度优于5 μm,拼缝中心测量精度优于6 μm,可识别的最小拼缝宽度为0.02 mm,完全满足激光焊接对接狭窄拼缝的检测与自动跟踪的要求。     

基于多尺度注意力网络的立体匹配方法

为解决网络深度与训练图像块大小耦合问题及进一步提高弱纹理区域及边缘处的匹配精度,提出了一种基于多尺度注意力网络的立体匹配方法.该方法将立体匹配过程分为2个阶段：第1阶段提出了一种成本网络用于计算匹配成本,该网络由基础网络层和缩放层组成.第2阶段提出了一种基于多尺度注意力的视差求精网络,该视差求精网络综合了多种视差线索,并加入多尺度注意力机制进一步提高立体匹配精度.该方法在KITTI 2012、KITTI 2015和SceneFlow数据集上的3像素坏点百分比分别为1.13%,1.87%和2.29%.实验结果表明,与国内外同类方法相比,采用多尺度注意力网络的立体匹配方法在匹配精度上获得了较大的提升,尤其是在弱纹理区域及物体边缘处表现较好.     

基于机器视觉的加工刀具磨损监测方法

为了对加工过程中刀具的磨损状态进行监测,针对麻花钻的磨损形式,提出基于机器视觉的加工刀具磨损监测方法. 根据磨损刀具图像的灰度分布特点,提出基于积分图加速和Turky bi-weight核函数的非局部均值去噪方法;采用单、双阈值大津法获取磨损区域的灰度区间,实现对图像的自适应对比度增强;提出基于形态学重构方法的磨损区域局部极值点提取方法,有效完成对磨损区域的检测和边界提取. 该刀具磨损检测方法成功应用于麻花钻头磨损状态的监测过程,实验结果表明,相较于目前已有的机器视觉监测方法,所提出的方法具有更高的检测精度和效率,准确地提取磨损轮廓,从而有效实现对刀具磨损状态的监测和自动化监控加工过程,达到降低人工成本和产品不合格率的目的.