High quality 3D reconstruction based on fusion of polarization imaging and binocular stereo vision

Polarization imaging can retrieve inaccurate objects’ 3D shapes with fine textures, whereas coarse but accurate depths can be provided by binocular stereo vision. To take full advantage of these two complementary techniques, we investigate a novel 3D reconstruction method based on the fusion of polarization imaging and binocular stereo vision for high quality 3D reconstruction. We first generate the polarization surface by correcting the azimuth angle errors on the basis of registered binocular depth, to solve the azimuthal ambiguity in the polarization imaging. Then we propose a joint 3D reconstruction model for depth fusion, including a data fitting term and a robust low-rank matrix factorization constraint. The former is to transfer textures from the polarization surface to the fused depth by assuming their relationship linear, whereas the latter is to utilize the low-frequency part of binocular depth to improve the accuracy of the fused depth considering the influences of missing-entries and outliers. To solve the optimization problem in the proposed model, we adopt an efficient solution based on the alternating direction method of multipliers. Extensive experiments have been conducted to demonstrate the efficiency of the proposed method in comparison with state-of-the-art methods and to exhibit its wide application prospects in 3D reconstruction.     

基于机器视觉的轮胎表面缺陷检测系统的研究与应用

在传统的轮胎表面缺陷依靠人工检测,存在劳动强度高、受人的主观影响大以及效率低下的问题。针对这一现象,研究了一种基于机器视觉的轮胎表面缺陷3D检测系统。该系统依靠机器视觉系统获取检测轮胎的表面图像,然后创建3D模型、判定缺陷类型,最终实现实时自动预警,为轮胎生产商提供一种自动化检测方案。系统集成了先进的技术、软件和工具,配套的信息管控系统可以对轮胎型号和生产数据进行采集、存储、分析,以便在生产过程中实现更高效、更可靠的质量控制,具有较高的实际应用推广价值。     

Shared human–robot path following control of an unmanned ground vehicle

This paper considers the shared path following control of an unmanned ground vehicle by a single person. A passive measure of human intent is used to blend the human and machine inputs in a mixed initiative approach. The blending law is combined with saturated super-twisting sliding mode speed and heading controllers, so that exogenous disturbances can be counteracted via equivalent control. It is proven that when the proposed blending law is used, the combined control signals from both the human and automatic controller respect the actuator magnitude constraints of the machine. To demonstrate the approach, shared control experiments are performed using an unmanned ground vehicle, which follows a lawn mower pattern shaped path.     

Optimal design of nonlinear model predictive controller based on new modified multitracker optimization algorithm

The controller design for the robotic manipulator faces different challenges such as the system's nonlinearities and the uncertainties of the parameters. Furthermore, the tracking of different linear and nonlinear trajectories represents a vital role by the manipulator. This paper suggests an optimal design for the nonlinear model predictive control (NLMPC) based on a new improved intelligent technique and it is named modified multitracker optimization algorithm (MMTOA). The proposed modification of the MTOA is carried out based on opposition-based learning (OBL) and quasi OBL approaches. This modification improves the exploration behavior of the MTOA to prevent it from becoming trapped in a local optimum. The proposed method is applied on the robotic manipulator to track different linear and nonlinear trajectories. The NLMPC parameters are tuned by the MMTOA rather than the trial and error method of the designer. The proposed NLMPC based on MMTOA is compared with the original MTOA, genetic algorithm, and cuckoo search algorithm in literature. The superiority and effectiveness of the proposed controller are confirmed to track different linear and nonlinear trajectories. Furthermore, the robustness of the proposed method is emphasized against the uncertainties of the parameters.     

Science fiction reduces the eeriness of android robots: A field experiment

As suggested by the uncanny valley hypothesis, robots that resemble humans likely elicit feelings of eeriness. Based on the psychological model of meaning maintenance, we expected that the uncanny valley experience could be mitigated through a fictional story, due to the meaning-generating function of narratives. A field experiment was conducted, in which 75 participants interacted with the humanlike robot Telenoid. Prior to the interaction, they either read a short story, a non-narrative leaflet about the robot, or they received no preliminary information. Eeriness ratings were significantly lower in the science fiction condition than in both other conditions. This effect was mediated by higher perceived human-likeness of the robot. Our findings suggest that science fiction may provide meaning for otherwise unsettling future technologies.     

Effects of apparent image velocity and complexity on the dynamic visual field using a high-speed train driving simulator

Train driving is a highly visual task. The visual capabilities of the train driver affects driving safety and driving performance. Understanding the effects of train speed and background image complexity on the visual behavior of the high-speed train driver is essential for optimizing performance and safety. This study investigated the role of the apparent image velocity and complexity on the dynamic visual field of drivers. Participants in a repeated-measures experiment drove a train at nine different speeds in a state-of-the-art high-speed train simulator. Eye movement analysis indicated that the effect of image velocity on the dynamic visual field of high-speed train driver was significant while image complexity had no effect on it. The fixation range was increasingly concentrated on the middle of the track as the speed increased, meanwhile there was a logarithmic decline in fixation range for areas surrounding the track. The extent of the visual search field decreased gradually, both vertically and horizontally, as the speed of train increased, and the rate of decrease was more rapid in the vertical direction. A model is proposed that predicts the extent of this tunnel vision phenomenon as a function of the train speed.Relevance to industryThis finding can be used as a basis for the design of high-speed railway system and as a foundation for improving the operational procedures of high-speed train driver for safety.     

Rapid screening of DON contamination in whole wheat meals by Vis/NIR spectroscopy and computer vision coupling technology

This work intends to develop an online experimental system for screening of deoxynivalenol (DON) contamination in whole wheat meals by visible/near-infrared (Vis/NIR) spectroscopy and computer vision coupling technology. Spectral and image information of samples with various DON levels was collected at speed of 0.15 m s⁻¹ on a conveyor belt. The two-type data were then integrated and subjected to chemometric analysis. Discriminant analysis showed that samples could be classified by setting 1000 μg kg⁻¹ as the cut-off value. The best correct classified rate obtained in prediction was 93.55% based on fusion of spectral and image features, with reduced prediction uncertainty as compared to single feature. However, quantification of DON by quantitative analysis was not successful due to poor model performance. These results indicate that, although not accurate enough to provide conclusive result, this coupling technology could be adopted for rapid screening of DON contamination in cereals and feeds during processing.     

面向草莓抓取的气动四叶片软体抓手研制

农林业中果蔬的自动化采摘需求日趋强烈,末端抓手是实现无损采摘的关键。传统的末端抓手以刚性结构居多,现有的各种柔性抓手也存在抓取力不足、包覆性不佳等缺点。本文以草莓的无损采摘为研究对象,提出将草莓外部轮廓曲线作为设计曲线,设计了一种新型气动四叶片软体抓手。首先,对软体抓手的结构做仿真优化,提出一种安全地附着在目标物表面的设想。然后,在进行草莓表面的最小破坏应力试验的基础上,测试了软体抓手的末端力,验证了其实现无损抓取的可行性。再次,利用动态捕捉技术,研究了软体抓手叶面的弯曲变形规律。最后,选择使用弧线型气体通道的软体抓手进行了草莓抓取测试,结果证明了气动四叶片软体抓手可以实现草莓的无损抓取,抓取成功率达90%,破损率为2%,表明所研制的四叶片软体抓手用于草莓抓取时具有良好的稳定性和实用性,可用于草莓采摘的末端执行器。本研究也可为其他易损果蔬的采摘技术提供理论基础和技术支撑。     

Maneuverability modeling and trajectory tracking for fish robot

This study develops a 6-DOF mathematical model for a robotic fish that considers surge, sway, heave, roll, pitch, and yaw. The model considers the conditions of a fish swimming in ocean current perturbations similar to the ocean current perturbations of the slender-body autonomous underwater vehicles. For swimming and turning behaviors, a nonlinear, dynamic, carangiform locomotion model is derived by using a planar four-link model. A 2-DOF barycenter mechanism is proposed to provide body stabilization and to serve as an actuating device for active control design. A barycenter control scheme is developed to change the center of gravity of the robot fish body by moving balancing masses along two axes. The projected torque on x and y axes propel pitch and roll angles to the desired settings. A Stabilizing controller, fish-tail mechanism, rigid body dynamics, and kinematics are incorporated to enable the fish robot to move in three dimensional space. Simulation results have demonstrated maneuverability and control system performance of the developed controller which is proposed to conduct path tracking of the robot fish as it swims under current perturbations.     

Perception‐aware autonomous mast motion planning for planetary exploration rovers

Highly accurate real‐time localization is of fundamental importance for the safety and efficiency of planetary rovers exploring the surface of Mars. Mars rover operations rely on vision‐based systems to avoid hazards as well as plan safe routes. However, vision‐based systems operate on the assumption that sufficient visual texture is visible in the scene. This poses a challenge for vision‐based navigation on Mars where regions lacking visual texture are prevalent. To overcome this, we make use of the ability of the rover to actively steer the visual sensor to improve fault tolerance and maximize the perception performance. This paper answers the question of where and when to look by presenting a method for predicting the sensor trajectory that maximizes the localization performance of the rover. This is accomplished by an online assessment of possible trajectories using synthetic, future camera views created from previous observations of the scene. The proposed trajectories are quantified and chosen based on the expected localization performance. In this study, we validate the proposed method in field experiments at the Jet Propulsion Laboratory (JPL) Mars Yard. Furthermore, multiple performance metrics are identified and evaluated for reducing the overall runtime of the algorithm. We show how actively steering the perception system increases the localization accuracy compared with traditional fixed‐sensor configurations.