No-Reference Video Quality Assessment using novel hybrid features and two-stage hybrid regression for score level fusion

This paper presents a novel No-Reference Video Quality Assessment (NR-VQA) model that utilizes proposed 3D steerable wavelet transform-based Natural Video Statistics (NVS) features as well as human perceptual features. Additionally, we proposed a novel two-stage regression scheme that significantly improves the overall performance of quality estimation. In the first stage, transform-based NVS and human perceptual features are separately passed through the proposed hybrid regression scheme: Support Vector Regression (SVR) followed by Polynomial curve fitting. The two visual quality scores predicted from the first stage are then used as features for the similar second stage. This predicts the final quality scores of distorted videos by achieving score level fusion. Extensive experiments were conducted using five authentic and four synthetic distortion databases. Experimental results demonstrate that the proposed method outperforms other published state-of-the-art benchmark methods on synthetic distortion databases and is among the top performers on authentic distortion databases. The source code is available at https://github.com/anishVNIT/two-stage-vqa.     

儿童用品TBT通报数据可视化预警研究

探索采用数据可视化技术分析儿童用品TBT通报数据,以可视化图形图像呈现通报热点并揭示趋势信息,提出对策与建议,助力为儿童用品产业升级、TBT预警数据分析和信息传播工作提供新思路,提高中小企业的国外市场准入机会。     

水下图像处理技术研究综述

随着自主式水下机器人的发展，水下探测技术成为新的研究热点。然而，吸收效应和散射效应导致水下获取的图像存在雾化和色彩偏差等缺陷。降质的水下图像在一定程度上降低了水下目标识别的准确性。为了改善水下图像质量，国内外学者对水下图像处理方法进行了深入研究。因水下图像处理方法对提升水下目标识别准确性具有良好的促进作用，故其具有重要的研究与分析价值。介绍了水下成像模型，分析了水下图像视觉质量下降的原理；根据水下物理成像模型将水下图像处理方法分为水下图像增强与水下图像复原，并分别对两类方法的研究现状进行分析与归纳；最后，总结与讨论了各类方法的优缺点，并展望了未来的发展方向。     

Deployment of a cloud pipeline for real-time visual inspection using fast streaming high-definition images

We investigate the challenges of building an end-to-end cloud pipeline for real-time intelligent visual inspection system for use in automotive manufacturing. Current methods of visual detection in automotive assembly are highly labor intensive, and thus prone to errors. An automated process is sought that can operate within the real-time constraints of the assembly line and can reduce errors. Components of the cloud pipeline include capture of a large set of high-definition images from a camera setup at the assembly location, transfer and storage of the images as needed, execution of object detection, and notification to a human operator when a fault is detected. The end-to-end execution must complete within a fixed time frame before the next car arrives in the assembly line. In this article, we report the design, development, and experimental evaluation of the tradeoffs of performance, accuracy, and scalability for a cloud system.     

Multiobjective PSO based adaption of neural network topology for pixel classification in satellite imagery

The proposed work involves the multiobjective PSO based adaption of optimal neural network topology for the classification of multispectral satellite images. It is per pixel supervised classification using spectral bands (original feature space). This paper also presents a thorough experimental analysis to investigate the behavior of neural network classifier for given problem. Based on 1050 number of experiments, we conclude that following two critical issues needs to be addressed: (1) selection of most discriminative spectral bands and (2) determination of optimal number of nodes in hidden layer. We propose new methodology based on multiobjective particle swarm optimization (MOPSO) technique to determine discriminative spectral bands and the number of hidden layer node simultaneously. The accuracy with neural network structure thus obtained is compared with that of traditional classifiers like MLC and Euclidean classifier. The performance of proposed classifier is evaluated quantitatively using Xie-Beni and β indexes. The result shows the superiority of the proposed method to the conventional one.     

Effects of apparent image velocity and complexity on the dynamic visual field using a high-speed train driving simulator

Train driving is a highly visual task. The visual capabilities of the train driver affects driving safety and driving performance. Understanding the effects of train speed and background image complexity on the visual behavior of the high-speed train driver is essential for optimizing performance and safety. This study investigated the role of the apparent image velocity and complexity on the dynamic visual field of drivers. Participants in a repeated-measures experiment drove a train at nine different speeds in a state-of-the-art high-speed train simulator. Eye movement analysis indicated that the effect of image velocity on the dynamic visual field of high-speed train driver was significant while image complexity had no effect on it. The fixation range was increasingly concentrated on the middle of the track as the speed increased, meanwhile there was a logarithmic decline in fixation range for areas surrounding the track. The extent of the visual search field decreased gradually, both vertically and horizontally, as the speed of train increased, and the rate of decrease was more rapid in the vertical direction. A model is proposed that predicts the extent of this tunnel vision phenomenon as a function of the train speed.Relevance to industryThis finding can be used as a basis for the design of high-speed railway system and as a foundation for improving the operational procedures of high-speed train driver for safety.     

基于时频域的卷积神经网络运动想象脑电信号识别方法

针对目前运动想象脑电（EEG）信号识别率较低的问题，考虑到脑电信号蕴含着丰富的时频信息，提出一种基于时频域的卷积神经网络（CNN）运动想象脑电信号识别方法。首先，利用短时傅里叶变换（STFT）对脑电信号的相关频带进行预处理，并将多个电极的时频图组合构造出一种二维时频图；然后，针对二维时频图的时频特性，通过一维卷积的方法设计了一种新颖的CNN结构；最后，通过支持向量机（SVM）对CNN提取的特征进行分类。基于BCI数据集的实验结果表明，所提方法的平均识别率为86.5%，优于其他传统运动想象脑电信号识别方法；同时将该方法应用在智能轮椅上，验证了其有效性。     

Characterizing physical habitat preferences and thermal refuge occupancy of brook trout (Salvelinus fontinalis) and Atlantic salmon (Salmo salar) at high river temperatures

Anthropogenic influences, including climate change, are increasing river temperatures in northern and temperate regions and threatening the thermal habitats of native salmonids. When river temperatures exceed the tolerance levels of brook trout and Atlantic salmon, individuals exhibit behavioural thermoregulation by seeking out cold‐water refugia – often created by tributaries and groundwater discharge. Thermal infrared (TIR) imagery was used to map cold‐water anomalies along a 53 km reach of the Cains River, New Brunswick. Trout and salmon parr did not use all identified thermal anomalies as refugia during higher river temperature periods (>21°C). Most small‐bodied trout (8–30 cm) were observed in 80% of the thermal anomalies sampled. Large‐bodied trout (>35 cm) required a more specific set of physical habitat conditions for suitable refugia, that is, 100% of observed large trout used 30% of the anomalies sampled and required water depths >65 cm within or adjacent to the anomaly. Densities of trout were significantly higher within anomalies compared with areas of ambient river temperature. Salmon parr were less aligned with thermal anomalies at the observed temperatures, that is, 59% were found in 65% of the sampled anomalies; and densities were not significantly different within/ outside anomalies. Salmon parr appeared to aggregate at 27°C, and after several events over 27°C variability in aggregation behaviour was observed – some fish aggregated at 25°C, others did not. We stipulate this is due to variances of thermal fatigue. Habitat suitability curves were developed for velocity, temperature, depth, substrate, and deep water availability to characterize conditions preferred by fish during high‐temperature events. These findings are useful for managers as our climate warms, and can potentially be used as a tool to help conserve and enhance thermal refugia for brook trout and Atlantic salmon in similar systems.     

基于深度卷积神经网络的视觉里程计研究

视觉里程计利用视频信息来估计相机运动的位姿参数，实现对智能体的定位。传统视觉里程计方法需要特征提取、特征匹配/跟踪、外点剔除、运动估计、优化等流程，解算非常复杂，因此，提出了基于卷积神经网络的方法来实现端对端的单目视觉里程计。借助卷积神经网络对彩色图片自动学习提取图像帧间变化的全局特征，将用于分类的卷积神经网络转化为帧间时序特征网络，通过三层全连接层输出相机的帧间相对位姿参数。在KITTI数据集上的实验结果表明，提出的Deep-CNN-VO模型可以较准确地估计车辆的运动轨迹，证明了方法的可行性。在简化了复杂模型的基础上，与传统的视觉里程计系统相比，该模型的精度也有所提高。