结合句法依存信息的方面级情感分类

引入句法依存信息到原方面术语,提出一种新的方面术语表示方法,利用Glove词向量表示单词以及单词与单词之间的依存关系,构造出包含句法依存信息的依存关系邻接矩阵和依存关系表示矩阵,利用图卷积神经网络和多头注意力机制将句法依存信息融入到方面术语中,使得方面术语表达与上下文结构高度相关。将改进后的方面词术语表示替换到现有模型后,模型泛化能力得到有效提升。对比试验和分析结果表明:该方法具有有效性和泛化性。     

基于改进残差特征蒸馏的轻量级超分辨率网络

基于深度学习的图像超分辨率算法通常采用递归的方式或参数共享的策略来减少网络参数，这将增加网络的深度，使得运行网络花费大量的时间，从而很难将模型部署到现实生活中。为了解决上述问题，本文设计一种轻量级超分辨率网络，对中间特征的关联性及重要性进行学习，且在重建部分结合高分辨率图像的特征信息。首先，引入层间注意力模块，通过考虑层与层之间的相关性，自适应地分配重要层次特征的权重。其次，使用增强重建模块提取高分辨率图像中更精细的特征信息，以此得到更加清晰的重建图片。通过大量的对比实验表明，本文设计的网络与其他轻量级模型相比，有更小的网络参数量，并且在重建精度和视觉效果上都有一定的提升。     

No-Reference Video Quality Assessment using novel hybrid features and two-stage hybrid regression for score level fusion

This paper presents a novel No-Reference Video Quality Assessment (NR-VQA) model that utilizes proposed 3D steerable wavelet transform-based Natural Video Statistics (NVS) features as well as human perceptual features. Additionally, we proposed a novel two-stage regression scheme that significantly improves the overall performance of quality estimation. In the first stage, transform-based NVS and human perceptual features are separately passed through the proposed hybrid regression scheme: Support Vector Regression (SVR) followed by Polynomial curve fitting. The two visual quality scores predicted from the first stage are then used as features for the similar second stage. This predicts the final quality scores of distorted videos by achieving score level fusion. Extensive experiments were conducted using five authentic and four synthetic distortion databases. Experimental results demonstrate that the proposed method outperforms other published state-of-the-art benchmark methods on synthetic distortion databases and is among the top performers on authentic distortion databases. The source code is available at https://github.com/anishVNIT/two-stage-vqa.     

Dilated and soft attention-guided convolutional neural network for breast cancer histology images classification

Breast cancer is one of the most common types of cancer in women, and histopathological imaging is considered the gold standard for its diagnosis. However, the great complexity of histopathological images and the considerable workload make this work extremely time-consuming, and the results may be affected by the subjectivity of the pathologist. Therefore, the development of an accurate, automated method for analysis of histopathological images is critical to this field. In this article, we propose a deep learning method guided by the attention mechanism for fast and effective classification of haematoxylin and eosin-stained breast biopsy images. First, this method takes advantage of DenseNet and uses the feature map's information. Second, we introduce dilated convolution to produce a larger receptive field. Finally, spatial attention and channel attention are used to guide the extraction of the most useful visual features. With the use of fivefold cross-validation, the best model obtained an accuracy of 96.47% on the BACH2018 dataset. We also evaluated our method on other datasets, and the experimental results demonstrated that our model has reliable performance. This study indicates that our histopathological image classifier with a soft attention-guided deep learning model for breast cancer shows significantly better results than the latest methods. It has great potential as an effective tool for automatic evaluation of digital histopathological microscopic images for computer-aided diagnosis.     

面向高光谱影像分类的多特征流形鉴别嵌入

鉴于传统维数约减方法对高光谱遥感影像进行降维时,往往只利用了单一的光谱特征,限制了分类性能的提升。提出一种基于多特征流形鉴别嵌入的维数约减方法,该方法首先提取高光谱数据的LBP(Local Binary Patterns)纹理特征,然后利用样本点的光谱-LBP特征联合距离及类别信息构建类内图和类间图以发现高光谱影像中的鉴别流形结构,在低维嵌入空间中不仅保持来自同一像素的光谱和纹理特征的相似性,而且使同类点尽可能紧致、不同类点远离,实现空-谱联合低维鉴别特征提取,以有效提高地物分类性能。在Indian Pines和黑河高光谱遥感数据集上的实验表明,本文算法的分类精度在不同实验条件下均优于传统的维数约减方法,其分类精度可达95.05%和96.20%,在较少训练样本条件下优势更为明显,有利于实际应用。     

飞秒激光光斑轮廓的傅里叶描述子重建及特征提取

在利用飞秒激光对单晶硅材料进行微尺度烧蚀时,衍生的等离子体发光光斑中蕴含着大量的加工信息。如何有效提取光斑图像的几何特征信息,对研究飞秒激光烧蚀加工工艺过程具有重要意义。轮廓特征是描述激光光斑最重要的特征之一,本文着重分析了等离子体光斑轮廓特征与光斑运动规律间的关系及光斑运动情况分类方法。首先,考虑到光斑微弱的特性,对光斑图像进行增强处理。其次,采用链码方法提取光斑轮廓特征,并利用傅里叶描述子低频特性,选取少量的描述子重建光斑图像轮廓特征,减少了复杂的计算量,有效提高了光斑图像分类的速度与质量。最后,运用Hu不变矩特征证明傅里叶描述子用于提取激光光斑对轮廓特征的有效性。     

基于深度分离卷积的情绪识别机器人即时交互研究

情绪识别是人工智能领域的研究热点,人机交互系统若能感知人类的情感行为并能表达情感,将会使机器人与人类的交互更加自然。人类主要通过面部表情、语义语调、肢体语言等几个方面获取情感信息。以拥有高自由度的NAO机器人为应用平台,设计了机器人面部情绪识别和肢体情感表达的人机交互系统。首先,引入深度分离卷积算法对人脸表情(生气、恐惧、伤心、高兴、惊讶和中性)进行特征提取和分类,结果表明通过训练得到的网络模型对FER2013人脸表情测试集的预测正确率可以达到0.711;其次,设计NAO机器人的肢体动作,对6种面部情感做出了分类;最后,对机器人实时表达使用者的情绪状态进行了测试,反馈时间均在2 s内,并对连续10帧预测结果进行了统计分析。     

Super-Resolution Reconstruction of Images Based on Microarray Camera

In the field of images and imaging, super-resolution (SR) reconstruction of images is a technique that converts one or more low-resolution (LR) images into a highresolution (HR) image. The classical two types of SR methods are mainly based on applying a single image or multiple images captured by a single camera. Microarray camera has the characteristics of small size, multi views, and the possibility of applying to portable devices. It has become a research hotspot in image processing. In this paper, we propose a SR reconstruction of images based on a microarray camera for sharpening and registration processing of array images. The array images are interpolated to obtain a HR image initially followed by a convolution neural network (CNN) procedure for enhancement. The convolution layers of our convolution neural network are 3×3 or 1×1 layers, of which the 1×1 layers are used to improve the network performance particularly. A bottleneck structure is applied to reduce the parameter numbers of the nonlinear mapping and to improve the nonlinear capability of the whole network. Finally, we use a 3×3 deconvolution layer to significantly reduce the number of parameters compared to the deconvolution layer of FSRCNN-s. The experiments show that the proposed method can not only ameliorate effectively the texture quality of the target image based on the array images information, but also further enhance the quality of the initial high resolution image by the improved CNN.     

Eye movements and visual discomfort when viewing stereoscopic 3D content

The visual brain fuses the left and right images projected onto the two eyes from a stereoscopic 3D (S3D) display, perceives parallax, and rebuilds a sense of depth. In this process, the eyes adjust vergence and accommodation to adapt to the depths and parallax of the points they gazed at. Conflicts between accommodation and vergence when viewing S3D content potentially lead to visual discomfort. A variety of approaches have been taken towards understanding the perceptual bases of discomfort felt when viewing S3D, including extreme disparities or disparity gradients, negative disparities, dichoptic presentations, and so on. However less effort has been applied towards understanding the role of eye movements as they relate to visual discomfort when viewing S3D. To study eye movements in the context of S3D viewing discomfort, a Shifted-S3D-Image-Database (SSID) is constructed using 11 original nature scene S3D images and their 6 shifted versions. We conducted eye-tracking experiments on humans viewing S3D images in SSID while simultaneously collecting their judgments of experienced visual discomfort. From the collected eye-tracking data, regions of interest (ROIs) were extracted by kernel density estimation using the fixation data, and an empirical formula fitted between the disparities of salient objects marked by the ROIs and the mean opinion scores (MOS). Finally, eye-tracking data was used to analyze the eye movement characteristics related to S3D image quality. Fifteen eye movement features were extracted, and a visual discomfort predication model learned using a support vector regressor (SVR). By analyzing the correlations between features and MOS, we conclude that angular disparity features have a strong correlation with human judgments of discomfort.