基于多模态融合的情绪检测研究

情绪检测技术正逐渐应用到检测机械员工损伤、视频游戏用户体验、协助医护人员评估患者健康等各行各业,围绕它的领域都在持续增长。本篇论文中,为更好地识别AFEW数据集中视频片段包含的情绪信息,我们加入语义模态,与表情模态、语音模态模态进行融合。表情模态使用Resnet模型,语音模态使用VGG19模型,语义模态使用TextCNN模型,并设计后期融合策略对三种模态的检测结果进行融合,提高了准确率。     

基于高分辨率SAR影像和深度学习的输电杆塔智能识别研究

近年来,强降雪、洪涝等极端气象灾害频发,对输电线路安全运行造成巨大挑战。星载合成孔径雷达技术(SAR)技术作为一种广域、全天时、全天候的新型感知技术,可实现大范围输电线路受灾情况的快速评估。针对复杂背景下的高分辨率SAR影像中的电塔识别问题,文章提出一种结合YOLO v2和VGG模型级联的Two-Stage目标检测算法。在Stage-1阶段,基于YOLO v2对整景SAR影像进行电塔检测;在Stage-2阶段,基于VGG对Stage-1的检测结果进行假阳性消除。以2018年1月强降雪后某地的COSMO影像为例进行测试,结果表明电塔召回率可达85. 7%,证明文中方法可较准确地识别整景SAR影像的电塔目标。     

基于改进的SSD监理目标检测研究

针对装饰装修工程中由人工验收带来的诸多问题,文中提出了一种改进的SSD算法并将其应用于监理工作来代替人工验收,推动智能监理的实现。由于SSD算法存在对同一目标复检以及小目标检测效果欠佳等问题,故文中利用DPN网络替换基础特征提取网络VGG16。DPN结合了Resnet和Densenet的优点,具有更好的特征提取能力。通过加权FPN融合特征图,突出不同层特征图的贡献,丰富用于预测的特征图语义。利用深度可分离卷积降低模型的参数量,提高算法的推理速度。实验对比发现,改进后模型的平均精度提升了3.47%,对小数目检测平均精度的提升可达15%,证明新模型在监理目标检测任务中效果良好。     

Transfer Learning on Deep Neural Networks to Detect Pornography

While the internet has a lot of positive impact on society, there are negative components. Accessible to everyone through online platforms, pornography is, inducing psychological and health related issues among people of all ages. While a difficult task, detecting pornography can be the important step in determining the porn and adult content in a video. In this paper, an architecture is proposed which yielded high scores for both training and testing. This dataset was produced from 190 videos, yielding more than 19 h of videos. The main sources for the content were from YouTube, movies, torrent, and websites that hosts both pornographic and non-pornographic contents. The videos were from different ethnicities and skin color which ensures the models can detect any kind of video. A VGG16, Inception V3 and Resnet 50 models were initially trained to detect these pornographic images but failed to achieve a high testing accuracy with accuracies of 0.49, 0.49 and 0.78 respectively. Finally, utilizing transfer learning, a convolutional neural network was designed and yielded an accuracy of 0.98.     

结合SoftPool的VGG19与CapsNet相级联的表情识别模型研究

表情识别作为计算机视觉领域的研究热点,在情感识别、人机交互、智能安防等领域有着重要的应用.文章针对VGG19在训练人脸表情数据集时由于全连接层参数量过大而易过拟合的问题,利用胶囊网络CapsNet对VGG19的全连接层进行替换,以实现VGG19与CapsNet相级联,从而改善训练时过拟合的问题,同时使得级联后的模型在RAF-DB数据集上的精度提高了5.28％.针对VGG19特征提取网络的MaxPool易丢失人脸特征图信息的问题,利用SoftPool对MaxPool进行替换,从而在最大程度上保留了人脸的细粒度特征.实验结果表明,改进后的模型在RAF-DB数据集上取得了 84.21％的精度,在FER2013数据集上取得了 73.16％的精度,表情识别效果更优.     

基于改进VGG网络的单体热电池X光图像无损检测方法研究

为解决单体热电池生产中出现的安装错误、人工检测耗时耗力的问题,提出一个结合迁移学习和卷积 神 经网络(convolutional neural network,CNN) 的单体热电池缺陷检测模型。首先,对数据集图像进行裁剪、加噪等预处理,以VGG16(visual geometry group 16) 网络作为 模型的骨干架构,在瓶颈层后增添选择性核(selective kernel,SK) 卷积;然后,增添全局平均池化(global average pooling,GAP) 层, 增加Dropout层及添加 L2 正则化等微调操作,得到单体热电池缺陷检测模型Q-VGGNet;最后,在大型公开数据集ImageNet上进 行预训练学习,将获得的权重参数迁移到单体热电池图像识别模型Q-VGGNet上。测试实验表明:6种 网络模型对数据集缺陷图像的总体识别准确率分别达到了98.39%、94.44%、97.27%、96.34%、93.71%、 95.61%,Q-VGGNet网 络模型 对合格图像和 漏装负极、极耳断裂、漏装集流片3种缺陷图像 识别准确率 分别达到了99.6%,95.9%,99.6%和98.4%。检测结果表明:该方法能够更准确、快速地检测热电池缺陷, 拥有良好的缺陷诊断能力,较传统方法提高近3%,为人工检测单体热电池缺陷提供了良好的解决途径。     

融合格拉姆角场的深度特征学习在痕量气体浓度识别中的应用研究

针对气体绝缘金属封闭式组合电器(gas insulated switchgear, GIS)设备中痕量气体紫外分析光谱信号易出现吸收峰重叠的问题,提出了一种结合格拉姆角场(Gram''s angle field, GAF)和VGG16改进模型的多组分痕量气体的定量检测方法。首先利用GAF将一维紫外光谱信号转换为时序图像,将光谱信号映射为具有丰富特征信息的图像形式,从而提升原始光谱信号的特征表达能力。其次将GAF特征图输入到VGG16改进模型中,实现痕量气体浓度的特征识别。最后通过不同浓度下采集到的CS2、SO2和H2S的单组分气体和混合气体,与卷积神经网络(convolutional neural network, CNN)、VGG16和SDP_VGG16等模型进行对比实验,并结合受试者工作特征曲线下面积(area under the curve, AUC)进行验证。结果表明,该方法可以有效地检测出SF6分解所产生的CS2、SO2和H2S痕量气体,是一种行之有效的特征提取方法。     

Detection of COVID-19 from chest X-ray images: Boosting the performance with convolutional neural network and transfer learning

Coronavirus disease (COVID-19) is a pandemic that has caused thousands of casualties and impacts all over the world. Most countries are facing a shortage of COVID-19 test kits in hospitals due to the daily increase in the number of cases. Early detection of COVID-19 can protect people from severe infection. Unfortunately, COVID-19 can be misdiagnosed as pneumonia or other illness and can lead to patient death. Therefore, in order to avoid the spread of COVID-19 among the population, it is necessary to implement an automated early diagnostic system as a rapid alternative diagnostic system. Several researchers have done very well in detecting COVID-19; however, most of them have lower accuracy and overfitting issues that make early screening of COVID-19 difficult. Transfer learning is the most successful technique to solve this problem with higher accuracy. In this paper, we studied the feasibility of applying transfer learning and added our own classifier to automatically classify COVID-19 because transfer learning is very suitable for medical imaging due to the limited availability of data. In this work, we proposed a CNN model based on deep transfer learning technique using six different pre-trained architectures, including VGG16, DenseNet201, MobileNetV2, ResNet50, Xception, and EfficientNetB0. A total of 3886 chest X-rays (1200 cases of COVID-19, 1341 healthy and 1345 cases of viral pneumonia) were used to study the effectiveness of the proposed CNN model. A comparative analysis of the proposed CNN models using three classes of chest X-ray datasets was carried out in order to find the most suitable model. Experimental results show that the proposed CNN model based on VGG16 was able to accurately diagnose COVID-19 patients with 97.84% accuracy, 97.90% precision, 97.89% sensitivity, and 97.89% of F1-score. Evaluation of the test data shows that the proposed model produces the highest accuracy among CNNs and seems to be the most suitable choice for COVID-19 classification. We believe that in this pandemic situation, this model will support healthcare professionals in improving patient screening.     

基于VGG网络的鲁棒目标跟踪算法

针对传统目标跟踪算法中当目标被遮挡和受光照强度变化等多种因素干扰时,相关滤波器模板更新不准确,误差逐帧累积最终导致目标跟踪失败,提出了一种基于VGG网络的鲁棒目标跟踪算法。首先通过VGG网络对第1帧输入图像中的局部上下文区域提取平均特征图来建立相关滤波器模板;然后通过VGG网络对后续帧输入图像中的局部上下文区域提取平均特征图和仿射变换平均特征图;其次与核相关滤波跟踪算法相结合,自适应确定目标位置和最终目标位置;最后自适应更新最终平均特征图和最终相关滤波器模板。实验结果表明,本文算法在目标被遮挡和受光照强度变化等多种因素干扰时,仍具有较高的目标跟踪精度和较强的鲁棒性。     

稀疏深度特征对传统显著性检测的优化

目的 显著性目标检测算法主要分为基于低级特征的传统方法和基于深度学习的新方法,传统方法难以捕获对象的高级语义信息,基于深度学习的新方法能捕获高级语义信息却忽略了边缘特征。为了充分发挥两种方法的优势,基于将二者结合的思路,本文利用稀疏能使得显著性对象指向性凝聚的优势,提出了一种基于稀疏自编码和显著性结果优化的方法。方法 对VGG（visual geometry group）网络第4个池化层的特征图进行稀疏自编码处理,得到5张稀疏显著性特征图,再与传统方法得到的显著图一起输入卷积神经网络进行显著性结果优化。结果 使用DRFI（discriminative regional feature integration）、HDCT（high dimensional color transform）、RRWR（regularized random walks ranking）和CGVS（contour-guided visual search）等传统方法在DUT-OMRON、ECSSD、HKU-IS和MSRA等公开数据集上进行实验,表明本文算法有效改善了显著性对象的F值和MAE（mean absolute error）值。在F值提高方面,优化后的DRFI方法提升最高,在HKU-IS数据集上提高了24.53%。在MAE值降低方面,CGVS方法降低最少,在ECSSD数据集上降低了12.78%,降低最多的接近50%。而且本模型结构简单,参数少,计算效率高,训练时间约5 h,图像的平均测试时间约为3 s,有很强的实际应用性。结论 本文提出了一种显著性结果优化算法,实验结果表明算法有效改善了显著性对象F值和MAE值,在对显著性对象检测要求越来越准确的对象识别等任务中有较好的适应性和应用性前景。