基于深度迁移自编码器的变工况下滚动轴承故障诊断方法

在实际工业场景下的轴承故障诊断,存在轴承故障样本不足,训练样本与实际信号样本存在分布差异的问题;文章提出一种新的基于深度迁移自编码器的故障诊断方法FS-DTAE,应用于不同工况下的轴承故障诊断;该方法首先采用小波包变换进行信号处理与特征提取;其次,采用提出的基于朴素贝叶斯与域间差异的特征选取(FSBD)方法对统计特征进行评估,选取更有利于跨域故障诊断和迁移学习的特征;然后,利用源域特征数据训练深度自编码器,将训练得到的模型参数迁移至目标域,再利用目标域正常状态样本对深度迁移自编码器模型进行微调,微调后的模型用于目标域无标签特征数据的故障分类;最后,基于CWRU轴承故障数据开展不同工况下故障诊断实验,结果表明,所提出的FS-DTAE方法能够有效提高不同工况下的故障诊断准确率。     

基于卷积注意力特征迁移学习的滚动轴承故障诊断

针对变工况条件下因源域和目标域样本数据分布差异大造成滚动轴承故障诊断准确率较低的问题,提出一种新的迁移学习方法——卷积注意力特征迁移学习(Convolutional Attention-based Feature Transfer Learning, CAFTL),并用于变工况条件下的滚动轴承故障诊断。在所提出的CAFTL中,将源域和目标域样本经过多头自注意力计算再经过归一化之后,输入到卷积神经网络中得到对应的源域和目标域特征;然后通过域自适应迁移学习网络将两域特征投影到同一个公共特征空间内;接着,利用由源域有标签样本构建的分类器进行分类;最后,利用随机梯度下降(Stochastic Gradient Descent, SGD)方法对CAFTL进行训练和参数更新,得到CAFTL的最优参数集后将参数优化后的CAFTL用于滚动轴承待测样本的故障诊断。滚动轴承故障诊断实例验证了所提出的方法的有效性。     

变工况滚动轴承故障诊断方法综述

智能制造背景下,旋转机械工况更加复杂,运行条件更加严峻,设备的运行状态监测与故障诊断更加重要。变工况条件下,轴承振动信号存在幅值变、脉动冲击间隔、采样相位不恒定和信号噪声污染等特点,传统滚动轴承故障诊断方法的应用受到了限制。针对变工况条件下的轴承故障诊断技术,发展了以阶次跟踪、时频分析、随机振动以及混沌理论等人工提取特征的信号解调与分析方法、以卷积神经网络、自编码器与深度置信网络为代表的深度学习方法以及迁移学习方法。回顾近五年变工况轴承故障诊断领域的进展,从算法原理、算法优化以及算法实际应用等角度,详细介绍几种当前主流的变工况故障诊断方法,讨论各类算法的优势不足及适用场景,为后续的研究指明方向。     

面向工业监控典型监督任务的深度迁移学习方法:现状、挑战与展望

基于深度迁移学习的工业监控方法在近年来获得了大量研究关注,特别是在以故障诊断、软测量等为代表的工业监控典型监督任务中.通过挖掘与迁移相似源域的知识来完成对目标域的建模,这类方法为实际工业场景中变工况等原因导致的跨域监控问题提供了新的思路.本文系统梳理了面向工业监控典型监督任务的深度迁移学习方法,并将其分为基于模型迁移、基于样例迁移与基于特征迁移的工业监控方法.在此基础上,对不同类方法的基本研究思想在故障诊断与软测量任务中的研究进展进行了详细阐述.随后,从实际工业场景的复杂欠数据问题、可迁移性的量化与负迁移问题、工业过程的动态特性问题等角度,指出了当前基于深度迁移学习的工业监控研究中存在的挑战,并对该领域的未来研究方向做出进一步展望.     

基于动态卷积多层域自适应的轴承故障诊断

现有基于深度学习的轴承故障诊断方法对数据具有一定的依赖性,要求训练数据与测试数据具有相同的分布。在变工况的条件下,网络模型的故障诊断精度会因数据分布发生变化而下降。为保证网络模型能够在变工况条件下对轴承的健康状态进行准确识别,基于无监督域自适应理论,提出一种新颖的智能故障诊断网络模型——动态卷积多层域自适应网络。该网络一方面充分利用动态卷积强有力的特征提取能力,提取更多有效的故障特征;另一方面采用相关对齐实施非线性变换,同时对齐多层故障特征分布的二阶统计量,促进源域的诊断知识向目标域迁移,提高了模型在目标域无故障标签条件下的故障识别准确率。最后,在两个数据集共14个迁移任务下进行实验,实验结果表明,动态卷积多层域自适应网络能够实现较高的故障诊断识别精度。     

基于迁移学习的小样本齿轮箱故障诊断方法

实际工程场景中齿轮箱受工况、环境等因素影响,数据难以满足特征分布相同、训练数据充足等条件,如何在变工况情况下对齿轮故障进行诊断是故障诊断领域一大难点。为此,提出了一种结合Logistic混沌麻雀搜索优化算法(LSSA)与深度置信网络(DBN)的智能故障诊断方法,即LSSADBN。首先,将时域振动信号进行快速傅里叶变换(FFT)转换为频域信号作为训练数据集,运用Logistic混沌映射对SSA种群进行初始化,采用LSSA方法对训练数据集进行DBN结构寻优;使用最优结构DBN对源域训练集进行预训练,并加入少量目标域样本用于反向权重调优,最终实现在小样本情况下对目标域齿轮箱健康状况的准确识别。实验对比结果证明,LSSADBN方法在模型调优阶段具有更快的收敛速度,且针对不同的目标域进行迁移时都具备较高的准确率,LSSADBN方法的研究对小样本情况下的齿轮箱故障诊断具有一定的应用价值。     

基于ECAMTL模型的小样本变工况轴承故障诊断

为解决小样本变工况轴承故障诊断中故障诊断模型参数多且泛化性能弱、故障诊断率低、诊断速度慢的问题，提出了将高效通道注意力(Efficient Channel Attention, ECA)机制与元迁移学习(Meta Transfer Learning, MTL)相结合的在线故障诊断方法。首先，将不同工况的原始振动信号转化为二维灰度图像，采用改进后的残差网络作为特征提取器进行特征提取。在不提升模型复杂度的情况下，增强了模型对重要特征的关注度，增强了模型的特征提取能力。之后，将提取到的特征与现场数据结合进行元训练，获得训练参数。最后，在元测试阶段，利用不同工况的元学习任务对模型进行微调，实现在线变工况轴承故障诊断。对比实验验证了本文方法的有效性和泛化能力。     

关联子域对齐网络的跨域高光谱图像分类

目的 近年来,深度网络成功应用于高光谱图像分类。然而,难以获取充足的标记数据大大限制了深度网络的充分训练,进而导致网络对高光谱图像的分类能力下降。为解决以上困难,提出一种关联子域对齐网络的高光谱图像迁移分类方法。方法 基于深度迁移学习方法,通过对两域分布进行多角度、全面领域适应的同时将两域分类器进行差异适配。一方面,利用关联对齐从整体上对齐了两域的二阶统计量信息,适配了两域的全局分布;另一方面,利用局部最大均值差异对齐了相关子域的一阶统计量信息,适配了两域的局部分布。另外,构造一种分类器适配模块并将其加入所提网络中,通过对两域分类器差异进行适配,进一步增强网络的领域适应效果。结果 从4组真实高光谱数据集上的实验结果可看出：在分别采集于不同区域的高光谱图像数据对上,所提方法的精度比排名第2的分类方法高出1.01%、0.42%、0.73%和0.64%。本文方法的Kappa系数也取得最优结果。结论 与现有主流算法相比较,所提网络能够在整体和局部、一阶和二阶统计量上分别对两域进行有效对齐,进而充分利用在源域上训练好的分类器完成对目标域高光谱数据的跨域分类。     

无监督的领域自适应机器阅读理解方法

受益于面向大规模语言学资源的深度学习,预训练语言模型有着较强的语义表示学习能力.其能够借助特定任务场景下的迁移学习,在优化模型性能方面提供重要的支持.目前,预训练语言模型已被引入机器阅读理解研究领域,并展现了较好的优化能力.然而,针对特定领域的数据,微调后的预训练模型仍存在领域适应性问题,即无法解决未知领域中新颖的语言现象.为此,本文提出了一种融合迁移自训练和多任务学习机制的无监督领域自适应模型.具体而言,本文结合生成式阅读理解网络和掩码预测机制形成了多任务学习框架,并利用该框架实现跨领域(源领域至目标领域)的无监督模型迁移技术.此外,本文设计了文本规范化和迁移自训练模式,以此促进目标领域的数据分布适应源领域的数据分布,从而提高模型迁移学习的质量.本文将TweetQA作为目标领域数据集,将SQuAD、CoQA和NarrativeQA作为源领域数据集进行实验.实验证明,本文所提方法相较于基线模型有显著提升,在BLEU-1、METEOR和ROUGE-L指标上分别提升了至少2.5、2.7和2.0个百分点,验证了其优化领域适应性的能力.     

基于深度模型迁移的细粒度图像分类方法

针对细粒度图像分类方法中存在模型复杂度较高、难以利用较深模型等问题,提出深度模型迁移（DMT）分类方法。首先,在粗粒度图像数据集上进行深度模型预训练;然后,使用细粒度图像数据集对预训练模型logits层进行不确切监督学习,使其特征分布向新数据集特征分布方向迁移;最后,将迁移模型导出,在对应的测试集上进行测试。实验结果表明,在STANFORD DOGS、CUB-200-2011、OXFORD FLOWER-102细粒度图像数据集上,DMT分类方法的分类准确率分别达到72.23%、73.33%和96.27%,验证了深度模型迁移方法在细粒度图像分类领域的有效性。     

Deep learning-based adversarial multi-classifier optimization for cross-domain machinery fault diagnostics

Despite the recent success in data-driven machinery fault diagnosis, cross-domain diagnostic tasks still remain challenging where the supervised training data and unsupervised testing data are collected under different operating conditions. In order to address the domain shift problem, minimizing the marginal domain distribution discrepancy is considered in most of the existing studies. While improvements have been achieved, the class-level alignments between domains are generally neglected, resulting in deteriorations in testing performance. This paper proposes an adversarial multi-classifier optimization method for cross-domain fault diagnosis based on deep learning. Through adversarial training, the overfitting phenomena of different classifiers are exploited to achieve class-level domain adaptation effects, facilitating extraction of domain-invariant features and development of cross-domain classifiers. Experiments on three rotating machinery datasets are carried out for validations, and the results suggest the proposed method is promising for cross-domain fault diagnostic tasks.     

Deep continual transfer learning with dynamic weight aggregation for fault diagnosis of industrial streaming data under varying working conditions

Catastrophic forgetting of learned knowledges and distribution discrepancy of different data are two key problems within fault diagnosis fields of rotating machinery. However, existing intelligent fault diagnosis methods generally tackle either the catastrophic forgetting problem or the domain adaptation problem. In complex industrial environments, both the catastrophic forgetting problem and the domain adaptation problem will occur simultaneously, which is termed as continual transfer problem. Therefore, it is necessary to investigate a more practical and challenging task where the number of fault categories are constantly increasing with industrial streaming data under varying operation conditions. To address the continual transfer problem, a novel framework named deep continual transfer learning network with dynamic weight aggregation (DCTLN-DWA) is proposed in this study. The DWA module is used to retain the diagnostic knowledge learned from previous phases and learn new knowledge from the new samples. The adversarial training strategy is applied to eliminate the data distribution discrepancy between source and target domains. The effectiveness of the proposed framework is investigated on an automobile transmission dataset. The experimental results demonstrate that the proposed framework can effectively handle the industrial streaming data under different working conditions and can be utilized as a promising tool for solving actual industrial problem.     

基于特征融合和混类增强的深度学习滚动轴承故障诊断

轴承故障诊断在维护旋转机械设备和规避重大灾难事故等方面起着至关重要的作用. 针对现有故障诊断模型无法适应实际工业应用中变化的工作负载的问题, 提出了一种基于特征融合和混类增强的故障诊断方法. 首先, 在原始信号的基础上融合时频特征、工况特征和时间差分特征形成新的特征信号; 然后, 采用相空间重构理论将信号特征转换为图像信号, 在训练时通过混类增强拓展数据的分布; 最后, 利用残差网络进行故障诊断分析. 在CWRU数据集上的实验结果表明, 该方法在同工况下的预测精度高达100%, 在变工况下的平均预测精度高达93.28%, 域适应性强.     

Intelligent fault diagnosis for rotating machinery using deep Q-network based health state classification: A deep reinforcement learning approach

Fault diagnosis methods for rotating machinery have always been a hot research topic, and artificial intelligence-based approaches have attracted increasing attention from both researchers and engineers. Among those related studies and methods, artificial neural networks, especially deep learning-based methods, are widely used to extract fault features or classify fault features obtained by other signal processing techniques. Although such methods could solve the fault diagnosis problems of rotating machinery, there are still two deficiencies. (1) Unable to establish direct linear or non-linear mapping between raw data and the corresponding fault modes, the performance of such fault diagnosis methods highly depends on the quality of the extracted features. (2) The optimization of neural network architecture and parameters, especially for deep neural networks, requires considerable manual modification and expert experience, which limits the applicability and generalization of such methods. As a remarkable breakthrough in artificial intelligence, AlphaGo, a representative achievement of deep reinforcement learning, provides inspiration and direction for the aforementioned shortcomings. Combining the advantages of deep learning and reinforcement learning, deep reinforcement learning is able to build an end-to-end fault diagnosis architecture that can directly map raw fault data to the corresponding fault modes. Thus, based on deep reinforcement learning, a novel intelligent diagnosis method is proposed that is able to overcome the shortcomings of the aforementioned diagnosis methods. Validation tests of the proposed method are carried out using datasets of two types of rotating machinery, rolling bearings and hydraulic pumps, which contain a large number of measured raw vibration signals under different health states and working conditions. The diagnosis results show that the proposed method is able to obtain intelligent fault diagnosis agents that can mine the relationships between the raw vibration signals and fault modes autonomously and effectively. Considering that the learning process of the proposed method depends only on the replayed memories of the agent and the overall rewards, which represent much weaker feedback than that obtained by the supervised learning-based method, the proposed method is promising in establishing a general fault diagnosis architecture for rotating machinery.     

Deep multi-scale adversarial network with attention: A novel domain adaptation method for intelligent fault diagnosis

Data driven-based intelligent fault diagnosis methods, as a promising approach, have been widely employed in the health management and maintenance decision of rotating machinery. However, the domain shift phenomenon caused by internal and external interference inevitably exists in practical application scenarios, which significantly deteriorates the performances of the intelligent diagnosis model. And the preparation of label information in real complex scenes is usually time-consuming and expensive. To overcome these challenges, a novel unsupervised domain adaptation framework named deep multi-scale adversarial network with attention (MSANA) is introduced for machinery fault diagnosis. It is established based on two main components, one is the shared feature generator, which is constructed by two novel multi-scale modules with attention mechanism, and the other part is a fault pattern recognition module composed of two differentiated discriminators. While the multi-scale module is used to obtain rich features through different internal perceptual scales, the attention mechanism determines the weights of different scales, which promotes the dynamic adjustment performance and adaptive ability of the model. Then, decision boundary assisted adversarial learning strategy is employed to eliminate domain distribution differences and obtain domain-invariant features. A total of ten rolling bearing-based transfer scenarios and six gearbox-based transfer scenarios are adopted to evaluate the transferability of the proposed MSANA model, and the cross-domain transfer results show that it has superior transferability and stability.     

Multi-mode data augmentation and fault diagnosis of rotating machinery using modified ACGAN designed with new framework

As one of the representative unsupervised data augmentation methods, generative adversarial networks (GANs) have the potential to solve the problem of insufficient samples in fault diagnosis of rotating machinery. However, the existing unsupervised GANs are usually incapable of simultaneously generating multi-mode fault samples and have some shortcomings such as mode collapse and gradient vanishing. To overcome these deficiencies, a supervised model called modified auxiliary classifier GAN (MACGAN) designed with new framework is proposed in this paper. Firstly, a new ACGAN framework is developed by adding an independent classifier to improve the compatibility between the classification and discrimination. Secondly, the Wasserstein distance is introduced in the new loss functions to overcome mode collapse and gradient vanishing. Finally, to achieve stable training, a spectral normalization is used to replace the weight clipping to constrain the weight parameters of discriminator. The proposed method is applied to fault diagnosis of bearing and gear. Compared with the existing GANs, the proposed method can more efficiently generate multi-mode fault samples with higher qualities, which can be used to assist the training of deep learning-based fault diagnosis models with high accuracy and good stability.     

Transfer reinforcement learning method with multi-label learning for compound fault recognition

In complex working site, bearings used as the important part of machine, could simultaneously have faults on several positions. Consequently, multi-label learning approach considering fully the correlation between different faulted positions of bearings becomes the popular learning pattern. Deep reinforcement learning (DRL) combining the perception ability of deep learning and the decision-making ability of reinforcement learning, could be adapted to the compound fault diagnosis while having a strong ability extracting the fault feature from the raw data. However, DRL is difficult to converge and easily falls into the unstable training problem. Therefore, this paper integrates the feature extraction ability of DRL and the knowledge transfer ability of transfer learning (TL), and proposes the multi-label transfer reinforcement learning (ML-TRL). In detail, the proposed method utilizes the improved trust region policy optimization (TRPO) as the basic DRL framework and pre-trains the fixed convolutional networks of ML-TRL using the multi-label convolutional neural network method. In compound fault experiment, the final results demonstrate powerfully that the proposed method could have the higher accuracy than other multi-label learning methods. Hence, the proposed method is a remarkable alternative when recognizing the compound fault of bearings.