基于并行双向时间卷积网络和双向长短期记忆网络的轴承剩余使用寿命预测方法

在基于深度学习的轴承剩余使用寿命(RUL)预测方法中,时间卷积网络(TCN)忽略了振动数据中未来时间信息的重要性,长短期记忆网络(LSTM)难以有效地学习振动数据的长时间序列特征.针对以上问题,提出一种基于并行双向时间卷积网络(Bi-TCN)和双向长短期记忆网络(Bi-LSTM)的轴承RUL预测方法.首先,对多传感器数据进行归一化处理,并将每个传感器数据进行通道合并,实现多传感器数据的高效融合;然后,采用Bi-TCN和Bi-LSTM构建并行的双分支特征学习网络,其中Bi-TCN提取数据的双向长时间序列特征, Bi-LSTM提取数据的时间相关特征;同时,设计一种特征融合注意力机制,该机制分别计算Bi-TCN和Bi-LSTM的输出权重,以实现两种网络输出特征的自适应加权融合;最后,融合特征通过全连接层并输出轴承RUL的预测结果.利用西安交通大学轴承数据集和PHM 2012轴承数据集进行RUL预测实验,实验结果表明,与其他先进的预测方法相比,所提出方法可以准确预测更多类型轴承的RUL,同时具有更低的预测误差.     

Temporal convolutional network with soft thresholding and attention mechanism for machinery prognostics

Remaining useful life (RUL) prediction is a challenging task for prognostics and health management (PHM). Due to the complexity physics involved for precisely modeling the machine degradation process, learning-based data-driven methods, which learn the degradation pattern solely from the historical data without referring to physical models, have become promising alternatives to model-based prognostic methods. In this paper, a new temporal convolutional neural network (TCN) with soft threshold and attention mechanism is proposed for machinery prognostics. Multi-channel sensor data are directly used as inputs to the prognostic network without feature extraction as a pre-processing step. A soft thresholding mechanism is embedded in the network, serving as a flexible activation function for certain layers to preserve useful features. The threshold value is adaptively learned by a subnetwork trained with the attention mechanism instead of assigning a deterministic value to the threshold. As a result, each feature map is assigned a customized threshold value such that the network training process can focus on features that are more critical to RUL prediction. To verify the generalization ability of the proposed method, three benchmark datasets related to rolling bearings and cutting tools are tested, and the performance of the developed method is compared with several state-of-the-art prognostic approaches. The results show that for all the three case studies, the developed method has produced accurate RUL prediction with good robustness and generalization ability.     

基于改进SAE和双向LSTM的滚动轴承RUL预测方法

针对稀疏自动编码器(Sparse auto encoder, SAE)采用sigmoid激活函数容易造成梯度消失的问题, 用一种新的Tan函数替代原有的sigmoid函数; 针对SAE采用Kullback-Leibler (KL) 散度进行稀疏性约束在回归预测方面的局限性, 以dropout机制替代KL散度实现网络的稀疏性. 利用改进SAE对滚动轴承振动信号进行无监督深层特征自适应提取, 无需人工设计标签进行有监督微调. 同时, 考虑到滚动轴承剩余使用寿命(Remaining useful life, RUL)预测方法一般仅考虑过去信息而忽略未来信息, 引入双向长短时记忆网络(Bi-directional long short-term memory, Bi-LSTM)构建滚动轴承RUL的预测模型. 在2个轴承数据集上的实验结果均表明, 所提基于改进SAE和Bi-LSTM的滚动轴承RUL预测方法不仅可以提高模型的收敛速度而且具有较低的预测误差.     

A novel deep learning scheme for multi-condition remaining useful life prediction of rolling element bearings

The remaining useful life (RUL) prediction of a rolling element bearing is important for more reasonable maintenance of machinery and equipment. Generally, the information of a failure can hardly be acquired in advance while running and the degradation process varies in terms of different faults. Thus, fault identification is indispensable for a multi-condition RUL prediction, where, however, the fault identification and RUL prediction are separated in most studies. A new hybrid scheme is proposed in this paper for the multi-condition RUL prediction of rolling element bearings. The proposed scheme contains both classification and regression, where the 2D-DCNN based classifier and predictors are built concerning typical fault conditions of a bearing. For the online prediction, the raw signals are spanned in the time-frequency domain and then transferred into images as the input of the scheme. The classifier is used to monitor the vibration of rolling bearings for online fault recognition and excite the corresponding predictor for RUL prediction once a fault is detected. The output from the predictor is amended by the proposed adaptive delay correction method as the final prediction results. A demonstration is performed based on the XJTU-SY datasets and the results are compared with those from the state-of-the-art methods, which proves the superiority of the proposed scheme in improving the accuracy and linearity of RUL prediction. The time cost of the proposed online prediction scheme is also investigated and the results indicate high time effectiveness.     

基于并联CNN-SE-Bi-LSTM的轴承剩余使用寿命预测

滚动轴承作为一种机械标准件,广泛应用于各类旋转机械设备,其健康状况对机器设备的正常运行至关重要,掌握其剩余使用寿命(RUL)可以更好地保证生产活动安全有效的进行.针对目前基于深度学习的机器RUL预测方法普遍存在:a)预测性能很大程度依赖手工特征设计;b)模型不能够充分提取数据中的有用特征;c)学习过程中没有明确考虑多传感器数据等缺点,提出了一种新的深度预测网络——并联多个带有压缩激励机制的卷积神经网络和双向长短期记忆网络集成网络(CNN-SE-Bi-LSTM),用于设备的RUL预测.在该预测网络中,不同传感器采集的监测数据直接作为预测网络的输入.然后,在改进的压缩激励卷积网络(CNN-SE-Net)提取空间特征的基础上进一步通过双向长短期记忆网络(Bi-LSTM)提取时序特征,建立起多个独立的可以自动从输入数据中学习高级表示的RU L预测模型分支.最后,将各独立分支学习到的特征通过全连接层并联获得最终的RU L预测模型.通过滚动轴承加速退化实验的数据,验证了所提网络的有效性并与现有的一些改进算法进行了对比实验.结果表明,面对原始多传感器数据,该算法能够自适应地提供准确的RU L预测结果,且预测表现优于现有一些预测方法.     

基于卷积注意力长短时记忆网络的轴承寿命预测方法EI北大核心CSCD

传统的滚动轴承寿命预测方法缺乏明确的学习机制,无法有效识别不同时序特征之间的差异并突出重要特征,影响其预测精度.为克服上述缺点,本文提出了一种基于卷积注意力长短时记忆网络(CAN-LSTM)的剩余使用寿命预测模型.该模型主要由两部分组成:前端为卷积注意力网络(CAN),学习通道和时间维度中的深层故障特征,提高特征的表征能力;后端为改进LSTM网络,基于退化特征对轴承进行寿命预测.归一化健康指标至[0,1]区间内,得到相同的失效阈值;使用五点平滑法对预测结果进行处理,实现预测结果的输出;利用留一法对轴承全寿命试验数据进行验证,测试模型的准确性和适应性.试验结果表明:所提模型的平均均方根误差和平均绝对值误差比仅用CNN模型预测值低54.12%和59.05%,比仅用LSTM模型预测值低39.06%和43.42%,比卷积长短时记忆网络(CNN-LSTM)低20.41%和25.86%.     

基于卷积神经网络与双向长短时融合的锂离子电池剩余使用寿命预测

针对锂离子电池剩余使用寿命（remaining useful life,RUL）传统预测方法的精确度与稳定性较低等问题,融合卷积神经网络（convolutional neural network,CNN）和双向长短期记忆（bidirectional long short-term memory,BiLSTM）神经网络的...     

A new convolutional dual-channel Transformer network with time window concatenation for remaining useful life prediction of rolling bearings

Deep learning has achieved numerous breakthroughs in bearing predicting remaining useful life (RUL). However, the current mainstream deep learning framework inevitably has flaws, including the disadvantage of the small receptive field, the difficulty of learning long-term dependencies and the singularity of feature extraction domains, etc. Given the challenges mentioned above, we propose a new convolutional dual-channel Transformer network (CDCT) for remaining useful life prediction of rolling bearings. In the CDCT, the causal convolution operation is applied to extract local features from the time and frequency domains and add positional encoding to the input signal, while the transformer block is utilized for extracting bidirectional features and fusing them. The CDCT not only has a global receptive field but also can learn long-term dependencies regardless of sequence length. Besides, the time window concatenation is adopted to ameliorate the problem of large amounts of trainable parameters of the Transformer-based models. In the experiments, we conduct a detailed analysis of each crucial element and hyperparameter of the CDCT and compare it to multiple basic and advanced methods. The experimental results highlight the superiority of the CDCT in bearing RUL prediction and demonstrate the effectiveness of crucial elements in the CDCT.     

考虑退化轨迹差异性与相似性的轴承RUL预测

轴承的个体异质性及工况差异性使得其性能退化轨迹不尽相同,导致训练轴承建立的深度学习模型与测试轴承失配.对此,提出基于卷积自编码器与自组织映射的轴承剩余使用寿命(remaining useful life,RUL)灰色预测方法.该方法引入以轴承自身监测数据为驱动的批量归一化的卷积自编码器对轴承性能退化特征进行深度提取,并结合自组织映射算法进行性能退化指标(degradation indicator,DI)自主构建.采用动态时间规划算法对各个轴承退化轨迹进行相似匹配分析,以相匹配的全寿命轴承的DI灰色模型回归曲线在寿命终点取值作为参考,进行测试轴承的失效阈值设置.以测试轴承历史DI为驱动,采用全阶时间幂灰色预测模型对测试轴承RUL进行滚动预测.实验结果表明,所提出方法在保留轴承退化趋势个体差异性的同时,能够实现轴承失效阈值自主合理设置,提高轴承RUL的预测精度.     

基于CNN-WaveNet的滚动轴承剩余寿命预测

为保证设备正常运行并准确预测轴承剩余寿命,提出二维卷积神经网络与改进WaveNet组合的寿命预测模型.为克服未优化的递归网络在预测训练过程中易出现梯度消失问题,该模型引入了WaveNet时序网络结构.针对原始WaveNet结构不适用滚动轴承振动数据情况,将WaveNet结构改进与二维卷积神经网络结合应用于滚动轴承寿命预测.模型利用二维卷积网络提取一维振动序列的特征,随后特征输入WaveNet并进行滚动轴承的预测寿命.改进模型相比于深度循环网络计算效率更高、结果更准确,相比于原始CNN-WaveNet-O模型预测结果更准确.相比于深度长短期记忆网络模型,改进方法预测结果均方根误差降低了11.04％,评分函数降低了11.34％.     

Remaining useful life prediction of bearing based on stacked autoencoder and recurrent neural network

Remaining Useful Life (RUL) prediction play a crucial part in bearing maintenance, which directly affects the production efficiency and safety of equipment. Moreover, the accuracy of the prediction model is constrained by the feature extraction process and full life data of bearings. In this paper, the life prediction method of faulty rolling bearing with limited data is presented including degradation state model and RUL prediction model. In order to obtain health indication (HI) without human interference in the degradation state modeling stage, the bottleneck structure of Stacked Autoencoder (SAE) is utilized to fuse the four selected features into one HI using Intelligent Maintenance Systems (IMS) bearing dataset as training sample. In RUL prediction model, the Long Short-Term Memory (LSTM) neural network is carried out to establish the model with Standard deviation (Std) input and HI training label. In order to solve the problem of large training error caused by insufficient data in the failure stage of bearing acceleration test, the third-order spline curve interpolation is utilized to enhance the data points. Through parameter analysis, the RMSE and MAE of the test set on the prediction model are 0.032582 and 0.024038, respectively. Furthermore, the effectiveness of the proposed method is further validated by dataset from Case Western Reserve University (CWRU) with different bearing fault degrees. The analysis indicates that the RUL prediction of bearing fault data is consistent with the size of artificial added faults, that is,the more severe the fault the shorter the time of remaining life. The results validate that the proposed method can effectively extract the bearing health state by incorporating feature fusion and establish accurately prediction model for bearing remaining life.     

基于CNN的变工况滚动轴承故障诊断研究

针对滚动轴承工作环境多变和样本不足导致故障诊断效果不佳的问题,提出一种多模态注意力卷积神经网络.该网络采用多个并行卷积层构建,并结合注意力机制,有效地提取了丰富的故障特征.然后提出了两种有限数据条件下的数据增强方法,解决了数据样本不足的问题.另外,将采集到的滚动轴承时域信号通过小波变换转换为时频图谱作为网络输入来提高数...     

A deep feature enhanced reinforcement learning method for rolling bearing fault diagnosis

Fault diagnosis of rolling bearing is crucial for safety of large rotating machinery. However, in practical engineering, the fault modes of rolling bearings are usually compound faults and contain a large amount of noise, which increases the difficulty of fault diagnosis. Therefore, a deep feature enhanced reinforcement learning method is proposed for the fault diagnosis of rolling bearing. Firstly, to improve robustness, the neural network is modified by the Elu activation function. Secondly, attention model is used to improve the feature enhanced ability and acquire essential global information. Finally, deep Q network is established to accurately diagnosis the fault modes. Sufficient experiments are conducted on the rolling bearing dataset. Test result shows that the proposed method is superior to other intelligent diagnosis methods.     

基于卷积注意力特征迁移学习的滚动轴承故障诊断

针对变工况条件下因源域和目标域样本数据分布差异大造成滚动轴承故障诊断准确率较低的问题,提出一种新的迁移学习方法——卷积注意力特征迁移学习(Convolutional Attention-based Feature Transfer Learning, CAFTL),并用于变工况条件下的滚动轴承故障诊断。在所提出的CAFTL中,将源域和目标域样本经过多头自注意力计算再经过归一化之后,输入到卷积神经网络中得到对应的源域和目标域特征;然后通过域自适应迁移学习网络将两域特征投影到同一个公共特征空间内;接着,利用由源域有标签样本构建的分类器进行分类;最后,利用随机梯度下降(Stochastic Gradient Descent, SGD)方法对CAFTL进行训练和参数更新,得到CAFTL的最优参数集后将参数优化后的CAFTL用于滚动轴承待测样本的故障诊断。滚动轴承故障诊断实例验证了所提出的方法的有效性。     

Health indicator construction of machinery based on end-to-end trainable convolution recurrent neural networks

In the field of prognostic and health management of engineered systems, health indicator construction of bearings is one of the most significant and challenging problems. Many data-driven approaches centered on deep learning have been proposed recently in the context of smart manufacturing, where massive condition monitoring data could be collected. Among them, there are two representative methods, i.e., the convolution neural networks (CNN) based method and the recurrent neural networks (RNN) based method. However, there are some problems with them. The former has small receptive field size and cannot encode time-series information that is crucial for determining the bearings degradation degree, while the latter need hand-crafted features with prior knowledge of experts. Aimed at these problems, an intelligent and end-to-end health indicator construction approach is proposed. It combines structural advantages of previous two methods. It firstly converts the original input data into a series of local features that maintain chronological order in the convolution feature map. Then the sequential local features are elegantly connected by a recurrent neural network, which makes the extracted features in the recurrent layer contain global semantic information with time series. The bearing experiment under two different operating conditions demonstrates that the proposed method is reliable and effective in establishing bearing health indicator and characterizes the nonlinear degradation trend of bearings into approximately linear process over time. The experimental results also show that the proposed method achieves better results concerning trendability and monotonicity, compared with the CNN-based method and the RNN-based method.     

A multi-head neural network with unsymmetrical constraints for remaining useful life prediction

This paper proposes a multi-head neural network (MHNN) model with unsymmetrical constraints for remaining useful life (RUL) prediction of industrial equipment. Generally, the existing deep learning methods proposed for RUL prediction utilize symmetrical constraint loss functions such as the mean squared error function to calculate training errors. However, if the predicted RUL is much larger than the actual value in some safety–critical applications, severe damage may occur. To address this issue, an unsymmetrical constraint function is proposed as the loss function in this work that penalizes the late predictions (i.e., the predicted RUL is larger than the actual RUL) more strongly. In addition, an adjustable parameter is added to this function to adjust the model’s attention to the late predictions. In MHNN model, the bidirectional gated recurrent units (BGRU) and self-attention mechanism are employed to extract temporal features from the condition monitoring data. In addition, the structure of the multi-head neural network is adopted in the proposed model, helping to capture more degradation information by means of multiple identical and parallel networks. The proposed method is validated against a commonly used turbofan engine dataset. Compared with other latest methods on the same dataset, the proposed method is proven to be superior. Taking the FD004 dataset as an example, the score obtained by MHNN is 24.09% lower than that obtained by the best existing method.     

A convolutional neural network based degradation indicator construction and health prognosis using bidirectional long short-term memory network for rolling bearings

Health prognosis of rolling bearing is of great significance to improve its safety and reliability. This paper presents a novel health prognosis method for the rolling bearing based on convolutional neural network (CNN) and bidirectional long short-term memory network (BiLSTM) model. First, a new nonlinear degradation indicator (DI) is designed which can be utilized as training label. Then, through learning and capturing the mapping relationship between raw vibration signals and DI of the rolling bearing, a CNN model is introduced to estimate the DI value of the rolling bearing. And, BiLSTM models are set up to carry out health prognosis using the estimated DI, including future DI and remaining useful life prediction. An experiment verification is implemented to validate the effectiveness of the proposed method. Results show the excellent ability of future DI prediction, and demonstrate the superiority of the proposed method in the field of remaining useful life prediction compared with other existing deep learning models.     

A Compact Convolutional Neural Network Augmented with Multiscale Feature Extraction of Acquired Monitoring Data for Mechanical Intelligent Fault Diagnosis

Considering all the monitoring data of bearings until failure, very few data are acquired when the bearings are faulty. Such circumstance leads to small faulty sample problem when an intelligent fault diagnosis method is applied. A deep neural network trained with small samples cannot be trained completely, and tends to overfit, which results in poor performance in practical application. To solve this problem, a compact convolutional neural network augmented with multiscale feature extraction is proposed in this paper. Multiscale feature extraction unit is introduced to extract features at different time scales without adding convolution layers, which can reduce the depth of the network while ensuring classification ability and alleviating the overfitting problem caused by the network being too complicated. Besides, a specially designed compact convolutional neural network synthetically analyzes the multiscale features. By combing these two tricks, the proposed neural network can extract more sensitive features with a relatively shallow structure, which increases classification accuracy under small samples. Dropout technique is also used to prevent the network from overfitting. Effectiveness of the proposed method is verified by three bearing datasets. Experiments show that this network can achieve competitive results with limited training samples even with different load and mixed rotating speed.     

基于深度时序特征迁移的轴承剩余寿命预测方法

不同工况下轴承退化数据分布不一致导致深度学习等方法对剩余寿命预测效果有限,而已有迁移学习预测方法未能充分挖掘不同工况退化序列的内在趋势性,为此,提出一种基于深度时序特征迁移的轴承剩余寿命预测方法.首先,提出一种深度时序特征融合的健康指标构建模型,利用时间卷积网络挖掘退化趋势的内在时序特征,得到源域多轴承的健康指标;然后,提出一种最小化序列相似度的领域自适应算法,利用源域健康指标作为退化趋势元信息,选取目标域与源域之间的公共敏感特征;最后,采用支持向量机构建预测模型.在IEEE PHM Challenge 2012 轴承全寿命数据集上进行实验,结果表明,所提出方法构建的健康指标可更有效地反映退化趋势,同时明显提升剩余寿命预测的准确度.     

基于小样本学习的SAR图像识别

深度学习已成为图像识别领域的一个研究热点。与传统图像识别方法不同,深度学习从大量数据中自动学习特征,并且具有强大的自学习能力和高效的特征表达能力。但在小样本条件下,传统的深度学习方法如卷积神经网络难以学习到有效的特征,造成图像识别的准确率较低。因此,提出一种新的小样本条件下的图像识别算法用于解决SAR图像的分类识别。该算法以卷积神经网络为基础,结合自编码器,形成深度卷积自编码网络结构。首先对图像进行预处理,使用2D Gabor滤波增强图像,在此基础上对模型进行训练,最后构建图像分类模型。该算法设计的网络结构能自动学习并提取小样本图像中的有效特征,进而提高识别准确率。在MSTAR数据集的10类目标分类中,选择训练集数据中10%的样本作为新的训练数据,其余数据为验证数据,并且,测试数据在卷积神经网络中的识别准确率为76.38%,而在提出的卷积自编码结构中的识别准确率达到了88.09%。实验结果表明,提出的算法在小样本图像识别中比卷积神经网络模型更加有效。