A novel adaptive convolutional neural network for fault diagnosis of hydraulic piston pump with acoustic images

As an essential part of hydraulic transmission systems, hydraulic piston pumps have a significant role in many state-of-the-art industries. Thus, it is important to implement accurate and effective fault diagnosis of hydraulic piston pumps. Owing to the heavy reliance of shallow machine learning models on the expertise and experience of engineers, fault diagnosis based on deep models has attracted significant attention from academia and industry. To construct a deep model with good performance, it is necessary and challenging to tune the hyperparameters (HPs). Since many existing methods focus on manual tuning and use common search algorithms, it is meaningful to explore more intelligent algorithms that can automatically optimize the HPs. In this paper, Bayesian optimization (BO) is employed for adaptive HP learning, and an improved convolutional neural network (CNN) is established for fault feature extraction and classification in a hydraulic piston pump. First, acoustic signals are transformed into time–frequency distributions by a continuous wavelet transform. Second, a preliminary CNN model is built by setting initial HPs. The range of each HP to be optimized is identified. Third, BO is employed to select the optimal combination of HPs. An improved model called CNN-BO is constructed. Finally, the diagnostic efficiency of CNN-BO is analyzed using a confusion matrix and t-distributed stochastic neighbor embedding. The classification performance of different models is compared. It is found that CNN-BO has a higher accuracy and better robustness in fault diagnosis for a hydraulic piston pump. This research will provide a basis for ensuring the reliability and safety of the hydraulic pump.     

基于空洞卷积神经网络的旋转机械故障诊断方法

由于旋转机械的振动信号具有非平稳、复杂多样、数据量大的特点，传统的方法难以较好地实现旋转机械故障诊断。近年来，基于深度学习的故障诊断算法发展迅速，其中，卷积神经网络(Convolutional Neural Network,CNN)由于可实现自动提取特征、运算效率高等优点受到广泛关注，但在识别准确率等方面仍然存在部分问题。为实现多传感器监测状态下的旋转机械故障诊断，在经典卷积神经网络结构的基础上，引入了多通道数据融合处理、空洞卷积层、批标准化处理、PReLU激活函数、全局平均池化层等改进方法，构造了一种新型的、高效的空洞卷积神经网络（Atrous Convolution-Convolutional Neural Network,AC-CNN），并基于该模型进行了旋转机械故障诊断实验。实验结果表明，提出的故障诊断模型分类准确率可达99%以上，对比其他神经网络方法具有明显优势。     

基于深度度量学习的电机故障诊断

深度学习以其强大的自适应特征提取和分类能力在机械大数据处理方面取得了丰硕的成果，由于电机结构的复杂性，其信号表现出的非平稳、非线性和复杂多样等特点，使得传统分类方法中的Softmax分类器+交叉熵损失函数对电机故障诊断力不从心。根据电机信号非平稳、数据量大等特点，结合短时傅里叶变换(STFT)与深度学习中的卷积神经网络(CNN)算法和Triplet Loss三元组思想，提出了深度度量学习电机故障诊断方法。该方法能将电机故障信号转换成时频谱图，同时构建CNN，将预处理后的样本用于CNN的训练，采用Triplet Loss作为损失函数度量故障数据高维特征间的距离，并结合标签有监督地微调整个网络，从而实现准确的电机故障诊断。实验表明该方法在处理复杂数据时能够度量特征在高维空间中的距离，高效完成故障诊断任务，弥补了交叉熵函数的不足。     

基于特高频和CNN-LSTM-Attention算法的高压电缆故障诊断方法

随着高压电缆的加速发展和老化,由局部放电(partial discharge, PD)引起的故障问题亟须解决。为此,提出了一种基于特高频(UHF)局放技术与CNN-LSTM-Attention算法的高压电缆故障在线智能诊断方法。首先,对高压电缆的PD产生机理,以及UHF局放技术的实现过程进行描述。其次,利用巴特沃斯(Butterworth)对PD信号进行高通滤波,采用小波变换对信号进行去噪,IPLR算法对PD信号进行降维处理,进而实现特征量的准确提取。最后,建立由CNN-LSTM-Attention算法构成的智能诊断模型。模型中卷积层(CNN)提取轮廓特征,长短期记忆层(LSTM)提取信号时序特征,注意力层(Attention)学习信号重要时序部分。通过实际数据仿真表明：相比传统神经网络方法,CNN-LSTM-Attention神经网络检测方法能够准确识别高采样率的异常放电信号特征,且故障识别准确率明显提高。     

Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification

Rolling bearing tips are often the most susceptible to electro-mechanical system failure due to high-speed and complex working conditions, and recent studies on diagnosing bearing health using vibration data have developed an assortment of feature extraction and fault classification methods. Due to the strong non-linear and non-stationary characteristics, an effective and reliable deep learning method based on a convolutional neural network (CNN) is investigated in this paper making use of cognitive computing theory, which introduces the advantages of image recognition and visual perception to bearing fault diagnosis by simulating the cognition process of the cerebral cortex. The novel feature representation method for bearing data is first discussed using supervised deep learning with the goal of identifying more robust and salient feature representations to reduce information loss. Next, the deep hierarchical structure is trained in a robust manner that is established using a transmitting rule of greedy training layer by layer. Convolution computation, rectified linear units, and sub-sampling are applied for weight replication and reducing the number of parameters that need to be learned to improve the general feed-forward back propagation training. The CNN model could thus reduce learning computation requirements in the temporal dimension, and an invariance level of working condition fluctuation and ambient noise is provided by identifying the elementary features of bearings. A top classifier followed by a back propagation process is used for fault classification. Contrast experiments and analyses have been undertaken to delineate the effectiveness of the CNN model for fault classification of rolling bearings.     

Intelligent fault recognition framework by using deep reinforcement learning with one dimension convolution and improved actor-critic algorithm

The quality of fault recognition part is one of the key factors affecting the efficiency of intelligent manufacturing. Many excellent achievements in deep learning (DL) have been realized recently as methods of fault recognition. However, DL models have inherent shortcomings. In particular, the phenomenon of over-fitting or degradation suggests that such an intelligent algorithm cannot fully use its feature perception ability. Researchers have mainly adapted the network architecture for fault diagnosis, but the above limitations are not taken into account. In this study, we propose a novel deep reinforcement learning method that combines the perception of DL with the decision-making ability of reinforcement learning. This method enhances the classification accuracy of the DL module to autonomously learn much more knowledge hidden in raw data. The proposed method based on the convolutional neural network (CNN) also adopts an improved actor-critic algorithm for fault recognition. The important parts in standard actor-critic algorithm, such as environment, neural network, reward, and loss functions, have been fully considered in improved actor-critic algorithm. Additionally, to fully distinguish compound faults under heavy background noise, multi-channel signals are first stacked synchronously and then input into the model in the end-to-end training mode. The diagnostic results on the compound fault of the bearing and tool in the machine tool experimental system show that compared with other methods, the proposed network structure has more accurate results. These findings demonstrate that under the guidance of the improved actor-critic algorithm and processing method for multi-channel data, the proposed method thus has stronger exploration performance.     

基于深度学习的计算机显示器电磁信息泄漏识别

本文以计算机显示设备泄漏电磁信号为研究对象,对于人工提取特征识别电磁泄漏信号存在的主观性强、特征冗余的问题,区别于传统基于经验的人工特征提取模式,利用人工智能深度学习方法,使用处理图像的深度学习技术应用于电磁信息泄漏特征识别,提出了一种基于卷积神经网络的识别方法.该方法首先提取电磁泄漏信号的时频谱信息作为卷积神经网络模型的输入,然后利用模型的自学习能力提取深层特征,实现对不同分辨率来源电磁泄漏信号的识别,识别准确率达到98％,单信号检测时间仅需40 ms,验证了卷积神经网络应用于电磁泄漏信号识别的有效性,为电磁泄漏预警与防护提供了重要依据,为电磁泄漏视频信号还原复现提供有力支撑.     

A novel fault diagnosis method based on CNN and LSTM and its application in fault diagnosis for complex systems

Fault diagnosis plays an important role in actual production activities. As large amounts of data can be collected efficiently and economically, data-driven methods based on deep learning have achieved remarkable results of fault diagnosis of complex systems due to their superiority in feature extraction. However, existing techniques rarely consider time delay of occurrence of faults, which affects the performance of fault diagnosis. In this paper, by synthetically considering feature extraction and time delay of occurrence of faults, we propose a novel fault diagnosis method that consists of two parts, namely, sliding window processing and CNN-LSTM model based on a combination of Convolutional Neural Network (CNN) and Long Short-Term Memory Network (LSTM). Firstly, samples obtained from multivariate time series by the sliding window processing integrates feature information and time delay information. Then, the obtained samples are fed into the proposed CNN-LSTM model including CNN layers and LSTM layers. The CNN layers perform feature learning without relying on prior knowledge. Time delay information is captured with the use of the LSTM layers. The fault diagnosis of the Tennessee Eastman chemical process is addressed, and it is verified that the predictive accuracy and noise sensitivity of fault diagnosis can be greatly improved when the proposed method is applied. Comparisons with five existing fault diagnosis methods show the superiority of the proposed method.

     

基于改进深度卷积神经网络的轴承故障诊断

轴承为风电机组的重要且故障频发部件,传统基于轴承振动数据的图像转换的卷积神经网络(CNN)的故障诊断技术存在一定局限性。提出了一种基于改进深度卷积神经网络(IDCNN)的直接时间序列特征提取方法,依据采样频率将原始振动数据划分为单个样本,构建诊断模型训练数据集。设计了一种新型的深度卷积神经网络(IDCNN),自动提取复杂样本数据的故障特征,提高DCNN的鲁棒性和泛化性,并将IDCNN提取的高维故障特征输入到分类器中,从而实现轴承故障的智能诊断。对比实验结果表明本方法有效提升了故障诊断精度。     

基于受限玻尔兹曼机的疲劳脑电特性分析

为了准确提取和分类视觉疲劳所引起的脑电特征，以此提醒过度用眼的工作人员及时休息，提出了多通道受限玻尔兹曼机算法和卷积神经网络(CNN)算法结合的深度学习混合模型，利用该模型对枕叶区10个通道的脑电信号进行自动提取内在特征和分类。在基于SSVEP的视觉疲劳脑电数据集上进行评估，深度学习混合模型的平均准确率达到88.63%,比传统的特征提取和分类方法高10%。实验结果证明了深度学习混合模型取得的分类效果较好，并且克服了传统手动提取特征方法不全面的不足，对疲劳脑电的研究具有现实的意义。     

自适应增强卷积神经网络图像识别

目的 为了进一步提高卷积神经网络的收敛性能和识别精度,增强泛化能力,提出一种自适应增强卷积神经网络图像识别算法。方法 构建自适应增强模型,分析卷积神经网络分类识别过程中误差产生的原因和误差反馈模式,针对分类误差进行有目的地训练,实现分类特征基于迭代次数和识别结果的自适应增强以及卷积神经网络权值的优化调整。自适应增强卷积神经网络与多种算法在收敛速度和识别精度等性能上进行对比,并在多种数据集上检测自适应卷积神经网络的泛化能力。结果 通过对比实验可知,自适应增强卷积神经网络算法可以在很大程度上优化收敛效果,提高收敛速度和识别精度,收敛时在手写数字数据集上的误识率可降低20.93%,在手写字母和高光谱图像数据集上的误识率可降低11.82%和15.12%;与不同卷积神经网络优化算法对比,误识率比动态自适应池化算法和双重优化算法最多可降低58.29%和43.50%;基于不同梯度算法的优化,误识率最多可降低33.11%;与不同的图像识别算法对比,识别率也有较大程度提高。结论 实验结果表明,自适应增强卷积神经网络算法可以实现分类特征的自适应增强,对收敛性能和识别精度有较大的提高,对多种数据集有较强的泛化能力。这种自适应增强模型可以进一步推广到其他与卷积神经网络相关的深度学习算法中。     

基于AC-CNN模型的过程故障识别

针对复杂工业过程中故障变量特征提取效率低,分类数量较少且故障识别率较低等问题,提出基于非对称卷积核(asymmetric convolutions)的卷积神经网络(CNN)的工业过程故障识别模型。采取故障变量重构对故障数据进行预处理;引入非对称卷积核模型对重构后的输入故障变量进行特征提取,提高特征提取的效率;根据CNN模型改进得到具有AC架构的AC-CNN模型,识别TE(田纳西-伊斯曼)过程故障的在线测试集样本,实验结果表明,所提方法对TE过程故障数据集的识别效果明显,验证了模型的有效性和优异性。     

融合PSO优化的相关变模态分解与深度学习的旋转机械早期故障智能分类方法

针对旋转机械早期故障信号呈现微弱、相互干扰,易导致故障智能分类精度低的现状。提出一种融合优化的PSO-RVMD (Particle swarm optimization-Relevant Variational Mode Decomposition)与SAE (Stacked AutoEncoder)的旋转机械早期故障分类方法。智能分类方法主要有信号增强与智能分类两阶段组成。首先该方法利用所改进的PSO-RVMD分解电机-轴承系统的早期故障振动信号,通过定义的相关能量比概念计算各分量信号(IMFs)与原始信号之间的相关程度,筛选并重构相关程度高的分量,去除冗余与不相干的干扰与噪声成分,实现信号增强。最后,将增强的早期微弱信号输入到SAE模型中进行训练。利用SAE模型提取高层、抽象且利于分类的深度特征且在最后一层添加BP层,直接对提取的深度特征进行故障分类。通过仿真与实际电机-轴承系统振动信号验证了该方法的有效性,结果表明该方法能快速的实现旋转机械早期微弱故障的精确识别与诊断,提高故障特征学习与自动分类程度。     

Human emotion recognition using deep belief network architecture

Recently, deep learning methodologies have become popular to analyse physiological signals in multiple modalities via hierarchical architectures for human emotion recognition. In most of the state-of-the-arts of human emotion recognition, deep learning for emotion classification was used. However, deep learning is mostly effective for deep feature extraction. Therefore, in this research, we applied unsupervised deep belief network (DBN) for depth level feature extraction from fused observations of Electro-Dermal Activity (EDA), Photoplethysmogram (PPG) and Zygomaticus Electromyography (zEMG) sensors signals. Afterwards, the DBN produced features are combined with statistical features of EDA, PPG and zEMG to prepare a feature-fusion vector. The prepared feature vector is then used to classify five basic emotions namely Happy, Relaxed, Disgust, Sad and Neutral. As the emotion classes are not linearly separable from the feature-fusion vector, the Fine Gaussian Support Vector Machine (FGSVM) is used with radial basis function kernel for non-linear classification of human emotions. Our experiments on a public multimodal physiological signal dataset show that the DBN, and FGSVM based model significantly increases the accuracy of emotion recognition rate as compared to the existing state-of-the-art emotion classification techniques.     

One-dimensional convolutional auto-encoder-based feature learning for fault diagnosis of multivariate processes

Noise and high-dimension of process signals decrease effectiveness of those regular fault detection and diagnosis models in multivariate processes. Deep learning technique shows very excellent performance in high-level feature learning from image and visual data. However, the large labeled data are required for deep neural networks (DNNs) with supervised learning like convolutional neural network (CNN), which increases the time cost of model construction significantly. A new DNN model, one-dimensional convolutional auto-encoder (1D-CAE) is proposed for fault detection and diagnosis of multivariate processes in this paper. 1D-CAE is utilized to learn hierarchical feature representations through noise reduction of high-dimensional process signals. Auto-encoder integrated with convolutional kernels and pooling units allows feature extraction to be particularly effective, which is of great importance for fault detection and diagnosis in multivariate processes. The comparison between 1D-CAE and other typical DNNs illustrates effectiveness of 1D-CAE for fault detection and diagnosis on Tennessee Eastman Process and Fed-batch fermentation penicillin process. The proposed method provides an effective platform for deep-learning-based process fault detection and diagnosis of multivariate processes.     

Adaptive diagnosis of DC motors using R-WDCNN classifiers based on VMD-SVD

Traditional fault diagnosis methods of DC (direct current) motors require high expertise and human labor. However, the other disadvantages of these methods are low efficiency and poor accuracy. To address these problems, a new adaptive and intelligent mechanical fault diagnosis method for DC motors based on variational mode decomposition (VMD), singular value decomposition (SVD), and residual deep convolutional neural networks with wide first-layer kernels (R-WDCNN) was proposed. First, the vibration signals of a DC motor were collected by a designed acquisition system. Subsequently, VMD was employed to decompose the raw signals adaptively into several intrinsic mode functions (IMFs). Moreover, the transient frequency means method, which can quickly and accurately obtain the optimal value of K, is proposed. SVD was applied to reduce the dimensionality of the IMF matrix for further feature extraction. Finally, the reconstructed matrix containing the main fault feature information was used to train and test the R-WDCNN. Based on residual learning, identification and classification of four types of vibration signals were achieved, while the R-WDCNN was optimized by the adaptive batch normalization algorithm (AdaBN). The recognition rate and the convergence were improved by this classifier. The results show that the method proposed in this paper has better adaptability and intelligence than other methods, and the R-WDCNN can reach a 94% recognition rate on unknown samples. Therefore, the proposed method is more intelligent and accurate than other methods.

     

基于Wavelet-CNN的电磁炮过靶信号识别方法

电磁炮测试中,炮口产生强烈的火光信号以及振动等噪声,会严重干扰电枢特征信号的识别处理;为了提升对电枢信号的自动识别率,提出了一种基于小波变换和卷积神经网络(CNN)相结合的电枢信号识别方法;利用小波变换对过靶信号进行小波阈值去噪,进而重构信号,然后利用CNN提取信号的深层次特征,通过CNN的全连接层输出信号的分类结果;当输入信号为电枢信号时,对其作最大值检测获取电枢信号的特征点;实验结果表明,所提方法对比传统小波阈值滤波法在特征点自动拾取准确率上提升了5.88%;该算法对电磁炮电枢过靶信号的滤波、识别具有一定的参考意义。     

基于小样本学习的LCD产品缺陷自动检测方法

针对高分辨率液晶显示器产品(liquid crystal display, LCD)质量在线检测需求,基于深度学习提出一种LCD缺陷自动检测方法。通过设计自适应浅层特征提取层,并引入稀疏卷积结构,多维度、多尺度的提取深层特征,采用迁移学习和深度卷积生成对抗生网络扩充数据强化训练,构建基于小样本学习的LCD表面缺陷检测模型。其特征在于,采用设计的自动分割与定位预处理软件将高分辨率图像划分成适于卷积神经网络学习的图像子块,并根据模型对图像子块的判定类别和定位坐标,同时获取多类型缺陷检测结果。实验结果表明,本文模型可以有效提高检出率,并减少漏检率。     

基于深度卷积神经网络的车型识别研究

近年来,深度学习中的卷积神经网络已经广泛运用于图像识别领域,它不仅显著提升了识别准确率,同时在特征提取速度方面也优于许多传统方法。本文针对高速公路环境下的车型识别问题,引入卷积神经网络（CNNs）理论,设计相应特征提取算法,并结合SVM分类器构建识别系统。通过对高速公路上主要三种车型（小车、客车、货车）的分类实验显示,本文方法在识别精度及速度上均取得较显著的提高。     

基于卷积长短时记忆网络的人体行为识别研究

人体行为识别利用深度学习网络模型自动提取数据的深层特征,但传统机器学习算法存在依赖手工特征提取、模型泛化能力差等问题。提出基于空时特征融合的深度学习模型（CLT-net）用于人体行为识别。采用卷积神经网络（CNN）自动提取人体行为数据的深层次隐含特征,利用长短时记忆（LSTM）网络构建时间序列模型,学习人体行为特征在时间序列上的长期依赖关系。在此基础上,通过softmax分类器实现对不同人体行为分类。在DaLiAc数据集的实验结果表明,相比CNN、LSTM、BP模型,CLT-net模型对13种人体行为的总体识别率达到了97.6%,具有较优的人体行为识别分类性能。