基于卷积-LSTM网络的广告点击率预测模型研究

点击率预测是计算广告学的核心算法之一。传统浅层模型没有充分考虑到数据之间存在的非线性关系，且使用人工特征提取方法费时费力。针对这些问题，提出了基于卷积（Convolutional Neural Networks）-LSTM（Long Short Term Memory）混合神经网络的广告点击率预测模型。该模型使用卷积神经网络提取高影响力特征，并通过LSTM神经网络的时序性进行预测分类。实验结果证明：与浅层模型或单一结构的神经网络模型相比，基于卷积-LSTM的混合神经网络模型能有效提高广告点击事件的预测准确率。     

基于模糊信息粒化与混合神经网络的混沌时间序列预测

为了提高对混沌时间序列预测的精准度,提出了一种基于模糊信息粒化和注意力机制的混合神经网络预测模型。首先对数据进行归一化处理,利用模糊信息粒化对数据的复杂度进行简化;然后将经过相空间重构后的样本输入卷积神经网络(CNN)提取空间特征;再利用长短期记忆神经网络(LSTM)进一步提取时间特征;最后将融合特征传递给注意力机制提取关键特征,得出预测结果。选取Logistic、洛伦兹和太阳黑子混沌时间序列进行实验,并与CNN-LSTM-Att模型、CNN-LSTM模型、FIG-CNN模型、FIG-LSTM模型、CNN模型、LSTM模型、支持向量机(SVM)及误差逆传播(BP)模型进行对比分析。结果表明,所提的预测模型预测精度更高,误差更小。     

CEEMD-WT和CNN在短期风速预测中的应用研究

由于风速存在随机性和不稳定性,为了提高短期风速预测的精度,提出了一种基于完备总体经验模态分解（CEEMD）、小波变换（WT）和卷积神经网络（CNN）的短期风速预测混合模型。首先,CEEMD算法把原始风速序列分解成一些相对平稳的固有模态函数和一个残差序列;然后,WT算法对每个固有模态函数进行二次去噪,进一步消除噪声对固有模态函数的影响;最后,卷积神经网络对每个固有模态函数、残差序列和影响风速的5个属性训练预测得到各自的预测结果,对所有的预测结果重构得到最终的预测结果。通过实验与其他4个风速预测模型进行比较,所提出的模型预测的绝对平均百分比误差（MAPE）最小,为2.484%,表明在短期风速预测方面CEEMD-WT-CNN模型有较好的性能。     

基于CNN和GRU的混合股指预测模型研究

针对股票数据共线性和非线性的特点,提出了一种基于卷积神经网络（Convolutional Neural Network,CNN）和门控循环单元（Gated Recurrent Unit,GRU）神经网络的混合预测模型,并对沪深300指数、上证综指和深证成指进行了预测。该模型首先采用CNN提取特征向量,对原始数据进行降维,然后利用GRU神经网络学习特征动态变化规律进行股指预测。仿真结果表明,与GRU神经网络、长短时记忆（Long-Short-Term Memory,LSTM）神经网络和CNN相比,该模型能够挖掘历史数据中蕴含的信息,有效提高股指预测的准确率,并可为股指交易提供一些参考。     

基于CNN-LSTM的短期风电功率预测

短期风电功率预测对电力系统的安全稳定运行和能源的优化配置具有重要意义。鉴于卷积神经网络(CNN)高效的数据特征提取能力,以及长短期记忆网络(LSTM)描述时间序列长期依赖关系的能力。为了提高短期风电功率预测的精度,设计了一种基于CNN和LSTM的风电功率预测模型。该模型利用卷积神经网络对风电功率、风速、风向数据进行多层卷积和池化堆叠计算,提取风电功率相关数据的特征图谱。为了描述风电功率序列的时序依从关系,将图谱特征信息作为长短期记忆网络的输入信息,计算得到风电功率的预测结果。采用西班牙某风电场的实测数据进行模型预测精度验证。结果表明,该模型较LSTM、Elman模型具有更好的预测性能。     

基于卷积门循环单元和气象雷达图像的临近降水预报

现有的深度神经网络预测模型主要是通过学习单一高度下的雷达回波图像序列的特征预测未来时间段回波序列.然而,这种模型并不能直接预测目标站点未来一段时间内的降水量.鉴于此,提出了一种基于卷积门循环单元(Con-volutional Gated Recurrent Unit,ConvGRU)神经网络的临近降水预报模型.对目标站点不同高度的雷达回波图像做卷积,同一高度的卷积图像通过GRU(Gated Recurrent Unit)学习云团运动过程中的时序特征,将不同高度时序图像的学习特征聚合到全连接层中进行训练,输出目标站点未来1h～2h的降水量.实验分析表明,该模型在未来1h～2h的降水预报中取得了较好的预报精度.     

基于网络表征学习的混合缺陷预测模型

针对软件系统模块间具有依赖关系的问题,通过对软件系统网络结构进行分析,构建了基于网络表征学习的混合缺陷预测模型。首先,将软件系统以模块为单位转换成软件网络;然后,使用网络表征技术来无监督学习软件网络中每个模块的系统结构特征;最后,结合系统结构特征和卷积神经网络学习的语义特征构建一个混合缺陷预测模型。实验结果表明：在Apache三个开源软件poi、lucene和synapse上所提混合缺陷预测模型具有更好的缺陷预测效果,其F1指标比最优模型——基于卷积神经网络（CNN）的缺陷预测模型分别提高了3.8%、1.0%、4.1%。软件网络结构特征分析为缺陷预测模型的构建提供了有效的研究思路。     

基于改进eRCNN的局部路网交通流预测

针对误差反馈循环卷积神经网络在运用到短时交通流预测时存在仅仅能接收时序误差序列,忽略交通流误差数据中隐含的空间拓扑特征,且在模型初始化时其采用的通用卷积神经网络初始化方法降低了模型训练效率的问题,本文提出一种优化的误差反馈循环卷积神经网络模型,在误差反馈循环卷积神经网络模型基础上根据预测误差数据的时空特性对误差反馈层进行结构强化,能够处理包含简单空间关系的误差序列。同时通过在模型训练的过程中分离模型产生的历史预测误差和训练误差,使得模型构建过程更加高效,加速了模型收敛速度。通过北京市四环道路交通数据的实验表明,优化的误差反馈循环卷积神经网络预测模型在预测精度、构建效率及鲁棒性上均得到有效提高。     

基于动态扩散卷积交互图神经网络的网络流量预测

现有的网络流量预测模型存在着泛化能力弱和预测准确率低等问题,为了解决此问题,提出了一种结合动态扩散卷积模块和卷积交互模块的预测模型。动态扩散卷积模块可以提取网络流量中复杂的空间特征和动态特性,而卷积交互模块则能捕获到流量中的时间特征,两者的有机结合可以有效预测网络中的流量。通过与其他网络流量预测模型在美国能源科学网（ESnet）流量数据上进行对比实验,验证了提出的动态扩散卷积交互图神经网络模型（DDCIGNN）的有效性。实验结果表明,DDCIGNN模型的均方根误差（RMSE）在最好的情况下优化了大约13.0％,说明该模型能够进行更有效的网络流量预测。     

应用改进卷积神经网络的网络安全态势预测方法

针对神经网络态势预测模型训练复杂度高的问题，提出了一种基于改进卷积神经网络的态势预测方法。结合深度可分离卷积与分解卷积技术的优点，提出了一种基于复合卷积结构的改进型卷积神经网络安全态势预测模型，实现了态势要素和态势值的映射。实验仿真结果证明，相比于已有的典型预测方法，该方法明显降低了复杂度，减少了预测时间，并提升了预测准确率。     

Evolutionary product unit neural networks for short-term wind speed forecasting in wind farms

Combinations of physical and statistical wind speed forecasting models are frequently used in wind speed prediction problems arising in wind farms management. Artificial neural networks can be used in these models as a final step to obtain accurate wind speed predictions. The aim of this work is to determine the potential of evolutionary product unit neural networks (EPUNNs) for improving the accuracy and interpretation of these systems. Traditional neural network and EPUNN approaches have been used to develop different wind speed prediction models. The results obtained using different EPUNN models show that the functional model and the hybrid algorithms proposed provide very accurate prediction compared with standard neural networks used to solve this regression problem. One of the main advantages of the application of these EPUNNs has been the possibility of obtaining some interpretation of the non-linear relation predicted by the model, as will be shown in real data of a wind farm in Spain.     

Forecasting wind speed using empirical mode decomposition and Elman neural network

Because of the chaotic nature and intrinsic complexity of wind speed, it is difficult to describe the moving tendency of wind speed and accurately forecast it. In our study, a novel EMD–ENN approach, a hybrid of empirical mode decomposition (EMD) and Elman neural network (ENN), is proposed to forecast wind speed. First, the original wind speed datasets are decomposed into a collection of intrinsic mode functions (IMFs) and a residue by EMD, yielding relatively stationary sub-series that can be readily modeled by neural networks. Second, both IMF components and residue are applied to establish the corresponding ENN models. Then, each sub-series is predicted using the corresponding ENN. Finally, the prediction values of the original wind speed datasets are calculated by the sum of the forecasting values of every sub-series. Moreover, in the ENN modeling process, the neuron number of the input layer is determined by a partial autocorrelation function. Four prediction cases of wind speed are used to test the performance of the proposed hybrid approach. Compared with the persistent model, back-propagation neural network, and ENN, the simulation results show that the proposed EMD–ENN model consistently has the minimum statistical error of the mean absolute error, mean square error, and mean absolute percentage error. Thus, it is concluded that the proposed approach is suitable for wind speed prediction.     

VMD和混合深度学习框架融合的短期风速预测

风速预测是影响风电场效率和稳定性的重要因素.文中基于风速的时空特征,融合变分模态分解(VMD)和混合深度学习框架进行短期风速预测,即VHSTN (VMD-based hybrid spatio-temporal network).其中,混合深度学习框架由卷积神经网络(CNN)、长短时记忆网络(LSTM)以及自注意力机制(SAM)组成.该算法对原始数据清洗后,采用VMD将多站点风速的时空数据分解为固有模态函数(intrinsic mode functions, IMF)分量,去除风速数据的不稳定性;然后针对各IMF分量,应用底部的CNN抽取空域特征;再用顶层LSTM提取时域特征,之后用SAM通过自适应加权加强对隐藏特征的提取并得到各分量的预测结果;最后合并获得最终预测风速.在数据集WIND上进行实验,并和相关典型算法对比,实验结果表明了该算法的有效性和优越性.     

Wind Speed Prediction Using Chicken Swarm Optimization with Deep Learning Model

High precision and reliable wind speed forecasting have become a challenge for meteorologists. Convective events, namely, strong winds, thunderstorms, and tornadoes, along with large hail, are natural calamities that disturb daily life. For accurate prediction of wind speed and overcoming its uncertainty of change, several prediction approaches have been presented over the last few decades. As wind speed series have higher volatility and nonlinearity, it is urgent to present cutting-edge artificial intelligence (AI) technology. In this aspect, this paper presents an intelligent wind speed prediction using chicken swarm optimization with the hybrid deep learning (IWSP-CSODL) method. The presented IWSP-CSODL model estimates the wind speed using a hybrid deep learning and hyperparameter optimizer. In the presented IWSP-CSODL model, the prediction process is performed via a convolutional neural network (CNN) based long short-term memory with autoencoder (CBLSTMAE) model. To optimally modify the hyperparameters related to the CBLSTMAE model, the chicken swarm optimization (CSO) algorithm is utilized and thereby reduces the mean square error (MSE). The experimental validation of the IWSP-CSODL model is tested using wind series data under three distinct scenarios. The comparative study pointed out the better outcomes of the IWSP-CSODL model over other recent wind speed prediction models.     

Short-term wind speed forecasting based on a hybrid model

Wind power is currently one of the types of renewable energy with a large generation capacity. However, operation of wind power generation is very challenging because of the intermittent and stochastic nature of the wind speed. Wind speed forecasting is a very important part of wind parks management and the integration of wind power into electricity grids. As an artificial intelligence algorithm, radial basis function neural network (RBFNN) has been successfully applied into solving forecasting problems. In this paper, a novel approach named WTT–SAM–RBFNN for short-term wind speed forecasting is proposed by applying wavelet transform technique (WTT) into hybrid model which hybrids the seasonal adjustment method (SAM) and the RBFNN. Real data sets of wind speed in Northwest China are used to evaluate the forecasting accuracy of the proposed approach. To avoid the randomness caused by the RBFNN model or the RBFNN part of the hybrid model, all simulations in this study are repeated 30 times to get the average. Numerical results show that the WTT–SAM–RBFNN outperforms the persistence method (PM), multilayer perceptron neural network (MLP), RBFNN, hybrid SAM and RBFNN (SAM–RBFNN), and hybrid WTT and RBFNN (WTT–RBFNN). It is concluded that the proposed approach is an effective way to improve the prediction accuracy.     

EMD与NARX神经网络的风电场总功率组合预测

探索构建对风电场总功率进行直接预测的高精度组合预测算法。考虑到风速的非平稳性导致风电总功率表现为非平稳时间序列,采用NARX神经网络作为初步预测模型,提出了经验模态分解与NARX神经网络相结合的混合预测模型。对风电场总功率非平稳时间序列进行经验模态分解,得到不同频带本征模式分量的平稳序列。对不同频带的平稳分量建立相应的NARX神经网络预测模型,并将各分量模型的预测值进行等权求和得到最终预测值。此外,为研究不同时间间隔对预测结果的影响,采用某大型风电场时间间隔为5 min与15 min的数据进行实验。预测结果表明,提出的组合预测模型适合于总功率预测,其预测效果比传统模型的效果更佳,且时间间隔为5 min的数据比时间间隔为15 min的数据预测精度更高。     

Performance analysis of modeling framework for prediction in wind farms employing artificial neural networks

This paper introduces the concept and practice of Neural Network architectures for wind speed prediction in wind farms. The wind speed prediction method has been analyzed by using back propagation network and radial basis function network. Artificial neural network is used to develop suitable architecture for predicting wind speed in wind farms. The key of wind speed prediction is rational selection of forecasting model and effective optimization of model performance. To verify the effectiveness of neural network architecture, simulations were conducted on real time wind data with different heights of wind mill. Due to fluctuation and nonlinearity of wind speed, accurate wind speed prediction plays a major role in the operational control of wind farms. The key advantages of Radial Basis Function Network include higher accuracy, reduction of training time and minimal error. The experimental results show that compared to existing approaches, proposed radial basis function network performs better in terms of minimization of errors.     

基于关联规则的PSO-Elman短期风速预测

传统神经网络在短期风速预测中,存在易陷入局部极值和动态性能不足等问题,从而导致风速预测精度较低。为了提高风速预测精度,提出一种基于关联规则的粒子群优化Elman神经网络风速预测模型。利用粒子群算法优化Elman神经网络模型参数,以提高算法的收敛速度,避免陷入局部极值,以得到最优的预测值。同时结合关联规则分析考虑气象因素,采用Apriori算法对风速与其他气象因素进行关联规则挖掘,并利用得到的关联规则对风速预测值进行修正与补偿。实验结果表明,所提出的预测模型的预测效果比传统模型的效果更佳,同时验证了结合关联规则考虑气象因素能够降低风速预测误差。     

基于混合算法的通信用户规模预测方法研究

准确地对通信用户规模进行预测对于通信运营商的决策具有十分重要的意义,而现有的常规预测方法存在预测误差较大、预测速率低等问题。研究一种基于RBF神经网络的通信用户规模预测模型。为了使得RBF神经网络算法预测性能更优,使用梯度下降算法与遗传算法混合对RBF神经网络进行参数优化,提高预测模型收敛效率。实例分析表明,使用本文研究的混合RBF神经网络预测模型的预测结果明显优于其他传统的预测模型。同时,在预测速度上也具有较大的优势。