Multi-step Learning Rule for Recurrent Neural Models: An Application to Time Series Forecasting

Multi-step prediction is a difficult task that has attracted increasing interest in recent years. It tries to achieve predictions several steps ahead into the future starting from current information. The interest in this work is the development of nonlinear neural models for the purpose of building multi-step time series prediction schemes. In that context, the most popular neural models are based on the traditional feedforward neural networks. However, this kind of model may present some disadvantages when a long-term prediction problem is formulated because they are trained to predict only the next sampling time. In this paper, a neural model based on a partially recurrent neural network is proposed as a better alternative. For the recurrent model, a learning phase with the purpose of long-term prediction is imposed, which allows to obtain better predictions of time series in the future. In order to validate the performance of the recurrent neural model to predict the dynamic behaviour of the series in the future, three different data time series have been used as study cases. An artificial data time series, the logistic map, and two real time series, sunspots and laser data. Models based on feedforward neural networks have also been used and compared against the proposed model. The results suggest than the recurrent model can help in improving the prediction accuracy.     

基于CEEMDAN分解的短时交通流组合预测

短时交通流预测是实现交通流诱导与控制的重要保障,鉴于交通流的随机性和复杂性,提出基于自适应噪声完全集合经验模态分解（CEEMDAN）的短时交通流组合预测模型。利用CEEMDAN算法对非线性序列具有自适应分解的特性,将交通流时间序列通过CEEMDAN分解为频率不同、复杂度不同的多个时间序列分量;利用PE算法分析各个分量的随机特性,根据时间序列分量的不同随机特性分为高频序列分量、中频序列分量和低频序列分量,根据高频、中频和低频序列分量的随机特性分别建立GWO-BP模型、GWO-LSSVM模型和ARIMA模型进行预测;叠加高频、中频和低频各个分量的预测结果,得到短时交通流最终预测值。仿真分析结果表明,与其他预测模型相比,基于CEEMDAN分解的短时交通流组合预测模型提升了预测精度。     

A hybrid neural network and ARIMA model for water quality time series prediction

Accurate predictions of time series data have motivated the researchers to develop innovative models for water resources management. Time series data often contain both linear and nonlinear patterns. Therefore, neither ARIMA nor neural networks can be adequate in modeling and predicting time series data. The ARIMA model cannot deal with nonlinear relationships while the neural network model alone is not able to handle both linear and nonlinear patterns equally well. In the present study, a hybrid ARIMA and neural network model is proposed that is capable of exploiting the strengths of traditional time series approaches and artificial neural networks. The proposed approach consists of an ARIMA methodology and feed-forward, backpropagation network structure with an optimized conjugated training algorithm. The hybrid approach for time series prediction is tested using 108-month observations of water quality data, including water temperature, boron and dissolved oxygen, during 1996–2004 at Büyük Menderes river, Turkey. Specifically, the results from the hybrid model provide a robust modeling framework capable of capturing the nonlinear nature of the complex time series and thus producing more accurate predictions. The correlation coefficients between the hybrid model predicted values and observed data for boron, dissolved oxygen and water temperature are 0.902, 0.893, and 0.909, respectively, which are satisfactory in common model applications. Predicted water quality data from the hybrid model are compared with those from the ARIMA methodology and neural network architecture using the accuracy measures. Owing to its ability in recognizing time series patterns and nonlinear characteristics, the hybrid model provides much better accuracy over the ARIMA and neural network models for water quality predictions.     

Prophet混合模型应用于基站网络流量长期预测

传统网络流量预测方法大多数关注短期预测,而长期预测能够更好地指导基站小区无线设备扩缩容。集合经验模态分解（ensemble empirical mode decomposition,EEMD）能够使非平稳时间序列转化成平稳时间序列,Prophet模型能够准确地对流量序列进行较准确的长期预测,基于以上模型方法的优点和基站小区网络流量的非线性和非平稳性特点,提出一种Prophet混合EEMD的基站小区网络流量预测方法（E-Prophet）。采用EEMD将网络流量序列分解成若干固有模态函数（intrinsic mode functions,IMF）分量和一个残差分量;利用Prophet模型对各分量建模,并将各分量预测结果进行线性组合,得到最终的预测结果。利用实际基站小区网络流量数据对方法进行验证,结果表明：E-Prophet对于网络流量长期预测比Prophet、SARIMA、LSTM以及结合EMD和Prophet的模型具有更高的准确度和鲁棒性。     

经验模式分解与时间序列分析在网络流量预测中的应用

提出一种经验模式分解和时间序列分析的网络流量预测方法. 首先,对网络流量时间序列进行经验模式分解,产生高低频分量和余量;然后,对各分量进行时间序列分析,确保高频分量采用改进和声搜索算法优化的最小二乘支持向量机模型、低频分量和余量采用差分自回归滑动平均模型进行建模和预测;最后,将预测结果通过RBF神经网络进行非线性叠加,得到最终的预测值.仿真实验表明,所提出方法具有更好的预测效果和更高的预测精度.     

EEMD与RBF神经网络的太阳黑子月均值预测

太阳黑子月均值是典型的混沌时间序列,具有较强的非线性和非平稳特征,能够反映太阳活动的真实水平。采用一种应用集合经验模态分解（Ensemble Empirical Mode Decomposition,EEMD）与径向基函数（Radial Basis Function,RBF）神经网络组合的预测模型。通过EEMD将原始时间序列分解为若干个不同时间尺度的本征模态函数（Intrinsic Mode Function,IMF）分量,并对这些分量进行建模预测,再将各分量的预测值重构得到原始时间序列的预测值,这样不仅降低了算法的复杂性,而且有利于提高模态分量包含信息的物理意义。仿真结果表明,与经验模态分解（Empirical Mode Decomposition,EMD）结合RBF神经网络的模型相比,该模型具有较高的预测精度。     

A nonlinear prediction model for Chinese speech signal based on RBF neural network

A novel method for Chinese speech time series prediction model is proposed. In order to reconstruct the phase space of Chinese speech signal, the delay time and embedding dimension are calculated by C–C method and false nearest neighbor algorithm. The maximum lyapunov exponent and correlation dimension of Chinese speech phoneme are calculated by wolf algorithm and genetic programming algorithm. The numerical results show that there exists nonlinear characteristics in Chinese speech signal. Based on the analysis method of RBF neural network and the nonlinear characteristic parameters such as the delay time and embedding dimension, a nonlinear prediction model is designed. In order to further verify the prediction performance of the designed prediction model, waveform comparison and four evaluation indexes are used. It is shown that compared with the linear prediction model and back propagation neural network nonlinear prediction model, prediction error of the RBF neural network nonlinear prediction model is significantly reduced, and the model has higher prediction accuracy and prediction performance.

     

基于趋势点状态模型的时间序列预测算法

针对传统的时间序列线性预测算法对时间序列的线性程度要求高,而非线性方法一般建模复杂且计算量大,提出了一种基于趋势点状态模型的时间序列预测算法.该算法无须考虑时间序列是否具有显著线性特征,通过序列间耦合度挖掘时间序列上的相似子序列,找出相对应的相似序列趋势点,建立趋势点状态模型并求出预测值.算法建模简单,复杂度较低.通过模拟实验,结果表明该算法性能良好,尤其对具有周期性的时间序列预测精度很高.     

基于Pytorch的LSTM模型对股价的分析与预测

股价预测一直都是股票投资者重点关注和重点研究的方向,针对股价具有高度非线性、高噪声、动态性等问题,提出一种基于自组织特征映射(SOM)神经网络和长短期记忆网络(LSTM)共同应用的股价预测方法。第一步聚类,使用python语言实现改进的自组织特征映射神经网络算法,将187支股票分成三类,三类股票以盈利能力大小进行聚类,并且求出每一类所包含的股票代码;第二步预测,基于Pytorch深度学习框架构造长短期记忆网络模型,分别对每一类中随机的3支股票进行股价预测,再通过均方误差和决定系数对预测结果进行评价。结果表明,在使用相同的预测模型对不同盈利能力的股票做股价预测时,盈利能力越大的股票,预测精度越高。此研究可以为投资者筛选出盈利能力更大的股票,并且在提高股价预测精度上也具有一定的贡献。     

A moving-average filter based hybrid ARIMA–ANN model for forecasting time series data

A suitable combination of linear and nonlinear models provides a more accurate prediction model than an individual linear or nonlinear model for forecasting time series data originating from various applications. The linear autoregressive integrated moving average (ARIMA) and nonlinear artificial neural network (ANN) models are explored in this paper to devise a new hybrid ARIMA–ANN model for the prediction of time series data. Many of the hybrid ARIMA–ANN models which exist in the literature apply an ARIMA model to given time series data, consider the error between the original and the ARIMA-predicted data as a nonlinear component, and model it using an ANN in different ways. Though these models give predictions with higher accuracy than the individual models, there is scope for further improvement in the accuracy if the nature of the given time series is taken into account before applying the models. In the work described in this paper, the nature of volatility was explored using a moving-average filter, and then an ARIMA and an ANN model were suitably applied. Using a simulated data set and experimental data sets such as sunspot data, electricity price data, and stock market data, the proposed hybrid ARIMA–ANN model was applied along with individual ARIMA and ANN models and some existing hybrid ARIMA–ANN models. The results obtained from all of these data sets show that for both one-step-ahead and multistep-ahead forecasts, the proposed hybrid model has higher prediction accuracy.     

基于集成深度学习算法的燃气负荷预测方法

燃气负荷预测受到社会经济、天气因素、日期类型等多种复杂因素的影响,而多因素的共同作用则必然会导致燃气负荷序列变化趋势具有很大的随机性以及一定程度上的复杂性.为了有效提高燃气负荷预测的精度,本文提出了一种新型的集成深度算法来对燃气负荷进行多步预测.首先通过EEMD算法将非平稳非线性的负荷序列分解为若干个稳态且线性的本征模式分量及剩余项,有效的避免了传统EMD带来的模态混叠问题,然后将负荷数据的影响因素输入到AutoEncoder中进行特征提取并做非线性降维处理,再将EEMD分解得到的每个子序列分别与AutoEncoder提取到的特征序列组成不同的训练矩阵,最后针对不同的子序列对应的训练矩阵建立相应的LSTM预测模型,重构分量预测值得到最终预测结果.为了验证所提出算法的有效性和预测性能,使用上海燃气数据来进行上述模型的仿真实验,结果证明相较对比方法,预测精度有了明显的提高.     

基于组合模型的非线性时间序列预测算法

为解决复杂系统中非线性时间序列预测模型构建效率低、预测精度低的问题,提出基于组合模型的HURST-EMD预测算法.采用EMD算法将非线性时间序列分解为代表原始序列特征的各个IMF,然后引入赫斯特(Hurst)指数将同类的IMF整合为新的分量,最后选用LS-SVR-ARIMA模型进行组合预测.在该算法中,设计了序列分类整合等过程,优化了建模的计算量,构建了高效精准的预测模型.为验证模型的有效性,采用上证指数公共数据集和真实交通流数据进行检验,实验结果表明,改进的基于组合模型的HURST-EMD预测算法在提高预测效率的同时具有更好的预测精度.     

基于矢量空间重构的网络流量预测算法

客户机与服务器之间存在数据存储隐通道,对该通道的网络流量进行准确预测可避免网络拥堵,提高网络流量的调度和管理能力。传统方法采用线性时间序列分析方法进行网络流量预测,没有准确反映流量序列的非线性特征信息,预测精度不高。提出一种基于非线性时间序列分析和矢量空间重构的网络流量预测算法。进行相位随机化处理,使得网络流量数据离散解析化,把网络流量时间序列解析模型分解为含有多个非线性成分的统计量。采用自相关函数法求得矢量空间重构的时间延迟,采用互信息最小嵌入维算法求得网络流量序列的矢量空间嵌入维,实现流量序列的矢量空间重构。在高维矢量空间中,提取网络流量的高阶谱特征,实现网络流量的准确预测。仿真结果表明,采用该算法能有效拟合流量序列的非线性状态特征,对流量状态变化的动态跟踪性能较好,其预测误差比传统方法的低。     

原油期货价格预测模型CEEMDAN-PSO-ELM

为了进一步提升原油期货价格预测的精准性,本文基于CEEMDAN分解算法和ELM极限学习机模型,利用PSO粒子群优化算法对机器学习模型进行参数寻优,进而构建了CEEMDAN-PSO-ELM模型用于原油期货价格预测.先基于CEEMDAN算法对原始价格序列进行分解,然后利用Lempel-Ziv复杂度指数对分量进行重构,得到高频、中频和低频重构分量,再采用PSO-ELM模型对每个重构分量进行预测,利用PACF系数选取模型输入变量,最终加总集成各分量预测结果.实证结果表明,与其他15种基准模型相比,CEEMDAN-PSO-ELM模型的预测性能最佳,MCS检验和DM检验也进一步证实了该模型的稳健性.     

Kernel-Based State-Space Kriging for Predictive Control

In this paper, we extend the state-space kriging(SSK) modeling technique presented in a previous work by the authors in order to consider non-autonomous systems. SSK is a data-driven method that computes predictions as linear combinations of past outputs. To model the nonlinear dynamics of the system, we propose the kernel-based state-space kriging(K-SSK), a new version of the SSK where kernel functions are used instead of resorting to considerations about the locality of the data. Also, a Kalma...     

结合SVD_ TLS及EKF算法的动态自组织模糊神经网络在动态系统中的应用

针对如何优化模糊神经网络的规则及如何合理地调整非线性参数及线性参数等问题,提出了将奇异值分解_总体最小二乘法(SVD_TLS)及扩展卡尔曼滤波(EKF)相结合的动态自组织模糊神经网络(STD_DSFNN)。首先给出了STD DSFNN的结构及各层的含义;其次,用EKF算法学习非线性参数,SVD_TLS算法学习线性参数的同时提取重要模糊规则;最后,通过典型的Machey-Ulass时间序列预测实例验证SVD_TLS及EKF相结合的动态自组织模糊神经网络(STE_DSFNN),同时与DFNN, ANFIS及UKF_DFNN相对比,结果表明STE DSFNN网络结构更紧凑,具有更好的泛化能力。     

一种基于分级输入训练神经网络的非线性主元分析

基于输入训练神经网络的非线性主元分析（PCA）能够有效地提取过程变量的非线性主元,但是存在主元的个数不能通过网络训练确定,且各个主元重要程度在神经网络中无法区分等缺点，本文提出一种分级输入自调整神经网络,并进一步提出基于此网络的非线性PCA,通过多级输入自调整神经网络,将主元按顺序找出,且根据主元对过程数据的预测误差定量地确定出主元的个数,克服了上述缺点.     

基于Volterra级数的一类非线性系统性能评估

化工过程多具有非线性特征,针对用线性系统性能评估方法处理非线性系统会存在过估计的情况,研究了一类叠加线性干扰的非线性系统的性能评估问题。通过使用Volterra级数近似非线性环节,把最小方差性能评估问题转化成一类模型辨识问题,并从辨识误差中得到非线性系统的最小方差估计值。通过数值仿真,将新方法所得结果和现有线性性能评估方法进行了比较,验证了设计算法的优越性。     

基于预测窗的轮式移动机器人最优避障避碰算法

针对非线性轮式移动机器人的避障以及多机器人间的相互避碰问题,提出了一种基于预测窗的避障避碰算法.首先为了便于预测碰撞的发生,通过反馈线性化将非线性的机器人运动学模型转化成线性模型;然后根据线性模型预测会导致机器人发生碰撞的所有相对虚拟加速度变化量集合,称之为加速度变化障碍.基于此,为每个机器人构造既能躲避障碍物又能相互避碰的可行加速度变化集合.然后通过优化指标函数求得最优虚拟加速度变化量,最后将其转换成机器人的实际控制量.这种算法与现有的相比,可使机器人在避障或避碰过程中的行驶方向角、线速度的变化幅值更小,角速度和线加速度的变化更为平顺,而且运行所用的平均时间更短.仿真结果演示了所提出算法的有效性和相对于已有方法的优势.