A comparison of time series and machine learning models for inflation forecasting: empirical evidence from the USA

This study compares time series and machine learning models for inflation forecasting. Empirical evidence from the USA between 1984 and 2014 suggests that out of sixteen conditions (four different inflation indicators and four different horizons), machine learning models provide more accurate forecasting results in seven conditions and the time series models are better in nine conditions. Moreover, multivariate models give better results in fourteen conditions, and univariate models are better only in two conditions. This study shows that machine learning model prevails against time series models for the core personal consumption expenditure (core-PCE) inflation forecasting, and the time series model (ARDL) is better for the core consumer price (core-CPI) index inflation forecasting in all horizons.

     

基于递归神经网络的风暴潮增水预测

风暴潮增水的准确预测能极大地减少人员伤害和经济损失,具有重要的实用价值。传统的风暴潮预报方法主要包括经验和数值预报,很难建立起相对准确的模型。现有的基于机器学习风暴潮预报方法大都只提取出静态数据间的关系,并没有充分挖掘出风暴潮数据背后的时序关联特性。文中提出了一种基于递归神经网络的风暴潮增水预测方法。本文对风暴潮时序数据进行特定的处理,并设计合适结构的递归神经网络,从而完成时序数据的预测。相较于传统的BP神经网络,递归神经网络能更好地应对时序数据的预测问题。将该方法用于潍坊水站的增水预测中,结果表明,相对于BP神经网络,递归神经网络能得到更好的预测结果,误差更小。     

SDAE-LSTM模型在金融时间序列预测中的应用

针对金融时间序列预测的复杂性和长期依赖性，提出了一种基于深度学习的LSTM神经网络预测模型。利用堆叠去噪自编码从金融时间序列的基本行情数据和技术指标中提取特征，将其作为LSTM神经网络的输入对金融时间序列进行预测；通过LSTM神经网络的长期依赖特性来提高金融时间序列的预测精度。利用股价指数数据，与传统的神经网络的预测结果进行比较，结果表明基于深度学习的LSTM神经网络具有比较高的预测精度。     

An effective neural network and fuzzy time series-based hybridized model to handle forecasting problems of two factors

Fuzzy time series forecasting method has been applied in several domains, such as stock market price, temperature, sales, crop production and academic enrollments. In this paper, we introduce a model to deal with forecasting problems of two factors. The proposed model is designed using fuzzy time series and artificial neural network. In a fuzzy time series forecasting model, the length of intervals in the universe of discourse always affects the results of forecasting. Therefore, an artificial neural network- based technique is employed for determining the intervals of the historical time series data sets by clustering them into different groups. The historical time series data sets are then fuzzified, and the high-order fuzzy logical relationships are established among fuzzified values based on fuzzy time series method. The paper also introduces some rules for interval weighing to defuzzify the fuzzified time series data sets. From experimental results, it is observed that the proposed model exhibits higher accuracy than those of existing two-factors fuzzy time series models.     

1D convolutional neural networks for chart pattern classification in financial time series

This paper proposes a novel deep learning-based approach for financial chart patterns classification. Convolutional neural networks (CNNs) have made notable achievements in image recognition and computer vision applications. These networks are usually based on two-dimensional convolutional neural networks (2D CNNs). In this paper, we describe the design and implementation of one-dimensional convolutional neural networks (1D CNNs) for the classification of chart patterns from financial time series. The proposed 1D CNN model is compared against support vector machine, extreme learning machine, long short-term memory, rule-based and dynamic time warping. Experimental results on synthetic datasets reveal that the accuracy of 1D CNN is highest among all the methods evaluated. Results on real datasets also reveal that chart patterns identified by 1D CNN are also the most recognized instances when they are compared to those classified by other methods.

     

Hybrid neural network models for hydrologic time series forecasting

The need for increased accuracies in time series forecasting has motivated the researchers to develop innovative models. In this paper, a new hybrid time series neural network model is proposed that is capable of exploiting the strengths of traditional time series approaches and artificial neural networks (ANNs). The proposed approach consists of an overall modelling framework, which is a combination of the conventional and ANN techniques. The steps involved in the time series analysis, e.g. de-trending and de-seasonalisation, can be carried out before gradually presenting the modified time series data to the ANN. The proposed hybrid approach for time series forecasting is tested using the monthly streamflow data at Colorado River at Lees Ferry, USA. Specifically, results from four time series models of auto-regressive (AR) type and four ANN models are presented. The results obtained in this study suggest that the approach of combining the strengths of the conventional and ANN techniques provides a robust modelling framework capable of capturing the non-linear nature of the complex time series and thus producing more accurate forecasts. Although the proposed hybrid neural network models are applied in hydrology in this study, they have tremendous scope for application in a wide range of areas for achieving increased accuracies in time series forecasting.     

A novel soft computing framework for solar radiation forecasting

Accurate forecasting of renewable-energy sources plays a key role in their integration into the grid. This paper proposes a novel soft computing framework using a modified clustering technique, an innovative hourly time-series classification method, a new cluster selection algorithm and a multilayer perceptron neural network (MLPNN) to increase the solar radiation forecasting accuracy. The proposed clustering method is an improved version of K-means algorithm that provides more reliable results than the K-means algorithm. The time series classification method is specifically designed for solar data to better characterize its irregularities and variations. Several different solar radiation datasets for different states of U.S. are used to evaluate the performance of the proposed forecasting model. The proposed forecasting method is also compared with the existing state-of-the-art techniques. The comparison results show the higher accuracy performance of the proposed model.     

Evolutionary Learning Processes to Design the Dilation-Erosion Perceptron for Weather Forecasting

The weather forecasting is considered a rather difficult problem due to many complex features present in these time series. Several techniques have been proposed in the literature to solve this problem. In particular, the dilation-erosion perceptron (DEP), a model whose foundations are based on mathematical morphology and complete lattice theory, has been successfully used for time series forecasting. However, a drawback arises from the gradient estimation of morphological operators in the classical gradient-based learning process of the DEP, since they are not differentiable of usual way. In this sense, this work presents evolutionary learning processes, using a modified genetic algorithm, a particle swarm optimization, a modified differential evolution and a covariance matrix adaptation evolutionary strategy, to design the DEP model for weather forecasting. In addition, into the proposed learning processes we have included an automatic correction step that is geared toward eliminating time phase distortions that occur in some weather phenomena. An experimental analysis is presented using three non-linear forecasting problems from the Brazilian weather, and the obtained results are discussed and compared, according to five well-known performance metrics and an evaluation function, to results found using the DEP model with its classical gradient-based learning process.     

Connectionist approach to time series prediction: an empirical test

Among the various potential applications of neural networks, forecasting is considered to be a major application. Several researchers have reported their experiences with the use of neural networks in forecasting, and the evidence is inconclusive. This paper presents the results of a forecasting competition between a neural network model and a Box-Jenkins automatic forecasting expert system. Seventy-five series, a subset of data series which have been used for comparison of various forecasting techniques, were analysed using the Box-Jenkins approach and a neural network implementation. The results show that the simple neural net model tested on this set of time series could forecast about as well as the Box-Jenkins forecasting system.     

基于经验模式分解和极限学习机的铀资源价格预测方法

针对国际铀资源价格预测问题, 提出一种基于经验模式分解(EMD)、相空间重构(PSR) 和极限学习机(ELM) 的非线性组合预测方法. 首先通过EMD分解, 将原始价格序列分解为若干固有模态分量(IMF), 按频率高低将各IMF 分组叠加成3 个新序列; 然后在重构相空间的基础上构建不同的ELM模型, 分别对各IMF 序列进行预测; 最后对预测结果进行合成. 将该方法应用于实际铀资源价格预测, 并与径向基神经网络(RBF) 方法及单独ELM方法进行比较, 仿真结果表明该方法预测精度有明显的提高.

     

Non-tuned machine learning approach for hydrological time series forecasting

Stream-flow forecasting is a crucial task for hydrological science. Throughout the literature, traditional and artificial intelligence models have been applied to this task. An attempt to explore and develop better expert models is an ongoing endeavor for this hydrological application. In addition, the accuracy of modeling, confidence and practicality of the model are the other significant problems that need to be considered. Accordingly, this study investigates modern non-tuned machine learning data-driven approach, namely extreme learning machine (ELM). This data-driven approach is containing single layer feedforward neural network that selects the input variables randomly and determine the output weights systematically. To demonstrate the reliability and the effectiveness, one-step-ahead stream-flow forecasting based on three time-scale pattern (daily, mean weekly and mean monthly) for Johor river, Malaysia, were implemented. Artificial neural network (ANN) model is used for comparison and evaluation. The results indicated ELM approach superior the ANN model level accuracies and time consuming in addition to precision forecasting in tropical zone. In measureable terms, the dominance of ELM model over ANN model was indicated in accordance with coefficient determination (R ²) root-mean-square error (RMSE) and mean absolute error (MAE). The results were obtained for example the daily time scale R ² = 0.94 and 0.90, RMSE = 2.78 and 11.63, and MAE = 0.10 and 0.43, for ELM and ANN models respectively.

     

Nonlinear time series forecasting with Bayesian neural networks

The Bayesian learning provides a natural way to model the nonlinear structure as the artificial neural networks due to their capability to cope with the model complexity. In this paper, an evolutionary Monte Carlo (MC) algorithm is proposed to train the Bayesian neural networks (BNNs) for the time series forecasting. This approach called as Genetic MC is based on Gaussian approximation with recursive hyperparameter. Genetic MC integrates MC simulations with the genetic algorithms and the fuzzy membership functions. In the implementations, Genetic MC is compared with the traditional neural networks and time series techniques in terms of their forecasting performances over the weekly sales of a Finance Magazine.     

基于聚类的数据加权优化在犯罪预测中的应用

近年来，我国传统暴力犯罪与成年人犯罪呈下降态势，但是，犯罪案由层出不穷。为有效提升公安实践工作中犯罪预测能力，打击各类违法犯罪事件,本文针对犯罪数据，提出一种新型犯罪预测模型。利用密度聚类分析方法将犯罪数据分类，然后进行数据降维提取关键属性生成特征数据，继而对特征数据进行加权优化并采用机器学习的方式对特征数据进行学习，从而预测犯罪案由。实验结果表明，与传统方法相比，本文方法具有更好的预测效果，为公安实践工作中类似案件的侦破和预防，提供新的路径支撑。     

Static, Dynamic, and Hybrid Neural Networks in Forecasting Inflation

The back-propagation neural network (BPN) model has been the most popular form of artificial neural network model used for forecasting, particularly in economics and finance. It is a static (feed-forward) model which has a learning process in both hidden and output layers. In this paper we compare the performance of the BPN model with that of two other neural network models, viz., the radial basis function network (RBFN) model and the recurrent neural network (RNN) model, in the context of forecasting inflation. The RBFN model is a hybrid model with a learning process that is much faster than the BPN model and that is able to generate almost the same results as the BPN model. The RNN model is a dynamic model which allows feedback from other layers to the input layer, enabling it to capture the dynamic behavior of the series. The results of the ANN models are also compared with those of the econometric time series models.     

基于周期性建模的时间序列预测方法及电价预测研究

时间序列数据广泛存在于人类的生产生活中, 通常具有复杂的非线性动态和一定的周期性. 与传统的时间序列分析方法相比, 基于深度学习的方法更能捕捉数据的深层特性, 对具有复杂非线性的时间序列有较好的建模效果. 为了在神经网络中显式地建模时间序列数据的周期性和趋势性, 本文在循环神经网络的基础上引入了周期损失和趋势损失, 建立了基于周期性建模和多任务学习的时间序列预测模型. 将模型应用到欧洲能源交易所法国市场的能源市场价格预测中, 结果表明周期损失和趋势损失能够提高神经网络的泛化能力, 并提高预测时间序列趋势的精度.     

Hybridization of autoregressive integrated moving average (ARIMA) with probabilistic neural networks (PNNs)

Autoregressive integrated moving average (ARIMA) models are one of the most important time series models applied in financial market forecasting over the past three decades. Improving forecasting especially time series forecasting accuracy is an important yet often difficult task facing forecasters. Both theoretical and empirical findings have indicated that integration of different models can be an effective way of improving upon their predictive performance, especially when the models in the ensemble are quite different. In the literature, several hybrid techniques have been proposed by combining different time series models together, in order to yield results that are more accurate. In this paper, a new hybrid model of the autoregressive integrated moving average (ARIMA) and probabilistic neural network (PNN), is proposed in order to yield more accurate results than traditional ARIMA models. In proposed model, the estimated values of the ARIMA model are modified based on the distinguished trend of the ARIMA residuals and optimum step length, which are respectively obtained from a probabilistic neural network and a mathematical programming model. Empirical results with three well-known real data sets indicate that the proposed model can be an effective way in order to construct a more accurate hybrid model than ARIMA model. Therefore, it can be used as an appropriate alternative model for forecasting tasks, especially when higher forecasting accuracy is needed.     

Forecasting model of global stock index by stochastic time effective neural network

In this paper, we investigate the statistical properties of the fluctuations of the Chinese Stock Index, and we study the statistical properties of HSI, DJI, IXIC and SP500 by comparison. According to the theory of artificial neural networks, a stochastic time effective function is introduced in the forecasting model of the indices in the present paper, which gives an improved neural network – the stochastic time effective neural network model. In this model, a promising data mining technique in machine learning has been proposed to uncover the predictive relationships of numerous financial and economic variables. We suppose that the investors decide their investment positions by analyzing the historical data on the stock market, and the historical data are given weights depending on their time, in detail, the nearer the time of the historical data is to the present, the stronger impact the data have on the predictive model, and we also introduce the Brownian motion in order to make the model have the effect of random movement while maintaining the original trend. In the last part of the paper, we test the forecasting performance of the model by using different volatility parameters and we show some results of the analysis for the fluctuations of the global stock indices using the model.     

Modes decomposition method in fusion with robust random vector functional link network for crude oil price forecasting

This paper proposes a decomposition based method in fusion with the non-iterative approach for crude oil price forecasting. In this approach, the robust random vector functional link network (RVFLN), a non-iterative approach in fusion with the most efficient decomposition technique called variational mode decomposition (VMD) is proposed which is executed with two links — fixed assigned random weights and direct link from input to output, and the iterative learning process is not involved in its functioning which makes it faster in execution as compared to many existing techniques proposed for forecasting. The fusion of VMD and robust RVFLN called VMD-RVFLN is implemented for crude oil price forecasting where the crude oil price series is decomposed using VMD into a linear smoother series by extracting useful information and the decomposed modes pass through the robust RVFLN model which produces the final forecasting values. The analysis performed in the study approves its efficiency and reports improvement in forecasting accuracy and execution time as compared to some of the traditional iterative techniques like BPNN (back propagation neural network), ARIMA (auto-regressive integrated moving average), LSSVR (least squares support vector regression), ANFIS (adaptive neuro-fuzzy inference system), IT2FNN (interval type-2 fuzzy neural network) and RNN (recurrent neural network), etc. However, both ELM and RVFLN without modes decomposition fusion exhibit less execution time at the cost of reduction in prediction accuracy.     

一种基于自演化预训练的多变量时间序列预测算法

时间序列预测是典型的时间序列分析任务,对于辅助决策、资源配置、提前采取止损措施等方面有重要意义,在包括电力、气象、交通、商业等领域有广泛应用.近年来,时间序列预测算法一直是机器学习的热门研究领域,其中多变量时间序列预测是一个具有挑战性的任务.本文研究多变量时间序列预测的局部变量预测精度问题,即多变量预测需要在提升整体预...     

Stock prediction using deep learning

Stock market is considered chaotic, complex, volatile and dynamic. Undoubtedly, its prediction is one of the most challenging tasks in time series forecasting. Moreover existing Artificial Neural Network (ANN) approaches fail to provide encouraging results. Meanwhile advances in machine learning have presented favourable results for speech recognition, image classification and language processing. Methods applied in digital signal processing can be applied to stock data as both are time series. Similarly, learning outcome of this paper can be applied to speech time series data. Deep learning for stock prediction has been introduced in this paper and its performance is evaluated on Google stock price multimedia data (chart) from NASDAQ. The objective of this paper is to demonstrate that deep learning can improve stock market forecasting accuracy. For this, (2D)²PCA + Deep Neural Network (DNN) method is compared with state of the art method 2-Directional 2-Dimensional Principal Component Analysis (2D)²PCA + Radial Basis Function Neural Network (RBFNN). It is found that the proposed method is performing better than the existing method RBFNN with an improved accuracy of 4.8% for Hit Rate with a window size of 20. Also the results of the proposed model are compared with the Recurrent Neural Network (RNN) and it is found that the accuracy for Hit Rate is improved by 15.6%. The correlation coefficient between the actual and predicted return for DNN is 17.1% more than RBFNN and it is 43.4% better than RNN.