Daily prediction of short-term trends or crude oil prices using neural networks exploiting multimarket dynamics

This paper documents a systematic investigation on the predictability of short-term trends of crude oil prices on a daily basis. In stark contrast with longer-term predictions of crude oil prices, short-term prediction with time horizons of 1-3 days posits an important problem that is quite different from what has been studied in the literature. The problem of such short-term predicability is tackled through two aspects. The first is to examine the existence of linear or nonlinear dynamic processes in crude oil prices. This sub-problem is addressed with statistical analysis involving the Brock-Dechert-Scheinkman test for nonlinearity. The second aspect is to test the capability of artificial neural networks (ANN) for modeling the implicit nonlinearity for prediction. Four experimental models are designed and tested with historical data: (1) using only the lagged returns of filtered crude oil prices as input to predict the returns of the next days; this is used as the benchmark, (2) using only the information set of filtered crude oil futures price as input, (3) combining the inputs from the benchmark and second models, and (4) combing the inputs from the benchmark model and the intermarket information. In order to filter out the noise in the original price data, the moving averages of prices are used for all the experiments. The results provided sufficient evidence to the predictability of crude oil prices using ANN with an out-of-sample hit rate of 80%, 70%, and 61% for each of the next three days’ trends.     

基于TN-LP-LSTM-SVM混合模型的原油期货次日价格变化方向和波动率大小预测

原油价格受国际政治、经济、军事、外交以及其他复杂因素的影响,这些因素的频繁变化使油价表现出随机波动,给原油投资及交易决策带来困难,准确预测油价已成为能源领域学术界的研究热点.但是,现有关于原油价格预测的文献大多数是预测原油价格的数值而不是变化方向,而且不是同时预测原油价格和波动率,因此无法给投资者充分的决策指导信息.为了填补这一研究空白,提出一种结合转移网络(TN)、链接预测(LP)、长短期记忆模型(LSTM)和支持向量机(SVM)的新的混合模型TN-LP-LSTM-SVM来更精确地预测WTI期货次日价格变化方向和波动率大小,为投资者、能源相关企业和参与政策决策的政府人员提供有益的建议.在不同的时间窗口下($h\in [1,50]$且$h\in {\bm Z     

Integration of genetic fuzzy systems and artificial neural networks for stock price forecasting

Stock market prediction is regarded as a challenging task in financial time-series forecasting. The central idea to successful stock market prediction is achieving best results using minimum required input data and the least complex stock market model. To achieve these purposes this article presents an integrated approach based on genetic fuzzy systems (GFS) and artificial neural networks (ANN) for constructing a stock price forecasting expert system. At first, we use stepwise regression analysis (SRA) to determine factors which have most influence on stock prices. At the next stage we divide our raw data into k clusters by means of self-organizing map (SOM) neural networks. Finally, all clusters will be fed into independent GFS models with the ability of rule base extraction and data base tuning. We evaluate capability of the proposed approach by applying it on stock price data gathered from IT and Airlines sectors, and compare the outcomes with previous stock price forecasting methods using mean absolute percentage error (MAPE). Results show that the proposed approach outperforms all previous methods, so it can be considered as a suitable tool for stock price forecasting problems.     

基于GA-BP的个股超短线预测应用研究

本文将遗传算法(GA)与BP算法相结合的人工神经网络模型学习算法,通过对海信电信(600060)的股票收盘价进行超短线预测研究,该模型通过matlab编程仿真,通过实验证明了股价超短线预测模型的可行性。     

区间计量方法及其在油价预测中的应用研究

经典的计量经济学建模与预测方法是基于点数据的,忽略了区间内价格波动的大量信息,因而预测效果欠佳。引入区间计算与区间计量方法,应用于国际原油期货价格的预测,研究结果表明：相对于经典AR-GARCH模型的置信区间预测结果,区间计量方法的预测结果具有更高的准确度与更小的预测误差。研究证实了区间计算与区间计量方法的优越性,并揭示了在经济领域的重要应用价值。     

Supervised classification of share price trends

Share price trends can be recognized by using data clustering methods. However, the accuracy of these methods may be rather low. This paper presents a novel supervised classification scheme for the recognition and prediction of share price trends. We first produce a smooth time series using zero-phase filtering and singular spectrum analysis from the original share price data. We train pattern classifiers using the classification results of both original and filtered time series and then use these classifiers to predict the future share price trends. Experiment results obtained from both synthetic data and real share prices show that the proposed method is effective and outperforms the well-known K-means clustering algorithm.     

基于EMD改进的Elman神经网络对股票的短期预测模型

Elman神经网络在短期预测股市收盘价时存在预测趋势良好但准确度较低的问题。在Elman神经网络的思想上提出以经验模态分解EMD为基础的Elman新组合模型。应用EMD将各交易日的收盘价序列分解成不同时间尺度上的本征模函数IMF分量和剩余分量,进而利用偏自相关函数PACF计算每一个分量的滞后期,以确定各分量在Elman神经网络中的输入和输出变量,从而得到各分量的预测值,相加得到最终的预测结果。与EMD单一网络、EMD-Elman模型、BP网络及EMD-BP模型进行实验对比,结果表明:该短期预测模型的预测值均方误差、平均绝对误差和平均绝对百分比误差都得到较大的改善;新组合模型可有效实现对股票收盘价的短期预测,且能降低非平稳性对预测结果的影响。该研究为进一步预测股市的走向提供了有效依据,也为投资者提供了更充分的决策参考。     

A Bayesian regularized artificial neural network for stock market forecasting

In this paper a Bayesian regularized artificial neural network is proposed as a novel method to forecast financial market behavior. Daily market prices and financial technical indicators are utilized as inputs to predict the one day future closing price of individual stocks. The prediction of stock price movement is generally considered to be a challenging and important task for financial time series analysis. The accurate prediction of stock price movements could play an important role in helping investors improve stock returns. The complexity in predicting these trends lies in the inherent noise and volatility in daily stock price movement. The Bayesian regularized network assigns a probabilistic nature to the network weights, allowing the network to automatically and optimally penalize excessively complex models. The proposed technique reduces the potential for overfitting and overtraining, improving the prediction quality and generalization of the network. Experiments were performed with Microsoft Corp. and Goldman Sachs Group Inc. stock to determine the effectiveness of the model. The results indicate that the proposed model performs as well as the more advanced models without the need for preprocessing of data, seasonality testing, or cycle analysis.     

A hybrid method for crude oil price direction forecasting using multiple timeframes dynamic time wrapping and genetic algorithm

This study proposes a hybrid method based on similarity measurement of time series from multiple timeframes to predict direction changes of crude oil price, as well as executing simulated trading. Except daily timeframe data, it is essential for utilizing the information from various representations of the same data source; hence weekly data are also used. For the proposed method, firstly, it uses the Multiple Dynamic Time Wrapping (MDTW) to collect similar time series from daily and weekly data, and direction changes and returns of them one week later. Next, it calculates a comprehensive expected return based on the expected return results of two timeframes and their weights. Then, the proposed method predicts the direction change of current time series for one week later, and executes simulation trading upon the prediction results. Lastly, the proposed method adopted the genetic algorithms to optimize several model parameters for trading strategy. Experimental results showed that the proposed method achieved excellent performances in terms of hit ratio, accumulated return and Sharpe ratio, and the results are significantly superior to that of benchmark methods. The proposed method can provide beneficial advises for investors, energy-related enterprises, and government officers engaged in policy decisions.     

Application of partial mutual information variable selection to ANN forecasting of water quality in water distribution systems

Recent trends in the management of water supply have increased the need for modelling techniques that can provide reliable, efficient, and accurate representation of the complex, non-linear dynamics of water quality within water distribution systems. Statistical models based on artificial neural networks (ANNs) have been found to be highly suited to this application, and offer distinct advantages over more conventional modelling techniques. However, many practitioners utilise somewhat heuristic or ad hoc methods for input variable selection (IVS) during ANN development.This paper describes the application of a newly proposed non-linear IVS algorithm to the development of ANN models to forecast water quality within two water distribution systems. The intention is to reduce the need for arbitrary judgement and extensive trial-and-error during model development. The algorithm utilises the concept of partial mutual information (PMI) to select inputs based on the analysis of relationship strength between inputs and outputs, and between redundant inputs. In comparison with an existing approach, the ANN models developed using the IVS algorithm are found to provide optimal prediction with significantly greater parsimony. Furthermore, the results obtained from the IVS procedure are useful for developing additional insight into the important relationships that exist between water distribution system variables.     

Predicting the direction,maximum, minimum and closing prices of daily Bitcoin exchange rate using machine learning techniques

Bitcoin is the most accepted cryptocurrency in the world, which makes it attractive for investors and traders. However, the challenge in predicting the Bitcoin exchange rate is its high volatility. Therefore, the prediction of its behavior is of great importance for financial markets. In this way, recent studies have been carried out on what internal and/or external Bitcoin information is relevant to its prediction. The increased use of machine learning techniques to predict time series and the acceptance of cryptocurrencies as financial instruments motivated the present study to seek more accurate predictions for the Bitcoin exchange rate. In this way, in a first stage of the proposed methodology, different feature selection techniques were evaluated in order to obtain the most relevant attributes for the predictions. In the sequence, it was analyzed the behavior of Artificial Neural Networks (ANN), Support Vector Machines (SVM) and Ensemble algorithms (based on Recurrent Neural Networks and the k-Means clustering method) for price direction predictions. Likewise, the ANN and SVM were employed for regression of the maximum, minimum and closing prices of the Bitcoin. Moreover, the regression results were also used as inputs to try to improve the price direction predictions. The results showed that the selected attributes and the best machine learning model achieved an improvement of more than 10%, in accuracy, for the price direction predictions, with respect to the state-of-the-art papers, using the same period of information. In relation to the maximum, minimum and closing Bitcoin prices regressions, it was possible to obtain Mean Absolute Percentage Errors between 1% and 2%. Based on these results, it was possible to demonstrate the efficacy of the proposed methodology when compared to other studies.     

Intelligent stock trading system with price trend prediction and reversal recognition using dual-module neural networks

This article presents an intelligent stock trading system that can generate timely stock trading suggestions according to the prediction of short-term trends of price movement using dual-module neural networks(dual net). Retrospective technical indicators extracted from raw price and volume time series data gathered from the market are used as independent variables for neural modeling. Both neural network modules of thedual net learn the correlation between the trends of price movement and the retrospective technical indicators by use of a modified back-propagation learning algorithm. Reinforcing the temporary correlation between the neural weights and the training patterns, dual modules of neural networks are respectively trained on a short-term and a long-term moving-window of training patterns. An adaptive reversal recognition mechanism that can self-tune thresholds for identification of the timing for buying or selling stocks has also been developed in our system. It is shown that the proposeddual net architecture generalizes better than one single-module neural network. According to the features of acceptable rate of returns and consistent quality of trading suggestions shown in the performance evaluation, an intelligent stock trading system with price trend prediction and reversal recognition can be realized using the proposed dual-module neural networks.     

Efficiency of Crude Oil Futures Markets: New Evidence from Multifractal Detrending Moving Average Analysis

In this paper, we examine the weak-form efficient market hypothesis of crude oil futures markets by testing for the random walk behavior of prices. Using a method borrowed from statistical physics, we find that crude oil price display weak persistent behavior for time scales smaller than a year. For time scales larger than a year, strong mean-reversion behaviors can be found. That is, crude oil futures markets are not efficient in the short-term or in the long-term. By quantifying the market inefficiency using a “multifractality degree”, we find that the futures markets are more inefficient in the long-term than in the short-term. Furthermore, we investigate the “stylized fact” of volatility dynamics on market efficiency. The simulating and empirical results indicate that volatility clustering, volatility memory and extreme volatility have adverse effects on market efficiency, especially in the long-term.     

Forecasting stock market short-term trends using a neuro-fuzzy based methodology

A neuro-fuzzy system composed of an Adaptive Neuro Fuzzy Inference System (ANFIS) controller used to control the stock market process model, also identified using an adaptive neuro-fuzzy technique, is derived and evaluated for a variety of stocks. Obtained results challenge the weak form of the Efficient Market Hypothesis (EMH) by demonstrating much improved and better predictions, compared to other approaches, of short-term stock market trends, and in particular the next day’s trend of chosen stocks. The ANFIS controller and the stock market process model inputs are chosen based on a comparative study of fifteen different combinations of past stock prices performed to determine the stock market process model inputs that return the best stock trend prediction for the next day in terms of the minimum Root Mean Square Error (RMSE). Gaussian-2 shaped membership functions are chosen over bell shaped Gaussian and triangular ones to fuzzify the system inputs due to the lowest RMSE. Real case studies using data from emerging and well developed stock markets – the Athens and the New York Stock Exchange (NYSE) – to train and evaluate the proposed system illustrate that compared to the “buy and hold” strategy and several other reported methods, the proposed approach and the forecasting trade accuracy are by far superior.     

Modes decomposition method in fusion with robust random vector functional link network for crude oil price forecasting

This paper proposes a decomposition based method in fusion with the non-iterative approach for crude oil price forecasting. In this approach, the robust random vector functional link network (RVFLN), a non-iterative approach in fusion with the most efficient decomposition technique called variational mode decomposition (VMD) is proposed which is executed with two links — fixed assigned random weights and direct link from input to output, and the iterative learning process is not involved in its functioning which makes it faster in execution as compared to many existing techniques proposed for forecasting. The fusion of VMD and robust RVFLN called VMD-RVFLN is implemented for crude oil price forecasting where the crude oil price series is decomposed using VMD into a linear smoother series by extracting useful information and the decomposed modes pass through the robust RVFLN model which produces the final forecasting values. The analysis performed in the study approves its efficiency and reports improvement in forecasting accuracy and execution time as compared to some of the traditional iterative techniques like BPNN (back propagation neural network), ARIMA (auto-regressive integrated moving average), LSSVR (least squares support vector regression), ANFIS (adaptive neuro-fuzzy inference system), IT2FNN (interval type-2 fuzzy neural network) and RNN (recurrent neural network), etc. However, both ELM and RVFLN without modes decomposition fusion exhibit less execution time at the cost of reduction in prediction accuracy.     

基于改进CAPSO的原油管道调合多性质优化方法

在仔细研究原油管道调合工艺基础上,提出一种基于改进有约束自适应粒子群优化(CAPSO)算法的原油管道调合多性质优化方法;首先,基于原油调合规则库、优化预处理及设备实际工作能力约束,建立了多原油多性质优化模型;然后,根据原油调合目标,通过CAPSO算法对优化模型进行快速、准确的优化计算,获得多种组分原油的最优配比;投运效果表明,系统能够自动、高效计算出原油调合的最优配比,避免人工计算所造成的一致性差,计算效率低并且不易获得最佳配比的问题,有效提高了加工设备的生产效率。     

A comparative study of artificial neural networks,and decision trees for digital game content stocks price prediction

Precise prediction of stock prices is difficult chiefly because of the many intervening factors. Unpredictability is particularly notable in the aftermath of the global financial crisis. Data mining may however be used to discover highly correlated estimation models. This study looks at artificial neural networks (ANN), decision trees and the hybrid model of ANN and decision trees (hybrid model), the three common algorithm methods used for numerical analysis, to forecast stock prices. The author compared the stock price forecasting models derived from the three methods, and applied the models on 10 different stocks in 320 data sets in an empirical forecast. Average accuracy of ANN is 15.31%, the highest, in terms of match with real market stock prices, followed by decision trees, at 14.06%; hybrid model is 13.75%. The study also discovers that compared to the other two methods, ANN is a more stable method for predicting stock prices in the volatile post-crisis stock market.     

A flexible neural network-fuzzy mathematical programming algorithm for improvement of oil price estimation and forecasting

This paper presents a flexible algorithm based on artificial neural network (ANN) and fuzzy regression (FR) to cope with optimum long-term oil price forecasting in noisy, uncertain, and complex environments. The oil supply, crude oil distillation capacity, oil consumption of non-OECD, USA refinery capacity, and surplus capacity are incorporated as the economic indicators. Analysis of variance (ANOVA) and Duncan’s multiple range test (DMRT) are then applied to test the significance of the forecasts obtained from ANN and FR models. It is concluded that the selected ANN models considerably outperform the FR models in terms of mean absolute percentage error (MAPE). Moreover, Spearman correlation test is applied for verification and validation of the results. The proposed flexible ANN–FR algorithm may be easily modified to be applied to other complex, non-linear and uncertain datasets.     

Improved estimation of electricity demand function by using of artificial neural network,principal component analysis and data envelopment analysis

Due to various seasonal and monthly changes in electricity consumption and difficulties in modeling it with the conventional methods, a novel algorithm is proposed in this paper. This study presents an approach that uses Artificial Neural Network (ANN), Principal Component Analysis (PCA), Data Envelopment Analysis (DEA) and ANOVA methods to estimate and predict electricity demand for seasonal and monthly changes in electricity consumption. Pre-processing and post-processing techniques in the data mining field are used in the present study. We analyze the impact of the data pre-processing and post-processing on the ANN performance and a 680 ANN-MLP is constructed for this purpose. DEA is used to compare the constructed ANN models as well as ANN learning algorithm performance. The average, minimum, maximum and standard deviation of mean absolute percentage error (MAPE) of each constructed ANN are used as the DEA inputs. The DEA helps the user to use an appropriate ANN model as an acceptable forecasting tool. In the other words, various error calculation methods are used to find a robust ANN learning algorithm. Moreover, PCA is used as an input selection method, and a preferred time series model is chosen from the linear (ARIMA) and nonlinear models. After selecting the preferred ARIMA model, the Mcleod–Li test is applied to determine the nonlinearity condition. Once the nonlinearity condition is satisfied, the preferred nonlinear model is selected and compared with the preferred ARIMA model, and the best time series model is selected. Then, a new algorithm is developed for the time series estimation; in each case an ANN or conventional time series model is selected for the estimation and prediction. To show the applicability and superiority of the proposed ANN-PCA-DEA-ANOVA algorithm, the data regarding the Iranian electricity consumption from April 1992 to February 2004 are used. The results show that the proposed algorithm provides an accurate solution for the problem of estimating electricity consumption.