Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange

Prediction of stock price index movement is regarded as a challenging task of financial time series prediction. An accurate prediction of stock price movement may yield profits for investors. Due to the complexity of stock market data, development of efficient models for predicting is very difficult. This study attempted to develop two efficient models and compared their performances in predicting the direction of movement in the daily Istanbul Stock Exchange (ISE) National 100 Index. The models are based on two classification techniques, artificial neural networks (ANN) and support vector machines (SVM). Ten technical indicators were selected as inputs of the proposed models. Two comprehensive parameter setting experiments for both models were performed to improve their prediction performances. Experimental results showed that average performance of ANN model (75.74%) was found significantly better than that of SVM model (71.52%).     

基于多信息源的股价趋势预测

股票价格及趋势预测是金融智能研究的热门话题。一直以来,各种各样的信息源被不断尝试用于股价预测,例如基本经济特征、技术指标、网络舆情、财务公告、财政新闻、金融研报等。然而,此类研究大多数只使用一种或两种信息源,使用3种及以上信息源的极为少见。信息源越多意味着能够提供更加丰富的信息内容和更多不同的信息层面。但是由于各种信源的本质不同,其对股票市场的影响程度不同,因此将多种信源融合起来进行股价预测并 非易事。此外,多信源也增加了维度灾难的风险。基于信息融合的目的,尝试同时利用基本经济特征、技术指标、网络舆情3种信息源来进行股价预测。具体做法:先对不同类型的信息源数据进行针对性的处理,使其形成统一的数据集,然后使用SVM分类器建立预测模型。实验结果表明,在选用线性核函数和考虑非交易日数据时,使用这3种信源组合的预测模型的预测效果要比使用单一信源或者两两组合的预测效果好。此外,在收集数据时发现,在非交易日(例如周末或停牌期)虽没有买卖但网络舆情剧增。因此,在实验数据中添加了非交易日的舆情情感数据,分类精准度有所提高。研究结果表明,基于多信源融合的股价预测虽然困难,但是在适当地选择特征和针对性地进行数据预处理后会有较好的预测效果。     

A Bayesian regularized artificial neural network for stock market forecasting

In this paper a Bayesian regularized artificial neural network is proposed as a novel method to forecast financial market behavior. Daily market prices and financial technical indicators are utilized as inputs to predict the one day future closing price of individual stocks. The prediction of stock price movement is generally considered to be a challenging and important task for financial time series analysis. The accurate prediction of stock price movements could play an important role in helping investors improve stock returns. The complexity in predicting these trends lies in the inherent noise and volatility in daily stock price movement. The Bayesian regularized network assigns a probabilistic nature to the network weights, allowing the network to automatically and optimally penalize excessively complex models. The proposed technique reduces the potential for overfitting and overtraining, improving the prediction quality and generalization of the network. Experiments were performed with Microsoft Corp. and Goldman Sachs Group Inc. stock to determine the effectiveness of the model. The results indicate that the proposed model performs as well as the more advanced models without the need for preprocessing of data, seasonality testing, or cycle analysis.     

Integrating metaheuristics and Artificial Neural Networks for improved stock price prediction

Stock market price is one of the most important indicators of a country's economic growth. That's why determining the exact movements of stock market price is considerably regarded. However, complex and uncertain behaviors of stock market make exact determination impossible and hence strong forecasting models are deeply desirable for investors' financial decision making process. This study aims at evaluating the effectiveness of using technical indicators, such as simple moving average of close price, momentum close price, etc. in Turkish stock market. To capture the relationship between the technical indicators and the stock market for the period under investigation, hybrid Artificial Neural Network (ANN) models, which consist in exploiting capabilities of Harmony Search (HS) and Genetic Algorithm (GA), are used for selecting the most relevant technical indicators. In addition, this study simultaneously searches the most appropriate number of hidden neurons in hidden layer and in this respect; proposed models mitigate well-known problem of overfitting/underfitting of ANN. The comparison for each proposed model is done in four viewpoints: loss functions, return from investment analysis, buy and hold analysis, and graphical analysis. According to the statistical and financial performance of these models, HS based ANN model is found as a dominant model for stock market forecasting.     

A bat-neural network multi-agent system (BNNMAS) for stock price prediction: Case study of DAX stock price

Creating an intelligent system that can accurately predict stock price in a robust way has always been a subject of great interest for many investors and financial analysts. Predicting future trends of financial markets is more remarkable these days especially after the recent global financial crisis. So traders who access to a powerful engine for extracting helpful information throw raw data can meet the success. In this paper we propose a new intelligent model in a multi-agent framework called bat-neural network multi-agent system (BNNMAS) to predict stock price. The model performs in a four layer multi-agent framework to predict eight years of DAX stock price in quarterly periods. The capability of BNNMAS is evaluated by applying both on fundamental and technical DAX stock price data and comparing the outcomes with the results of other methods such as genetic algorithm neural network (GANN) and some standard models like generalized regression neural network (GRNN), etc. The model tested for predicting DAX stock price a period of time that global financial crisis was faced to economics. The results show that BNNMAS significantly performs accurate and reliable, so it can be considered as a suitable tool for predicting stock price specially in a long term periods.     

A hybrid model based on rough sets theory and genetic algorithms for stock price forecasting

In the stock market, technical analysis is a useful method for predicting stock prices. Although, professional stock analysts and fund managers usually make subjective judgments, based on objective technical indicators, it is difficult for non-professionals to apply this forecasting technique because there are too many complex technical indicators to be considered. Moreover, two drawbacks have been found in many of the past forecasting models: (1) statistical assumptions about variables are required for time series models, such as the autoregressive moving average model (ARMA) and the autoregressive conditional heteroscedasticity (ARCH), to produce forecasting models of mathematical equations, and these are not easily understood by stock investors; and (2) the rules mined from some artificial intelligence (AI) algorithms, such as neural networks (NN), are not easily realized.In order to overcome these drawbacks, this paper proposes a hybrid forecasting model, using multi-technical indicators to predict stock price trends. Further, it includes four proposed procedures in the hybrid model to provide efficient rules for forecasting, which are evolved from the extracted rules with high support value, by using the toolset based on rough sets theory (RST): (1) select the essential technical indicators, which are highly related to the future stock price, from the popular indicators based on a correlation matrix; (2) use the cumulative probability distribution approach (CDPA) and minimize the entropy principle approach (MEPA) to partition technical indicator value and daily price fluctuation into linguistic values, based on the characteristics of the data distribution; (3) employ a RST algorithm to extract linguistic rules from the linguistic technical indicator dataset; and (4) utilize genetic algorithms (GAs) to refine the extracted rules to get better forecasting accuracy and stock return. The effectiveness of the proposed model is verified with two types of performance evaluations, accuracy and stock return, and by using a six-year period of the TAIEX (Taiwan Stock Exchange Capitalization Weighted Stock Index) as the experiment dataset. The experimental results show that the proposed model is superior to the two listed forecasting models (RST and GAs) in terms of accuracy, and the stock return evaluations have revealed that the profits produced by the proposed model are higher than the three listed models (Buy-and-Hold, RST and GAs).     

Applying Artificial Neural Networks to prediction of stock price and improvement of the directional prediction index – Case study of PETR4, Petrobras,Brazil

Predicting the direction of stock price changes is an important factor, as it contributes to the development of effective strategies for stock exchange transactions and attracts much interest in incorporating variables historical series into the mathematical models or computer algorithms in order to produce estimations of expected price fluctuations. The purpose of this study is to build a neural model for the financial market, allowing predictions of stocks closing prices future behavior negotiated in BM&FBOVESPA in the short term, using the economic and financial theory, combining technical analysis, fundamental analysis and analysis of time series, to predict price behavior, addressing the percentage of correct predictions of price series direction (POCID or Prediction of Change in Direction). The aim of this work is to understand the information available in the financial market and identify the variables that drive stock prices. The methodology presented may be adapted to other companies and their stock. Petrobras stock PETR4, traded in BM&FBOVESPA, was used as a case study. As part of this effort, configurations with different window sizes were designed, and the best performance was achieved with a window size of 3, which the POCID index of correct direction predictions was 93.62% for the test set and 87.50% for a validation set.     

A hybrid procedure with feature selection for resolving stock/futures price forecasting problems

Stock/futures price forecasting is an important financial topic for individual investors, stock fund managers, and financial analysts and is currently receiving considerable attention from both researchers and practitioners. However, the inherent characteristics of stock/futures prices, namely, high volatility, complexity, and turbulence, make forecasting a challenging endeavor. In the past, various approaches have been proposed to deal with the problems of stock/futures price forecasting that are difficult to resolve by using only a single soft computing technique. In this study, a hybrid procedure based on a backpropagation (BP) neural network, a feature selection technique, and genetic programming (GP) is proposed to tackle stock/futures price forecasting problems with the use of technical indicators. The feasibility and effectiveness of this procedure are evaluated through a case study on forecasting the closing prices of Taiwan Stock Exchange Capitalization Weighted Stock Index (TAIEX) futures of the spot month. Experimental results show that the proposed forecasting procedure is a feasible and effective tool for improving the performance of stock/futures price forecasting. Furthermore, the most important technical indicators can be determined by applying a feature selection method based on the proposed simulation technique, or solely on the preliminary GP forecast model.     

An integrated framework of genetic network programming and multi-layer perceptron neural network for prediction of daily stock return: An application in Tehran stock exchange market

Evolutionary algorithms are generally used to find or generate the best individuals in a population. Whenever these algorithms are applied to agent systems, they will lead to optimal solutions. Genetic Network Programming (GNP), which contains graph networks, is one of the developed evolutionary algorithms. When the aim is to forecast the share price or return, ascending and descending trends, volatilities, recent returns, fundamental and technical factors have remarkable impacts on the prediction. This is why technical indicators are used to constitute a set of trading rules. In this paper, we apply an integrated framework consisting of GNP model along with a reinforcement learning and Multi-Layer Perceptron (MLP) neural network to classify data and also time series models to forecast the stock return. Moreover, we utilize rules of accumulation based on the GNP model’s results to forecast the return. The aim of using these models alongside one another is to estimate one-day return. The results derived from 9 stocks with regard to the Tehran Stock Exchange Market. GNP extracts a prodigious number of rules on the basis of 5 technical indicators with 3 times period. Next, MLP network classifies data and finds the similarity between future data and past data concerning a stock (5 sub-period) through classification. Subsequently, a number of conditions are established, in order to choose the best estimation between GNP-RL and ARMA. Distinct comparison with the ARMA–GARCH model, which is operated for return estimation and risk measurement in many researches, demonstrates an extended forecasting power of the proposed model, by the name of GNP–ARMA, reducing error by a mean of 16%.     

A hybrid procedure for stock price prediction by integrating self-organizing map and genetic programming

Stock price prediction is a very important financial topic, and is considered a challenging task and worthy of the considerable attention received from both researchers and practitioners. Stock price series have properties of high volatility, complexity, dynamics and turbulence, thus the implicit relationship between the stock price and predictors is quite dynamic. Hence, it is difficult to tackle the stock price prediction problems effectively by using only single soft computing technique. This study hybridizes a self-organizing map (SOM) neural network and genetic programming (GP) to develop an integrated procedure, namely, the SOM-GP procedure, in order to resolve problems inherent in stock price predictions. The SOM neural network is utilized to divide the sample data into several clusters, in such a manner that the objects within each cluster possess similar properties to each other, but differ from the objects in other clusters. The GP technique is applied to construct a mathematical prediction model that describes the functional relationship between technical indicators and the closing price of each cluster formed in the SOM neural network. The feasibility and effectiveness of the proposed hybrid SOM-GP prediction procedure are demonstrated through experiments aimed at predicting the finance and insurance sub-index of TAIEX (Taiwan stock exchange capitalization weighted stock index). Experimental results show that the proposed SOM-GP prediction procedure can be considered a feasible and effective tool for stock price predictions, as based on the overall prediction performance indices. Furthermore, it is found that the frequent and alternating rise and fall, as well as the range of daily closing prices during the period, significantly increase the difficulties of predicting.     

A two-stage architecture for stock price forecasting by integrating self-organizing map and support vector regression

Stock price prediction has attracted much attention from both practitioners and researchers. However, most studies in this area ignored the non-stationary nature of stock price series. That is, stock price series do not exhibit identical statistical properties at each point of time. As a result, the relationships between stock price series and their predictors are quite dynamic. It is challenging for any single artificial technique to effectively address this problematic characteristics in stock price series. One potential solution is to hybridize different artificial techniques. Towards this end, this study employs a two-stage architecture for better stock price prediction. Specifically, the self-organizing map (SOM) is first used to decompose the whole input space into regions where data points with similar statistical distributions are grouped together, so as to contain and capture the non-stationary property of financial series. After decomposing heterogeneous data points into several homogenous regions, support vector regression (SVR) is applied to forecast financial indices. The proposed technique is empirically tested using stock price series from seven major financial markets. The results show that the performance of stock price prediction can be significantly enhanced by using the two-stage architecture in comparison with a single SVR model.     

Support vector regression with chaos-based firefly algorithm for stock market price forecasting

Due to the inherent non-linearity and non-stationary characteristics of financial stock market price time series, conventional modeling techniques such as the Box–Jenkins autoregressive integrated moving average (ARIMA) are not adequate for stock market price forecasting. In this paper, a forecasting model based on chaotic mapping, firefly algorithm, and support vector regression (SVR) is proposed to predict stock market price. The forecasting model has three stages. In the first stage, a delay coordinate embedding method is used to reconstruct unseen phase space dynamics. In the second stage, a chaotic firefly algorithm is employed to optimize SVR hyperparameters. Finally in the third stage, the optimized SVR is used to forecast stock market price. The significance of the proposed algorithm is 3-fold. First, it integrates both chaos theory and the firefly algorithm to optimize SVR hyperparameters, whereas previous studies employ a genetic algorithm (GA) to optimize these parameters. Second, it uses a delay coordinate embedding method to reconstruct phase space dynamics. Third, it has high prediction accuracy due to its implementation of structural risk minimization (SRM). To show the applicability and superiority of the proposed algorithm, we selected the three most challenging stock market time series data from NASDAQ historical quotes, namely Intel, National Bank shares and Microsoft daily closed (last) stock price, and applied the proposed algorithm to these data. Compared with genetic algorithm-based SVR (SVR-GA), chaotic genetic algorithm-based SVR (SVR-CGA), firefly-based SVR (SVR-FA), artificial neural networks (ANNs) and adaptive neuro-fuzzy inference systems (ANFIS), the proposed model performs best based on two error measures, namely mean squared error (MSE) and mean absolute percent error (MAPE).     

Incorporating feature selection method into support vector regression for stock index forecasting

Stock index forecasting is one of the most difficult tasks that financial organizations, firms and private investors have to face. Support vector regression (SVR) has become a popular alternative in stock index forecasting tasks due to its generalization capability in obtaining a unique solution. However, the major limitation of SVR is that it cannot capture the relative importance of independent variables to the dependent variable when many potential independent variables are considered. This study incorporates feature selection method and SVR for building stock index forecasting model. The proposed model uses multivariate adaptive regression splines (MARS), an effective nonlinear and nonparametric regression methodology, to identify important forecasting variables. The obtained significant predictor variables are then served as the inputs for the SVR model. Experimental results reveal that the obtained important variables from MARS can improve the forecasting performance of the SVR models. Moreover, the MARS results provide useful information about the relationship between the selected predictor variables and stock index through the obtained basis functions, important predictor variables and the MARS prediction function. Hence, the proposed stock index forecasting model can generate good forecasting performance and exhibits the capability of identifying significant predictor variables, which provide valuable information for further investment decisions/strategies.     

一种改进的组合SOFM-SVR股票价格预测模型

股票市场价格预测一直以来都被认为是金融时序预测领域的一项具有挑战性的工作。综合回归支持向量机SVR和自组织特征函数(SOFM)技术,并引入基于过滤的特征选择算法确定重要的输入变量,在SVR核函数的参数选择上采用粒子群优化算法(PSO)。SOFM算法将训练样本聚类,然后分别应用SVR来预测股票价格走势。最后应用上海A股的浦发银行日数据来做股票价格日预测,实验结果表明,经过改进的SOFM-SVR模型与之前的SOFM-SVR模型相比,在预测精度和训练时间上都有了较大的提高。     

基于MFR-GEP的高阶常微分方程预测模型

股价预测一直是金融投资领域的热点问题，但是股票市场相关指标数据的波动性和不确定性使得股价预测问题成为难点。因此对于非线性且受到多因素影响的股票系统，传统的预测方法无法准确地表达股价的变化规律，预测效果较差。针对复杂的股价预测问题，建立了基于多指标正则化GEP算法（Multiple Factor Regularization Gene Expression Programming，MFR-GEP）的高阶常微分方程模型，利用数值差分拟合股价数据，并且加入影响股价的其他指标作为正则项，其中利用指标相关性确定正则项权重参数，应用模糊粗糙集的原理确定子函数映射。该模型能够刻画股价随时间的变化趋势，更好地描述数据波动，正则项的加入使得模型可以根据多指标进行预测，避免因单一指标引起的预测精度低等问题。最后将提出的算法与标准GEP算法及传统预测算法进行对比实验，结果充分验证了该算法的有效性和准确性。     

基于模糊近似支持向量回归的股价预测研究

股价预测是投资策略形成和风险管理模型发展的基础。为了降低股价变化趋势中的噪声信息和投资者关于两种股价预测误差的不同偏好对股价预测的影响,提出了基于信噪比的模糊近似支持向量回归(FPSVR)的股价预测模型。首先构建信噪比输入变量,然后引入模糊隶属度和双边权重测量方法对支持向量回归(SVR)模型进行改进,最后借助沪深300成份股2008至2019年的股票时间序列日数据,按照股市的波动情况将其分为三个阶段(牛市、熊市、震荡市),并建立三个基准模型进行对比分析。研究结果表明:与三个基准模型相比,所提出的股价预测模型的预测误差最低;与原有的SVR模型相比,FPSVR模型可以更好地对处于牛市和震荡市阶段的股票时间序列进行股价预测。     

A hybrid ANFIS based on n-period moving average model to forecast TAIEX stock

Linear model is a general forecasting model and moving average technical index (MATI) is one of useful forecasting methods to predict the future stock prices in stock markets. Therefore, individual investors, stock fund managers, and financial analysts attempt to predict price fluctuation in stock markets by either linear model or MATI. From literatures, three major drawbacks are found in many existing forecasting models. First, forecasting rules mined from some AI algorithms, such as neural networks, could be very difficult to understand. Second, statistic assumptions about variables are required for time series to generate forecasting models, which are not easily understandable by stock investors. Third, stock market investors usually make short-term decisions based on recent price fluctuations, i.e., the last one or two periods, but most time series models use only the last period of stock price. In order to overcome these drawbacks, this study proposes a hybrid forecasting model using linear model and MATI to predict stock price trends with the following four steps: (1) test the lag period of Taiwan Stock Exchange Capitalization Weighted Stock Index (TAIEX) and calculate the last n-period moving average; (2) use subtractive clustering to partition technical indicator values into linguistic values based on data discretization method objectively; (3) employ fuzzy inference system (FIS) to build linguistic rules from the linguistic technical indicator dataset, and optimize the FIS parameters by adaptive network; and (4) refine the proposed model by adaptive expectation models. The proposed model is then verified by root mean squared error (RMSE), and a ten-year period of TAIEX is selected as experiment datasets. The results show that the proposed model is superior to the other forecasting models, namely Chen's model and Yu's model in terms of RMSE.     

MTICA-AEO-SVR股票价格预测模型

为了改善传统Fast ICA算法的稳定性和分离效率,基于Tukey M估计构造了一种新的非线性函数,提出了MTICA算法;并在此基础上结合SVR算法,建立了一种新的MTICA-AEO-SVR股票价格预测模型。用MTICA算法将原始股票数据分解为独立分量进行排序去噪,选择不同的SVR模型分别对各独立分量和股票价格进行预测。在SVR算法中引入了人工生态系统优化算法（AEO）选参,提高了模型的预测精度。通过对上证B股指数的实证分析,结果表明,MTICA-AEO-SVR模型比ICA-AEO-SVR模型和ICA-SVR模型更准确和高效。     

Generative adversarial network (GAN) and enhanced root mean square error (ERMSE): deep learning for stock price movement prediction

The prediction of stock price movement direction is significant in financial circles and academic. Stock price contains complex, incomplete, and fuzzy information which makes it an extremely difficult task to predict its development trend. Predicting and analysing financial data is a nonlinear, time-dependent problem. With rapid development in machine learning and deep learning, this task can be performed more effectively by a purposely designed network. This paper aims to improve prediction accuracy and minimizing forecasting error loss through deep learning architecture by using Generative Adversarial Networks. It was proposed a generic model consisting of Phase-space Reconstruction (PSR) method for reconstructing price series and Generative Adversarial Network (GAN) which is a combination of two neural networks which are Long Short-Term Memory (LSTM) as Generative model and Convolutional Neural Network (CNN) as Discriminative model for adversarial training to forecast the stock market. LSTM will generate new instances based on historical basic indicators information and then CNN will estimate whether the data is predicted by LSTM or is real. It was found that the Generative Adversarial Network (GAN) has performed well on the enhanced root mean square error to LSTM, as it was 4.35% more accurate in predicting the direction and reduced processing time and RMSE by 78 s and 0.029, respectively. This study provides a better result in the accuracy of the stock index. It seems that the proposed system concentrates on minimizing the root mean square error and processing time and improving the direction prediction accuracy, and provides a better result in the accuracy of the stock index.

     

大数据分析的应用案例——投资模型的稳健性

交易模型的稳健性,指的是该模型的利润率曲线的波动性较小,没有大起大落。针对一个基于支持向量回归（SVR）技术的算法交易模型的稳健性问题,提出了使用若干导出指标训练统一的交易模型的策略,以及投资组合多样化的方法。首先,介绍基于支持向量回归技术的算法交易模型;然后,基于常用指标,构造了若干导出指标,用于股票价格的短期预测。这些指标,刻画了近期价格运动的典型模式、超买/超卖市场状态,以及背离市场状态。对这些指标进行了规范化,用于训练交易模型,使得模型可以泛化到不同的股票;最后,设计了投资组合多样化方法。在投资组合里,各个股票之间的相关性,有时会导致较大的投资损失;因为具有较强相关关系的股票,其价格朝相同方向变化。如果交易模型预测的价格走势不正确,引起止损操作,那么这些具有较强相关关系的股票,将引发雪崩式的止损,于是导致损失加剧。把股票根据相似性聚类到不同类别,通过从不同聚类类别中选择若干股票来构成多样化的投资组合,其中,股票的相似性,通过交易模型在不同股票上近期的利润曲线的相似度进行计算。在900只股票10年的价格大数据上进行了实验,实验结果显示,交易模型能够获得超过定期存款的超额利润率,年化利润率为8.06%。交易模型的最大回撤由13.23%降为5.32%,夏普指数由81.23%提高到88.79%,交易模型的利润率曲线波动性降低,说明交易模型的稳健性获得了提高。