Predicting corporate financial distress based on integration of decision tree classification and logistic regression

Lately, stock and derivative securities markets continuously and rapidly evolve in the world. As quick market developments, enterprise operating status will be disclosed periodically on financial statement. Unfortunately, if executives of firms intentionally dress financial statements up, it will not be observed any financial distress possibility in the short or long run. Recently, there were occurred many financial crises in the international marketing, such as Enron, Kmart, Global Crossing, WorldCom and Lehman Brothers events. How these financial events affect world’s business, especially for the financial service industry or investors has been public’s concern. To improve the accuracy of the financial distress prediction model, this paper referred to the operating rules of the Taiwan Stock Exchange Corporation (TSEC) and collected 100 listed companies as the initial samples. Moreover, the empirical experiment with a total of 37 ratios which composed of financial and other non-financial ratios and used principle component analysis (PCA) to extract suitable variables. The decision tree (DT) classification methods (C5.0, CART, and CHAID) and logistic regression (LR) techniques were used to implement the financial distress prediction model. Finally, the experiments acquired a satisfying result, which testifies for the possibility and validity of our proposed methods for the financial distress prediction of listed companies.This paper makes four critical contributions: (1) the more PCA we used, the less accuracy we obtained by the DT classification approach. However, the LR approach has no significant impact with PCA; (2) the closer we get to the actual occurrence of financial distress, the higher the accuracy we obtain in DT classification approach, with an 97.01% correct percentage for 2 seasons prior to the occurrence of financial distress; (3) our empirical results show that PCA increases the error of classifying companies that are in a financial crisis as normal companies; and (4) the DT classification approach obtains better prediction accuracy than the LR approach in short run (less one year). On the contrary, the LR approach gets better prediction accuracy in long run (above one and half year). Therefore, this paper proposes that the artificial intelligent (AI) approach could be a more suitable methodology than traditional statistics for predicting the potential financial distress of a company in short run.     

Predicting financial distress of the South Korean manufacturing industries

The financial distress forecasting has long been of great interest both to scholars and practitioners. The financial distress forecasting is basically a dichotomous decision, either being financial distress or not. Most statistical and artificial intelligence methods estimate the probability of financial distress, and if this probability is greater than the cutoff value, then the prediction is to be financial distress. To improve the accuracy of the financial distress prediction, this paper first analyzed the yearly financial data of 1888 manufacturing corporations collected by the Korea Credit Guarantee Fund (KODIT). Then we developed a financial distress prediction model based on radial basis function support vector machines (RSVM). We compare the classification accuracy performance between our RSVM and artificial intelligence techniques, and suggest a better financial distress predicting model to help a chief finance officer or a board of directors make better decision in a corporate financial distress. The experiments demonstrate that RSVM always outperforms other models in the performance of corporate financial distress predicting, and hence we can predict future financial distress more correctly than any other models. This enhancement in predictability of future financial distress can significantly contribute to the correct valuation of a company, and hence those people from investors to financial managers to any decision makers of a company can make use of RSVM for the better financing and investing decision making which can lead to higher profits and firm values eventually.     

Predicting bank financial failures using neural networks,support vector machines and multivariate statistical methods: A comparative analysis in the sample of savings deposit insurance fund (SDIF) transferred banks in Turkey

Bank failures threaten the economic system as a whole. Therefore, predicting bank financial failures is crucial to prevent and/or lessen the incoming negative effects on the economic system. This is originally a classification problem to categorize banks as healthy or non-healthy ones. This study aims to apply various neural network techniques, support vector machines and multivariate statistical methods to the bank failure prediction problem in a Turkish case, and to present a comprehensive computational comparison of the classification performances of the techniques tested. Twenty financial ratios with six feature groups including capital adequacy, asset quality, management quality, earnings, liquidity and sensitivity to market risk (CAMELS) are selected as predictor variables in the study. Four different data sets with different characteristics are developed using official financial data to improve the prediction performance. Each data set is also divided into training and validation sets. In the category of neural networks, four different architectures namely multi-layer perceptron, competitive learning, self-organizing map and learning vector quantization are employed. The multivariate statistical methods; multivariate discriminant analysis, k-means cluster analysis and logistic regression analysis are tested. Experimental results are evaluated with respect to the correct accuracy performance of techniques. Results show that multi-layer perceptron and learning vector quantization can be considered as the most successful models in predicting the financial failure of banks.     

An evolution-based approach with modularized evaluations to forecast financial distress

Due to the radical changing of the global economy, a more precise forecasting of corporate financial distress helps provide important judgment principles to decision-makers. Although financial statements reflect a firm's business activities, it is very challenging to discover critical information from these statements. Applying machine learning algorithms can be demonstrated to improve forecasting accuracy in predicting corporate bankruptcy. In this paper, we introduce an evolutionary approach with modularized evaluation functions to forecast financial distress, which allows using any evolutionary algorithm to extract the set of critical financial ratios and integrates more evaluation function modules to achieve a better forecasting accuracy by assigning distinct weights. To achieve a more precise predicting accuracy, the undesirable forecasting results from some modules are weeded out, if their predicting accuracies are out of the allowable tolerance range as learned from our mechanism.     

Prediction of corporate financial distress: an application of the America banking industry

Financial distress prediction is an important and widely researched issue because of its potential significant influence on bank lending decisions and profitability. Since the 1970s, many mathematical and statistical researchers have proposed prediction models on such issues. Given the recent vigorous growth of artificial intelligence (AI) and data mining techniques, many researchers have begun to apply those techniques to the problem of bankruptcy prediction. Among these techniques, the support vector machine (SVM) has been applied successfully and obtained good performance with other AI and statistical method comparisons. Particle swarm optimization (PSO) has been increasingly employed in conjunction with AI techniques and has provided reliable optimization capability. However, researches addressing PSO and SVM integration are scarce, although there is great potential for useful applications in this field. This paper proposes an adaptive inertia weight (AIW) method for improving PSO performance and integrates SVM in two aspects: feature subset selection and parameter optimization. The experiments collected 54 listed companies as initial samples from American bank datasets. The proposed adaptive PSO-SVM approach could be a more suitable methodology for predicting potential financial distress. This approach also proves its capability to handle scalable and non-scalable function problems.     

Using neural network ensembles for bankruptcy prediction and credit scoring

Bankruptcy prediction and credit scoring have long been regarded as critical topics and have been studied extensively in the accounting and finance literature. Artificial intelligence and machine learning techniques have been used to solve these financial decision-making problems. The multilayer perceptron (MLP) network trained by the back-propagation learning algorithm is the mostly used technique for financial decision-making problems. In addition, it is usually superior to other traditional statistical models. Recent studies suggest combining multiple classifiers (or classifier ensembles) should be better than single classifiers. However, the performance of multiple classifiers in bankruptcy prediction and credit scoring is not fully understood. In this paper, we investigate the performance of a single classifier as the baseline classifier to compare with multiple classifiers and diversified multiple classifiers by using neural networks based on three datasets. By comparing with the single classifier as the benchmark in terms of average prediction accuracy, the multiple classifiers only perform better in one of the three datasets. The diversified multiple classifiers trained by not only different classifier parameters but also different sets of training data perform worse in all datasets. However, for the Type I and Type II errors, there is no exact winner. We suggest that it is better to consider these three classifier architectures to make the optimal financial decision.     

An improved boosting based on feature selection for corporate bankruptcy prediction

With the recent financial crisis and European debt crisis, corporate bankruptcy prediction has become an increasingly important issue for financial institutions. Many statistical and intelligent methods have been proposed, however, there is no overall best method has been used in predicting corporate bankruptcy. Recent studies suggest ensemble learning methods may have potential applicability in corporate bankruptcy prediction. In this paper, a new and improved Boosting, FS-Boosting, is proposed to predict corporate bankruptcy. Through injecting feature selection strategy into Boosting, FS-Booting can get better performance as base learners in FS-Boosting could get more accuracy and diversity. For the testing and illustration purposes, two real world bankruptcy datasets were selected to demonstrate the effectiveness and feasibility of FS-Boosting. Experimental results reveal that FS-Boosting could be used as an alternative method for the corporate bankruptcy prediction.     

支持向量机应用于大气污染物浓度预测

支持向量机是基于统计学习理论的新一代机器学习技术,其非线性回归预测性能优越于传统统计方法。提出了一种大气污染物浓度预测模型,该方法将支持向量机应用于大气污染物浓度预测,首先对各类影响因子进行分析并进行建模预测;而后利用主成分分析的方法对输入因子降维,从而形成支持向量机的训练样本集;在此基础上建立了基于RBF核函数支持向量回归法的大气污染预模型。大气污染预测实例表明,该方法具有泛化能力强、预测精度高、训练速度快、稳定性好、便于建模等优点,有良好的应用前景。     

Feature selection in bankruptcy prediction

For many corporations, assessing the credit of investment targets and the possibility of bankruptcy is a vital issue before investment. Data mining and machine learning techniques have been applied to solve the bankruptcy prediction and credit scoring problems. As feature selection is an important step to select more representative data from a given dataset in data mining to improve the final prediction performance, it is unknown that which feature selection method is better. Therefore, this paper aims at comparing five well-known feature selection methods used in bankruptcy prediction, which are t-test, correlation matrix, stepwise regression, principle component analysis (PCA) and factor analysis (FA) to examine their prediction performance. Multi-layer perceptron (MLP) neural networks are used as the prediction model. Five related datasets are used in order to provide a reliable conclusion. Regarding the experimental results, the t-test feature selection method outperforms the other ones by the two performance measurements.     

Feature selection in single and ensemble learning‐based bankruptcy prediction models

Feature selection is an important data preprocessing step for the construction of an effective bankruptcy prediction model. The prediction performance can be affected by the employed feature selection and classification techniques. However, there have been very few studies of bankruptcy prediction that identify the best combination of feature selection and classification techniques. In this study, two types of feature selection methods, including filter‐ and wrapper‐based methods, are considered, and two types of classification techniques, including statistical and machine learning techniques, are employed in the development of the prediction methods. In addition, bagging and boosting ensemble classifiers are also constructed for comparison. The experimental results based on three related datasets that contain different numbers of input features show that the genetic algorithm as the wrapper‐based feature selection method performs better than the filter‐based one by information gain. It is also shown that the lowest prediction error rates for the three datasets are provided by combining the genetic algorithm with the naïve Bayes and support vector machine classifiers without bagging and boosting.     

Combining cluster analysis with classifier ensembles to predict financial distress

The ability to accurately predict business failure is a very important issue in financial decision-making. Incorrect decision-making in financial institutions is very likely to cause financial crises and distress. Bankruptcy prediction and credit scoring are two important problems facing financial decision support. As many related studies develop financial distress models by some machine learning techniques, more advanced machine learning techniques, such as classifier ensembles and hybrid classifiers, have not been fully assessed. The aim of this paper is to develop a novel hybrid financial distress model based on combining the clustering technique and classifier ensembles. In addition, single baseline classifiers, hybrid classifiers, and classifier ensembles are developed for comparisons. In particular, two clustering techniques, Self-Organizing Maps (SOMs) and k-means and three classification techniques, logistic regression, multilayer-perceptron (MLP) neural network, and decision trees, are used to develop these four different types of bankruptcy prediction models. As a result, 21 different models are compared in terms of average prediction accuracy and Type I & II errors. By using five related datasets, combining Self-Organizing Maps (SOMs) with MLP classifier ensembles performs the best, which provides higher predication accuracy and lower Type I & II errors.     

面向高维混合不平衡信贷数据的单类分类方法

为实现对高维混合、不平衡信贷数据中的不良贷款者的准确预测,从降维预处理和分类算法两方面进行优化,提出一种基于混合数据主成分分析（Principal Component Analysis of Mixed Data,PCAmix）预处理的单类[K]近邻[（K]-Nearest Neighbor,[KNN）]计算均值算法。针对传统的主成分分析（Principal Component Analysis,PCA）不能直接处理定性变量的问题,使用PCAmix降维预处理数据,为规避不平衡数据在二分类模型中性能较差的缺点,采用单类分类和[K]近邻算法邻居计算的思想,仅采用多数类训练模型。利用Bootstrap方法找到最佳的决策边界,使得正负样本最大限度地分离,最终准确预测客户的违约风险。采用UCI数据库中的German和Default个人信用评分数据集进行验证,实验结果表明该算法在处理高维混合、不平衡的信贷数据上具有较好的分类效果。     

Ensemble boosted trees with synthetic features generation in application to bankruptcy prediction

Bankruptcy prediction has been a subject of interests for almost a century and it still ranks high among hottest topics in economics. The aim of predicting financial distress is to develop a predictive model that combines various econometric measures and allows to foresee a financial condition of a firm. In this domain various methods were proposed that were based on statistical hypothesis testing, statistical modeling (e.g., generalized linear models), and recently artificial intelligence (e.g., neural networks, Support Vector Machines, decision tress). In this paper, we propose a novel approach for bankruptcy prediction that utilizes Extreme Gradient Boosting for learning an ensemble of decision trees. Additionally, in order to reflect higher-order statistics in data and impose a prior knowledge about data representation, we introduce a new concept that we refer as to synthetic features. A synthetic feature is a combination of the econometric measures using arithmetic operations (addition, subtraction, multiplication, division). Each synthetic feature can be seen as a single regression model that is developed in an evolutionary manner. We evaluate our solution using the collected data about Polish companies in five tasks corresponding to the bankruptcy prediction in the 1st, 2nd, 3rd, 4th, and 5th year. We compare our approach with the reference methods.     

A hybrid financial analysis model for business failure prediction

Accounting frauds have continuously happened all over the world. This leads to the need of predicting business failures. Statistical methods and machine learning techniques have been widely used to deal with this issue. In general, financial ratios are one of the main inputs to develop the prediction models. This paper presents a hybrid financial analysis model including static and trend analysis models to construct and train a back-propagation neural network (BPN) model. Further, the experiments employ four datasets of Taiwan enterprises which support that the proposed model not only provides a high predication rate but also outperforms other models including discriminant analysis, decision trees, and the back-propagation neural network alone.     

Genetic programming for the prediction of insolvency in non-life insurance companies

Prediction of non-life insurance companies insolvency has arised as an important problem in the field of financial research, due to the necessity of protecting the general public whilst minimizing the costs associated to this problem, such as the effects on state insurance guaranty funds or the responsibilities for management and auditors. Most methods applied in the past to predict business failure in non-life insurance companies are traditional statistical techniques, which use financial ratios as explicative variables. However, these variables do not usually satisfy statistical assumptions, what complicates the application of the mentioned methods. Emergent statistical learning methods like neural networks or SVMs provide a successful approach in terms of error rate, but their character of black-box methods make the obtained results difficult to be interpreted and discussed. In this paper, we propose an approach to predict insolvency of non-life insurance companies based on the application of genetic programming (GP). GP is a class of evolutionary algorithms, which operates by codifying the solution of the problem as a population of LISP trees. This type of algorithm provides a diagnosis output in the form of a decision tree with given functions and data. We can treat it like a computer program which returns an answer depending on the input, and, more importantly, the tree can potentially be inspected, interpreted and re-used for different data sets. We have compared the performance of GP with other classifiers approaches, a Support Vector Machine and a Rough Set algorithm. The final purpose is to create an automatic diagnostic system for analysing non-insurance firms using their financial ratios as explicative variables.     

Domain-independent feature extraction for multi-classification using multi-objective genetic programming

We propose three model-free feature extraction approaches for solving the multiple class classification problem; we use multi-objective genetic programming (MOGP) to derive (near-)optimal feature extraction stages as a precursor to classification with a simple and fast-to-train classifier. Statistically-founded comparisons are made between our three proposed approaches and seven conventional classifiers over seven datasets from the UCI Machine Learning database. We also make comparisons with other reported evolutionary computation techniques. On almost all the benchmark datasets, the MOGP approaches give better or identical performance to the best of the conventional methods. Of our proposed MOGP-based algorithms, we conclude that hierarchical feature extraction performs best on multi-classification problems.     

Forecasting financial condition of Chinese listed companies based on support vector machine

Due to the radical changing and specialty of Chinese capital market, it is challenging to develop a powerful financial distress prediction model. In this paper, we first analyzed the feasibility of Chinese special-treated companies as distressed sample by using statistical methods. Then we developed a prediction model based on support vector machines (SVM) for an unmatched sample of Chinese high-tech manufacture companies. The grid-search technique using 10-fold cross-validation is used to find out the best parameter value of kernel function of SVM. The experiment results show that the proposed SVM model outperforms conventional statistical methods and back-propagation neural network. In general, SVM provides a robust model with high prediction accuracy for forecasting financial distress of Chinese listed companies. It is also suggested that Chinese special-treated event adopted as cut-off line has some effect on the prediction accuracy of the models.     

Efficiently processing deterministic approximate aggregation query on massive data

Financial distress prediction is very important to financial institutions who must be able to make critical decisions regarding customer loans. Bankruptcy prediction and credit scoring are the two main aspects considered in financial distress prediction. To assist in this determination, thereby lowering the risk borne by the financial institution, it is necessary to develop effective prediction models for prediction of the likelihood of bankruptcy and estimation of credit risk. A number of financial distress prediction models have been constructed, which utilize various machine learning techniques, such as single classifiers and classifier ensembles, but improving the prediction accuracy is the major research issue. In addition, aside from improving the prediction accuracy, there have been very few studies that specifically consider lowering the Type I error. In practice, Type I errors need to receive careful consideration during model construction because they can affect the cost to the financial institution. In this study, we introduce a classifier ensemble approach designed to reduce the misclassification cost. The outputs produced by multiple classifiers are combined by utilizing the unanimous voting (UV) method to find the final prediction result. Experimental results obtained based on four relevant datasets show that our UV ensemble approach outperforms the baseline single classifiers and classifier ensembles. Specifically, the UV ensemble not only provides relatively good prediction accuracy and minimizes Type I/II errors, but also produces the smallest misclassification cost.     

A survey on feature selection methods

Plenty of feature selection methods are available in literature due to the availability of data with hundreds of variables leading to data with very high dimension. Feature selection methods provides us a way of reducing computation time, improving prediction performance, and a better understanding of the data in machine learning or pattern recognition applications. In this paper we provide an overview of some of the methods present in literature. The objective is to provide a generic introduction to variable elimination which can be applied to a wide array of machine learning problems. We focus on Filter, Wrapper and Embedded methods. We also apply some of the feature selection techniques on standard datasets to demonstrate the applicability of feature selection techniques.     

A new perspective of performance comparison among machine learning algorithms for financial distress prediction

We set out in this study to review a vast amount of recent literature on machine learning (ML) approaches to predicting financial distress (FD), including supervised, unsupervised and hybrid supervised–unsupervised learning algorithms. Four supervised ML models including the traditional support vector machine (SVM), recently developed hybrid associative memory with translation (HACT), hybrid GA-fuzzy clustering and extreme gradient boosting (XGBoost) were compared in prediction performance to the unsupervised classifier deep belief network (DBN) and the hybrid DBN-SVM model, whereby a total of sixteen financial variables were selected from the financial statements of the publicly-listed Taiwanese firms as inputs to the six approaches. Our empirical findings, covering the 2010–2016 sample period, demonstrated that among the four supervised algorithms, the XGBoost provided the most accurate FD prediction. Moreover, the hybrid DBN-SVM model was able to generate more accurate forecasts than the use of either the SVM or the classifier DBN in isolation.