A hybrid approach to integrate genetic algorithm into dual scoring model in enhancing the performance of credit scoring model

Credit scoring model is an important tool for assessing risks in financial industry, consequently the majority of financial institutions actively develops credit scoring model on the credit approval assessment of new customers and the credit risk management of existing customers. Nonetheless, most past researches used the one-dimensional credit scoring model to measure customer risk. In this study, we select important variables by genetic algorithm (GA) to combine the bank’s internal behavioral scoring model with the external credit bureau scoring model to construct the dual scoring model for credit risk management of mortgage accounts. It undergoes more accurate risk judgment and segmentation to further discover the parts which are required to be enhanced in management or control from mortgage portfolio. The results show that the predictive ability of the dual scoring model outperforms both one-dimensional behavioral scoring model and credit bureau scoring model. Moreover, this study proposes credit strategies such as on-lending retaining and collection actions for corresponding customers in order to contribute benefits to the practice of banking credit.     

Decision tree-based technology credit scoring for start-up firms: Korean case

Various types of Technology Credit Guarantees (TCGs) have been issued to support technology development of start-up firms. Technology evaluation has become a critical part of TCG system. However, general technology credit scoring models have not been applied reflecting the special phenomena of start-ups, which are distinguishable from those of established firms. Furthermore, somewhat complicated approaches have been applied to existing models. We propose a rather simple decision tree-based technology credit scoring for start-ups which can serve as a-replacement for the complicated models currently used for general purposes. Our result is expected to provide valuable information to evaluator for start-up firms.     

The application of brute force logistic regression to corporate credit scoring models: Evidence from Serbian financial statements

In this paper a brute force logistic regression (LR) modeling approach is proposed and used to develop predictive credit scoring model for corporate entities. The modeling is based on 5 years of data from end-of-year financial statements of Serbian corporate entities, as well as, default event data. To the best of our knowledge, so far no relevant research about predictive power of financial ratios derived from Serbian financial statements has been published. This is also the first paper that generated 350 financial ratios to represent independent variables for 7590 corporate entities default predictions’. Many of derived financial ratios are new and were not discussed in literature before. Weight of evidence (WOE) method has been applied to transform and prepare financial ratios for brute force LR fitting simulations. Clustering method has been utilized to reduce long list of variables and to remove highly correlated financial ratios from partitioned training and validation datasets. The clustering results have revealed that number of variables can be reduced to short list of 24 financial ratios which are then analyzed in terms of default event predictive power. In this paper we propose the most predictive financial ratios from financial statements of Serbian corporate entities. The obtained short list of financial ratios has been used as a main input for brute force LR model simulations. According to literature, common practice to select variables in final model is to run stepwise, forward or backward LR. However, this research has been conducted in a way that the brute force LR simulations have to obtain all possible combinations of models that comprise of 5–14 independent variables from the short list of 24 financial ratios. The total number of simulated resulting LR models is around 14 million. Each model has been fitted through extensive and time consuming brute force LR simulations using SAS® code written by the authors. The total number of 342,016 simulated models (“well-founded” models) has satisfied the established credit scoring model validity conditions. The well-founded models have been ranked according to GINI performance on validation dataset. After all well-founded models have been ranked, the model with highest predictive power and consisting of 8 financial ratios has been selected and analyzed in terms of receiver-operating characteristic curve (ROC), GINI, AIC, SC, LR fitting statistics and correlation coefficients. The financial ratio constituents of that model have been discussed and benchmarked with several models from relevant literature.     

An application of locally linear model tree algorithm with combination of feature selection in credit scoring

Nowadays, credit scoring is one of the most important topics in the banking sector. Credit scoring models have been widely used to facilitate the process of credit assessing. In this paper, an application of the locally linear model tree algorithm (LOLIMOT) was experimented to evaluate the superiority of its performance to predict the customer's credit status. The algorithm is improved with an aim of adjustment by credit scoring domain by means of data fusion and feature selection techniques. Two real world credit data sets – Australian and German – from UCI machine learning database were selected to demonstrate the performance of our new classifier. The analytical results indicate that the improved LOLIMOT significantly increase the prediction accuracy.     

A two-stage hybrid credit scoring model using artificial neural networks and multivariate adaptive regression splines

The objective of the proposed study is to explore the performance of credit scoring using a two-stage hybrid modeling procedure with artificial neural networks and multivariate adaptive regression splines (MARS). The rationale under the analyses is firstly to use MARS in building the credit scoring model, the obtained significant variables are then served as the input nodes of the neural networks model. To demonstrate the effectiveness and feasibility of the proposed modeling procedure, credit scoring tasks are performed on one bank housing loan dataset using cross-validation approach. As the results reveal, the proposed hybrid approach outperforms the results using discriminant analysis, logistic regression, artificial neural networks and MARS and hence provides an alternative in handling credit scoring tasks.     

A logistic regression model for Semantic Web service matchmaking

Semantic Web service matchmaking,as one of the most challenging problems in Semantic Web services (SWS),aims to filter and rank a set of services with respect to a service query by using a certain matching strategy.In this paper,we propose a logistic regression based method to aggregate several matching strategies instead of a fixed integration (e.g.,the weighted sum) for SWS matchmaking.The logistic regression model is trained on training data derived from binary relevance assessments of existing test collections,and then used to predict the probability of relevance between a new pair of query and service according to their matching values obtained from various matching strategies.Services are then ranked according to the probabilities of relevance with respect to each query.Our method is evaluated on two main test collections,SAWSDL-TC2 and Jena Geography Dataset(JGD).Experimental results show that the logistic regression model can effectively predict the relevance between a query and a service,and hence can improve the effectiveness of service matchmaking.     

Forecasting analysis by using fuzzy grey regression model for solving limited time series data

The grey model GM(1,1) is a popular forecasting method when using limited time series data and is successfully applied to management and engineering applications. On the other hand, the reliability and validity of the grey model GM(1,1) have never been discussed. First, without considering other causes when using limited time series data, the forecasting of the grey model GM(1,1) is unreliable, and provide insufficient information to a decision maker. Therefore, for the sake of reliability, the fuzzy set theory was hybridized into the grey model GM(1,1). This resulted in the fuzzy grey regression model, which granulates a concept into a set with membership function, thereby obtaining a possible interval extrapolation. Second, for a newly developed product or a newly developed system, the data collected are limited and rather vague with the result that the grey model GM(1,1) is useless for solving its problem with vague or fuzzy-input values. In this paper the fuzzy grey regression model is verified to show its validity in solving crisp-input data and fuzzy-input data with limited time series data. Finally, two examples for the LCD TV demand are illustrated using the proposed models.     

A two stage fuzzy piecewise logistic model for penetration forecasting

It is undeniably crucial for a firm to be able to make a forecast regarding the sales volume of new products. However, the current economic environments invariably have uncertain factors and rapid fluctuations where decision makers must draw conclusions from minimal data. Previous studies combine scenario analysis and technology substitution models to forecast the market share of multigenerational technologies. However, a technology substitution model based on a logistic curve will not always fit the S curve well. Therefore, based on historical data and the data forecast by both the Scenario and Delphi methods, a two stage fuzzy piecewise logistic growth model with multiple objective programming is proposed herein. The piecewise concept is adopted in order to reflect the market impact of a new product such that it can be possible to determine the effective length of sales forecasting intervals even when handling a large variation in data or small size data. In order to demonstrate the model's performance, two cases in the Television and Telecommunication industries are treated using the proposed method and the technology substitution model or the Norton and Bass diffusion model. A comparison of the results shows that the proposed model outperforms the technology substitution model and the Norton and Bass diffusion model.     

Fuzzy linear regression model based on fuzzy scalar product

The new concept and method of imposing imprecise (fuzzy) input and output data upon the conventional linear regression model is proposed in this paper. We introduce the fuzzy scalar (inner) product to formulate the fuzzy linear regression model. In order to invoke the conventional approach of linear regression analysis for real-valued data, we transact the α-level linear regression models of the fuzzy linear regression model. We construct the membership functions of fuzzy least squares estimators via the form of “Resolution Identity” which is a well-known formula in fuzzy sets theory. In order to obtain the membership value of any given least squares estimate taken from the fuzzy least squares estimator, we transform the original problem into the optimization problems. We also provide two computational procedures to solve the optimization problems.     

基于模糊线性回归的脑卒中发病率预测模型

针对经典线性回归模型不能完全反映变量间的耦合关系而不适宜有模糊数的脑卒中发病率预测的问题,建立了一种模糊多元线性回归分析的脑卒中发病率预测模型。把历史数据分为建模数据样本和检测数据样本,采用线性规划法求出参数的中心值和模糊幅度值。实验结果表明,该模型具有较高的精确度和可操作性。     

A novel hybrid credit scoring model based on ensemble feature selection and multilayer ensemble classification

Credit scoring focuses on the development of empirical models to support the financial decision‐making processes of financial institutions and credit industries. It makes use of applicants' historical data and statistical or machine learning techniques to assess the risk associated with an applicant. However, the historical data may consist of redundant and noisy features that affect the performance of credit scoring models. The main focus of this paper is to develop a hybrid model, combining feature selection and a multilayer ensemble classifier framework, to improve the predictive performance of credit scoring. The proposed hybrid credit scoring model is modeled in three phases. The initial phase constitutes preprocessing and assigns ranks and weights to classifiers. In the next phase, the ensemble feature selection approach is applied to the preprocessed dataset. Finally, in the last phase, the dataset with the selected features is used in a multilayer ensemble classifier framework. In addition, a classifier placement algorithm based on the Choquet integral value is designed, as the classifier placement affects the predictive performance of the ensemble framework. The proposed hybrid credit scoring model is validated on real‐world credit scoring datasets, namely, Australian, Japanese, German‐categorical, and German‐numerical datasets.     

基于DESMID-AD动态选择的类别不平衡信用评估模型

针对现实信用评估业务中样本类别不平衡和代价敏感的情况,为降低信用风险评估的误分类损失,提出一种基于DESMID-AD动态选择的信用评估集成模型,根据每一个测试样本的特点动态地选择合适的基分类器对其进行信用预测.为提高模型对信用差客户(小类)的识别能力,在基分类器训练前使用过采样的方法对训练数据作类别平衡,采用元学习的方式基于多个指标进行基分类器的性能评估并在此阶段设计权重机制增强小类的影响.在三个公开信用评估数据集上,以AUC、一型、二型错误率以及误分类代价作为评价指标,与九种信用评估常用模型做比较,证明了该方法在信用评估领域的有效性和可行性.     

A new approach to formulate fuzzy regression models

A fuzzy regression model is developed to construct the relationship between the response and explanatory variables in fuzzy environments. To enhance explanatory power and take into account the uncertainty of the formulated model and parameters, a new operator, called the fuzzy product core (FPC), is proposed for the formulation processes to establish fuzzy regression models with fuzzy parameters using fuzzy observations that include fuzzy response and explanatory variables. In addition, the sign of parameters can be determined in the model-building processes. Compared to existing approaches, the proposed approach reduces the amount of unnecessary or unimportant information arising from fuzzy observations and determines the sign of parameters in the models to increase model performance. This improves the weakness of the relevant approaches in which the parameters in the models are fuzzy and must be predetermined in the formulation processes. The proposed approach outperforms existing models in terms of distance, mean similarity, and credibility measures, even when crisp explanatory variables are used.     

The logistic regression model with response variables subject to randomized response

The univariate and multivariate logistic regression model is discussed where response variables are subject to randomized response (RR). RR is an interview technique that can be used when sensitive questions have to be asked and respondents are reluctant to answer directly. RR variables may be described as misclassified categorical variables where conditional misclassification probabilities are known. The univariate model is revisited and is presented as a generalized linear model. Standard software can be easily adjusted to take into account the RR design. The multivariate model does not appear to have been considered elsewhere in an RR setting; it is shown how a Fisher scoring algorithm can be used to take the RR aspect into account. The approach is illustrated by analyzing RR data taken from a study in regulatory non-compliance regarding unemployment benefit.     

Insight of the fuzzy grey autoregressive model

In our previous research, we proposed a fuzzy grey regression model for solving limited time series data. The present paper follows the previous research and proposes a fuzzy grey autoregressive model for considering that the current value is correlated with previous values. The proposed model combines the advantages of the grey system model, the fuzzy regression model and the autoregressive model. Two illustrated examples are provided in which the amount of internet subscribers in Taiwan and the global demand of LCD TVs are forecasted. The results of these practical applications show that the proposed model can be used to obtain smaller forecasting errors of MAPE and RMSE, and that it makes good forecasts for the next demand period of internet subscribers and LCD TV. Furthermore, this model makes it possible for decision makers to forecast the best and the worst estimates based on fewer observations.     

Forecasting business failure using two‐stage ensemble of multivariate discriminant analysis and logistic regression

A major drawback associated with the use of classical statistical methods for business failure prediction on top of financial distress is their lack of high accuracy rate. This work analyses the use of the two‐stage ensemble of multivariate discriminant analysis (MDA) and logit to improve predictive performance of classical statistical methods. All possible ratios are firstly built from the quantities involved and then the three common filters, that is stepwise MDA, stepwise logit, and t‐test, are used to choose another three convenient subsets of ratios. Four principal components spaces (PCSs) are, respectively, produced on the four different feature spaces by using principal components analysis. MDA and logit are used to produce predictions on the four PCSs. After that, two levels of ensemble are implemented: one based on predictions inside each of the same type of model (i.e. MDA or logit) and another based on the former two ensembles and one best model. Each of the eight models is weighted on the base of ranking order information of its predictive accuracy in ensemble by majority voting. MDA and logit and the new challenge model of support vector machine respectively in their best standalone modes are used for comparisons. Empirical results indicate that the two‐stage ensemble of MDA and logit compares favourably with the three comparative models and all its component models.     

A variable spread fuzzy linear regression model with higher explanatory power and forecasting accuracy

Fuzzy regression models have been applied to operational research (OR) applications such as forecasting. Some of previous studies on fuzzy regression analysis obtain crisp regression coefficients for eliminating the problem of increasing spreads for the estimated fuzzy responses as the magnitude of the independent variable increases; however, they still cannot cope with the situation of decreasing or variable spreads. This paper proposes a three-phase method to construct the fuzzy regression model with variable spreads to resolve this problem. In the first phase, on the basis of the extension principle, the membership functions of the least-squares estimates of regression coefficients are constructed to conserve completely the fuzziness of observations. In the second phase, then they are defuzzified by the center of gravity method to obtain crisp regression coefficients. In the third phase, the error terms of the proposed model are determined by setting each estimated spread equals its corresponding observed spread. Furthermore, the Mamdani fuzzy inference system is adopted for improving the accuracy of its forecasts. Compared to the previous studies, the results from five examples and an application example of Japanese house prices show that the proposed fuzzy linear regression model has higher explanatory power and forecasting performance.     

Development of a quick credibility scoring decision support system using fuzzy TOPSIS

In this study, a quick credibility scoring decision support system is developed for the banks to determine the credibility of manufacturing firms in Turkey. The proposed decision support system is expected to be used by the banks when they want to determine whether an applicant firm is worth a detailed credit check or not. Using such a quick credit scoring decision model reduces the banks’ workload. The proposed credit scoring model is based on the financial ratios and fuzzy TOPSIS approach. It obtains two separate scores which reflect the attractiveness of manufacturing industries within the overall economy and manufacturing firms’ performance with respect to its competitors belonging to the same industry. These two scores are then used to determine the credibility of applicant manufacturing firms. The developed decision support system is tested with various real cases and satisfactory results are obtained. An application is also provided in the paper for illustrative purposes.     

Fuzzy logistic regression based on the least squares approach with application in clinical studies

To model fuzzy binary observations, a new model named “Fuzzy Logistic Regression” is proposed and discussed in this study. In fact, due to the vague nature of binary observations, no probability distribution can be considered for these data. Therefore, the ordinary logistic regression may not be appropriate. This study attempts to construct a fuzzy model based on possibility of success. These possibilities are defined by some linguistic terms such as …, low, medium, high…. Then, by use of the Extension principle, the logarithm transformation of “possibilistic odds” is modeled based on a set of crisp explanatory variables observations. Also, to estimate parameters in the proposed model, the least squares method in fuzzy linear regression is used. For evaluating the model, a criterion named the “capability index” is calculated. At the end, because of widespread applications of logistic regression in clinical studies and also, the abundance of vague observations in clinical diagnosis, the suspected cases to Systematic Lupus Erythematosus (SLE) disease is modeled based on some significant risk factors to detect the application of the model. The results showed that the proposed model could be a rational substituted model of an ordinary one in modeling the clinical vague status.