极限学习机的分类器集成模型研究

将极限学习机算法与旋转森林算法相结合,提出了以ELM算法为基分类器并以旋转森林算法为框架的RF-ELM集成学习模型。在8个数据集上进行了3组预测实验,根据实验结果讨论了ELM算法中隐含层神经元个数对预测结果的影响以及单个ELM模型预测结果不稳定的缺陷;将RF-ELM模型与单ELM模型和基于Bagging算法集成的ELM模型相比较,由稳定性和预测精度的两组对比实验的实验结果表明,对ELM的集成学习可以有效地提高ELM模型的性能,且RF-ELM模型较其他两个模型具有更好的稳定性和更高的准确率,验证了RF-ELM是一种有效的ELM集成学习模型。     

Prediction of cement-based mortars compressive strength using machine learning techniques

Neural Computing and Applications - The application of artificial neural networks in mapping the mechanical characteristics of the cement-based materials is underlined in previous investigations....     

An application of adaptive neuro fuzzy inference system for estimating the uniaxial compressive strength of certain granitic rocks from their mineral contents

The uniaxial compressive strength (UCS) of rocks is an important intact rock parameter, and it is commonly used for various engineering applications. This parameter is mainly controlled by the mineralogical and textural characteristics of rocks. In this study, a soft computing method, an adaptive neuro-fuzzy inference system (ANFIS), was employed to estimate UCS from the mineral contents of certain granitic rocks selected from Turkey; nonlinear multiple regression analysis was then employed to validate these estimations. Five nonlinear multiple regressions and ANFIS models were constructed with three inputs: quartz, orthoclase and plagioclase. To determine the optimal model, various performance indices (R, values account for and root mean square error) were determined, and the model obtained from dataset #3 was selected as the optimal model. The coefficients of correlation for the nonlinear multiple regression and ANFIS models were 0.87 and 0.91, respectively. Thus, both models yielded acceptable results, and the ANFIS is a suitable method for estimating the UCS of rocks.     

基于集成学习的口令强度评估模型

针对现有的口令评估模型通用性差,没有一个可以对从简单口令到非常复杂口令都适用的评估模型的问题,设计了一种基于多模型的集成学习的口令评估模型。首先,使用真实的口令训练集训练多个现有的口令评估模型作为子模型;其次,将多个经过训练的子模型作为基学习器进行集成学习,采用偏弱项投票法的结合策略实现各个子模型的优势集成;最后,实现一个以高准确性为前提的通用口令评估模型。实验中使用网络泄露的真实用户口令数据集作为实验数据,实验结果表明,基于多模型集成学习模型针对不同复杂程度的口令进行口令强度评估,其评估结果准确率高、通用性强,所提模型在口令评估方面具有较好的适用性。     

Application of several non-linear prediction tools for estimating uniaxial compressive strength of granitic rocks and comparison of their performances

Uniaxial compressive strength (UCS) of rock is crucial for any type of projects constructed in/on rock mass. The test that is conducted to measure the UCS of rock is expensive, time consuming and having sample restriction. For this reason, the UCS of rock may be estimated using simple rock tests such as point load index (I _s(50)), Schmidt hammer (R _n) and p-wave velocity (V _p) tests. To estimate the UCS of granitic rock as a function of relevant rock properties like R _n, p-wave and I _s(50), the rock cores were collected from the face of the Pahang–Selangor fresh water tunnel in Malaysia. Afterwards, 124 samples are prepared and tested in accordance with relevant standards and the dataset is obtained. Further an established dataset is used for estimating the UCS of rock via three-nonlinear prediction tools, namely non-linear multiple regression (NLMR), artificial neural network (ANN) and adaptive neuro-fuzzy inference system (ANFIS). After conducting the mentioned models, considering several performance indices including coefficient of determination (R ²), variance account for and root mean squared error and also using simple ranking procedure, the models were examined and the best prediction model was selected. It is concluded that the R ² equal to 0.951 for testing dataset suggests the superiority of the ANFIS model, while these values are 0.651 and 0.886 for NLMR and ANN techniques, respectively. The results pointed out that the ANFIS model can be used for predicting UCS of rocks with higher capacity in comparison with others. However, the developed model may be useful at a preliminary stage of design; it should be used with caution and only for the specified rock types.     

Applying several machine learning approaches for prediction of unconfined compressive strength of stabilized pond ashes

This paper evaluates the potential of five modeling approaches, namely M5 model tree, random forest, artificial neural networks, support vector machines and Gaussian processes, for the prediction of unconfined compressive strength of stabilized pond ashes with lime and lime sludge. The study not only presents five models for the same set of data but also compares the overall performance of them. Dataset used consists of 255 samples acquired from laboratory experiments. Out of the total, 170 randomly chosen samples were used for training and remaining 85 were used for testing the models. Input dataset consists of eight parameters (uniformity coefficient, coefficient of curvature, maximum dry density, optimum moisture content, lime, lime sludge, curing period and 7-day soaked California bearing ratio), while the output is UCS value at 7, 28, 45, 90 and 180 days of curing. Comparisons of results propose that Gaussian processes modeling strategy works well and the overall performance was substantially nearer to the exact agreement line. As a result of GP model, higher value of CC = 0.997 and lower values of RMSE = 23.016 kPa and MAE = 16.455 were obtained for testing the dataset. Sensitivity analysis suggests that lime, lime sludge, curing period and California bearing ratio are the significant parameters for predicting the unconfined compressive strength of stabilized pond ashes. The results confirmed that GP models are in a position to predict the unconfined compressive strength of stabilized pond ashes with an excessive degree of accuracy; however, GP modeling approach proves that this approach is more economical and less difficult in comparison with tedious laboratory work.

     

An ensemble learning model for preference-geographical aware point-of interest recommendation

Applied Intelligence - The emergence of location-based social networks (LBSNs), which contain a lot of information, creates the possibility of a point-of-interest (POI) recommendation. Meanwhile,...     

An optimized instance based learning algorithm for estimation of compressive strength of concrete

This article proposes an optimized instance-based learning approach for prediction of the compressive strength of high performance concrete based on mix data, such as water to binder ratio, water content, super-plasticizer content, fly ash content, etc. The base algorithm used in this study is the k nearest neighbor algorithm, which is an instance-based machine leaning algorithm. Five different models were developed and analyzed to investigate the effects of the number of neighbors, the distance function and the attribute weights on the performance of the models. For each model a modified version of the differential evolution algorithm was used to find the optimal model parameters. Moreover, two different models based on generalized regression neural network and stepwise regressions were also developed. The performances of the models were evaluated using a set of high strength concrete mix data. The results of this study indicate that the optimized models outperform those derived from the standard k nearest neighbor algorithm, and that the proposed models have a better performance in comparison to generalized regression neural network, stepwise regression and modular neural networks models.     

Development of ensemble machine learning approaches for designing fiber-reinforced polymer composite strain prediction model

Engineering with Computers - Over the past few decades, it has been observed a remarkable progression in the development of computer aid models in the field of civil engineering. Machine learning...     

A survival ensemble of extreme learning machine

Due to the fast learning speed, simplicity of implementation and minimal human intervention, extreme learning machine has received considerable attentions recently, mostly from the machine learning community. Generally, extreme learning machine and its various variants focus on classification and regression problems. Its potential application in analyzing censored time-to-event data is yet to be verified. In this study, we present an extreme learning machine ensemble to model right-censored survival data by combining the Buckley-James transformation and the random forest framework. According to experimental and statistical analysis results, we show that the proposed model outperforms popular survival models such as random survival forest, Cox proportional hazard models on well-known low-dimensional and high-dimensional benchmark datasets in terms of both prediction accuracy and time efficiency.     

Estimating the uniaxial compressive strength of some clay-bearing rocks selected from Turkey by nonlinear multivariable regression and rule-based fuzzy models

Abstract: Although the use of predictive models in rock engineering and engineering geology is an important issue, some simple and multivariate regression techniques traditionally employed in these areas have recently been challenged by the use of fuzzy inference systems and artificial neural networks. The purpose of this study was to construct some predictive models to estimate the uniaxial compressive strength of some clay-bearing rocks, depending on examination of their slake durability indices and clay contents. For this purpose, the simple and nonlinear multivariable regression techniques and the Mamdani fuzzy algorithm are compared in terms of their accuracy. To increase the accuracy of the Mamdani fuzzy inference system, the weighted if–then rules are extracted. To compare the predictive performances of the models, the statistical performance indices (root mean square error and variance account for) are calculated and the results are discussed. The indices reveal that the fuzzy inference system has a slightly higher prediction capacity than the regression models. The basic reason for the higher performance of the fuzzy inference system is the flexibility of the fuzzy approach.     

基于金枪鱼群算法优化极限学习机的混凝土抗压强度预测

混凝土抗压强度是建筑结构设计与评价一个重要指标,它直接关乎建筑的质量与安全。为解决现有机器学习模型对其预测存在预测耗时长、精度不够高,不能很好地满足施工现场对混凝土抗压强度预测实时性与准确性要求的问题,提出一套基于新式仿生算法金枪鱼群算法优化极限学习机（TSO-ELM）的混凝土抗压强度预测方法。该方法通过对ELM隐藏层初始参数中的连接权值与偏置值使用TSO进行寻优,有效提升了ELM的预测准确度。在仿真实验部分,通过两组混凝土数据集对ELM的预测速度、TSO的寻优能力、TSO-ELM模型的泛化性逐一进行验证。结果表明,该方法可以有效提高预测的速度与精准度,迭代次数更少,同时具有良好的泛化性,为现场施工及时进行混凝土抗压强度的预测提供了一种新方法。     

An optimized hybrid deep learning model using ensemble learning approach for human walking activities recognition

The Journal of Supercomputing - Recent advancements in edge computing devices motivate us to develop a sustainable and reliable technique for multiple gait activities recognition using wearable...     

基于集成学习方法的点击率预估模型研究

由于互联网中积累的广告日志具有数据稀疏、特征量大、正负样本分布极其不均匀等问题,使得人工特征提取费时费力,并且单一预测模型很难得到更好的预测性能。针对这些问题,提出梯度提升树GBDT和Stacking相融合的点击率预测模型GBDT-Stacking。通过引入梯度提升树自动进行特征提取与构造,并结合Stacking集成模型对在线广告点击率进行预测,有效提高了单个预测模型的性能。在真实广告数据集上的实验结果表明,GBDT-Stacking集成模型比对比模型在AUC的取值上至少提升了4%。     

Performance prediction of roadheaders using ensemble machine learning techniques

Mechanical excavators are widely used in mining, tunneling and civil engineering projects. There are several types of mechanical excavators, such as a roadheader, tunnel boring machine and impact hammer. This is because these tools can bring productivity to the project quickly, accurately and safely. Among these, roadheaders have some advantages like selective mining, mobility, less over excavation, minimal ground disturbances, elimination of blast vibration, reduced ventilation requirements and initial investment cost. A critical issue in successful roadheader application is the ability to evaluate and predict the machine performance named instantaneous (net) cutting rate. Although there are several prediction methods in the literature, for the prediction of roadheader performance, only a few of them have been developed via artificial neural network techniques. In this study, for this purpose, 333 data sets including uniaxial compressive strength and power on cutting boom, 103 data set including RQD, and 125 data sets including machine weight are accumulated from the literature. This paper focuses on roadheader performance prediction using six different machine learning algorithms and a combination of various machine learning algorithms via ensemble techniques. Algorithms are ZeroR, random forest (RF), Gaussian process, linear regression, logistic regression and multi-layer perceptron (MLP). As a result, MLP and RF give better results than the other algorithms also the best solution achieved was bagging technique on RF and principle component analysis (PCA). The best success rate obtained in this study is 90.2% successful prediction, and it is relatively better than contemporary research.

     

Random forests-based extreme learning machine ensemble for multi-regime time series prediction

Accurate and timely predicting values of performance parameters are currently strongly needed for important complex equipment in engineering. In time series prediction, two problems are urgent to be solved. One problem is how to achieve the accuracy, stability and efficiency together, and the other is how to handle time series with multiple regimes. To solve these two problems, random forests-based extreme learning machine ensemble model and a novel multi-regime approach are proposed respectively, and these two approaches can be integrated to achieve better performance. First, the extreme learning machine (ELM) is used in the proposed model because of its efficiency. Then the regularized ELM and ensemble learning strategy are used to improve generalization performance and prediction accuracy. The bootstrap sampling technique is used to generate training sample sets for multiple base-level ELM models, and then the random forests (RF) model is used as the combiner to aggregate these ELM models to achieve more accurate and stable performance. Next, based on the specific properties of turbofan engine time series, a multi-regime approach is proposed to handle it. Regimes are first separated, then the proposed RF-based ELM ensemble model is used to learn models of all regimes, individually, and last, all the learned regime models are aggregated to predict performance parameter at the future timestamp. The proposed RF-based ELM ensemble model and multi-regime approaches are evaluated by using NN3 time series and NASA turbofan engine time series, and then the proposed model is applied to the exhaust gas temperature prediction of CFM engine. The results demonstrate that the proposed RF-based ELM ensemble model and multi-regime approach can be accurate, stable and efficient in predicting multi-regime time series, and it can be robust against overfitting.     

An ensemble of support vector machines for predicting virulent proteins

It is important to develop a reliable system for predicting bacterial virulent proteins for finding novel drug/vaccine and for understanding virulence mechanisms in pathogens.In this work we have proposed a bacterial virulent protein prediction method based on an ensemble of classifiers where the features are extracted directly from the amino acid sequence of a given protein. It is well known in the literature that the features extracted from the evolutionary information of a given protein are better than the features extracted from the amino acid sequence. Our method tries to fill the gap between the amino acid sequence based approaches and the evolutionary information based approaches.An extensive evaluation according to a blind testing protocol, where the parameters of the system are calculated using the training set and the system is validated in three different independent datasets, has demonstrated the validity of the proposed method.     

Design and implementation of a new tuned hybrid intelligent model to predict the uniaxial compressive strength of the rock using SFS-ANFIS

This study proposes a novel design to systematically optimize the parameters for the adaptive neuro-fuzzy inference system (ANFIS) model using stochastic fractal search (SFS) algorithm. To affirm the efficiency of the proposed SFS-ANFIS model, the predicting results were compared with ANFIS and three hybrid methodologies based on ANFIS combined with genetic algorithm (GA), differential evolution (DE), and particle swarm optimization (PSO). Accurate prediction of uniaxial compressive strength (UCS) is of great significance for all geotechnical projects such as tunnels and dams. Hence, this study proposes the use of SFS-ANFIS, GA-ANFIS, DE-ANFIS, PSO-ANFIS, and ANFIS models to predict UCS. In this regard, the fresh water tunnel of Pahang–Selangor located in Malaysia was considered and the requirement data samples were collected. Different statistical metrics such as coefficient of determination (R²) and mean absolute error were used to evaluate the models. Referring to the efficiency results of SFS-ANFIS, it can be found that the SFS-ANFIS (with the R² of 0.981) has higher ability than PSO-ANFIS, DE-ANFIS, GA-ANFIS, and ANFIS models in predicting the UCS.

     

An improved model for predicting trip mode distribution using convolution deep learning

The Journal of Supercomputing - Trip mode selection is a behavioral characteristic of passengers with immense importance for travel demand analysis, transportation planning, and traffic management....