Prediction of shield tunneling-induced ground settlement using machine learning techniques

Predicting the tunneling-induced maximum ground surface settlement is a complex problem since the settlement depends on plenty of intrinsic and extrinsic factors. This study investigates the efficiency and feasibility of six machine learning (ML) algorithms, namely, back-propagation neural network, wavelet neural network, general regression neural network (GRNN), extreme learning machine, support vector machine and random forest (RF), to predict tunneling-induced settlement. Field data sets including geological conditions, shield operational parameters, and tunnel geometry collected from four sections of tunnel with a total of 3.93 km are used to build models. Three indicators, mean absolute error, root mean absolute error, and coefficient of determination the (R²) are used to demonstrate the performance of each computational model. The results indicated that ML algorithms have great potential to predict tunneling-induced settlement, compared with the traditional multivariate linear regression method. GRNN and RF algorithms show the best performance among six ML algorithms, which accurately recognize the evolution of tunneling-induced settlement. The correlation between the input variables and settlement is also investigated by Pearson correlation coefficient.     

Effectiveness of predicting tunneling-induced ground settlements using machine learning methods with small datasets

Prediction of tunneling-induced ground settlements is an essential task, particularly for tunneling in urban settings. Ground settlements should be limited within a tolerable threshold to avoid damages to aboveground structures. Machine learning(ML) methods are becoming popular in many fields, including tunneling and underground excavations, as a powerful learning and predicting technique. However, the available datasets collected from a tunneling project are usually small from the perspective o...     

Prediction of flyrock distance induced by mine blasting using a novel Harris Hawks optimization-based multi-layer perceptron neural network

In mining or construction projects, for exploitation of hard rock with high strength properties, blasting is frequently applied to breaking or moving them using high explosive energy. However, use of explosives may lead to the flyrock phenomenon. Flyrock can damage structures or nearby equipment in the surrounding areas and inflict harm to humans, especially workers in the working sites. Thus, prediction of flyrock is of high importance. In this investigation, examination and estimation/forecast of flyrock distance induced by blasting through the application of five artificial intelligent algorithms were carried out. One hundred and fifty-two blasting events in three open-pit granite mines in Johor, Malaysia, were monitored to collect field data. The collected data include blasting parameters and rock mass properties. Site-specific weathering index (WI), geological strength index (GSI) and rock quality designation (RQD) are rock mass properties. Multi-layer perceptron (MLP), random forest (RF), support vector machine (SVM), and hybrid models including Harris Hawks optimization-based MLP (known as HHO-MLP) and whale optimization algorithm-based MLP (known as WOA-MLP) were developed. The performance of various models was assessed through various performance indices, including a10-index, coefficient of determination (R²), root mean squared error (RMSE), mean absolute percentage error (MAPE), variance accounted for (VAF), and root squared error (RSE). The a10-index values for MLP, RF, SVM, HHO-MLP and WOA-MLP are 0.953, 0.933, 0.937, 0.991 and 0.972, respectively. R² of HHO-MLP is 0.998, which achieved the best performance among all five machine learning (ML) models.     

A generic framework for geotechnical subsurface modeling with machine learning

This study introduces a generic framework for geotechnical subsurface modeling, which accounts for spatial autocorrelation with local mapping machine learning(ML) methods. Instead of using XY coordinate fields directly as model input, a series of autocorrelated geotechnical distance fields(GDFs) is designed to enable the ML models to infer the spatial relationship between the sampled locations and unknown locations. The whole framework using GDF with ML methods is named GDF-ML. This framework is...     

Application of several optimization techniques for estimating TBM advance rate in granitic rocks

This study aims to develop several optimization techniques for predicting advance rate of tunnel boring machine(TBM)in different weathered zones of granite.For this purpose,extensive field and laboratory studies have been conducted along the 12,649 m of the Pahang-Selangor raw water transfer tunnel in Malaysia.Rock properties consisting of uniaxial compressive strength(UCS),Brazilian tensile strength(BTS),rock mass rating(RMR),rock quality designation(RQD),quartz content(q)and weathered zone as well as machine specifications including thrust force and revolution per minute(RPM)were measured to establish comprehensive datasets for optimization.Accordingly,to estimate the advance rate of TBM,two new hybrid optimization techniques,i.e.an artificial neural network(ANN)combined with both imperialist competitive algorithm(ICA)and particle swarm optimization(PSO),were developed for mechanical tunneling in granitic rocks.Further,the new hybrid optimization techniques were compared and the best one was chosen among them to be used for practice.To evaluate the accuracy of the proposed models for both testing and training datasets,various statistical indices including coefficient of determination(R~2),root mean square error(RMSE)and variance account for(VAF)were utilized herein.The values of R~2,RMSE,and VAF ranged in 0.939-0.961,0.022-0.036,and 93.899-96.145,respectively,with the PSO-ANN hybrid technique demonstrating the best performance.It is concluded that both the optimization techniques,i.e.PSO-ANN and ICA-ANN,could be utilized for predicting the advance rate of TBMs;however,the PSO-ANN technique is superior.     

Prediction of rockhead using a hybrid N-XGBoost machine learning framework

The spatial information of rockhead is crucial for the design and construction of tunneling or underground excavation. Although the conventional site investigation methods (i.e. borehole drilling) could provide local engineering geological information, the accurate prediction of the rockhead position with limited borehole data is still challenging due to its spatial variation and great uncertainties involved. With the development of computer science, machine learning (ML) has been proved to be a promising way to avoid subjective judgments by human beings and to establish complex relationships with mega data automatically. However, few studies have been reported on the adoption of ML models for the prediction of the rockhead position. In this paper, we proposed a robust probabilistic ML model for predicting the rockhead distribution using the spatial geographic information. The framework of the natural gradient boosting (NGBoost) algorithm combined with the extreme gradient boosting (XGBoost) is used as the basic learner. The XGBoost model was also compared with some other ML models such as the gradient boosting regression tree (GBRT), the light gradient boosting machine (LightGBM), the multivariate linear regression (MLR), the artificial neural network (ANN), and the support vector machine (SVM). The results demonstrate that the XGBoost algorithm, the core algorithm of the probabilistic N-XGBoost model, outperformed the other conventional ML models with a coefficient of determination (R²) of 0.89 and a root mean squared error (RMSE) of 5.8 m for the prediction of rockhead position based on limited borehole data. The probabilistic N-XGBoost model not only achieved a higher prediction accuracy, but also provided a predictive estimation of the uncertainty. Thus, the proposed N-XGBoost probabilistic model has the potential to be used as a reliable and effective ML algorithm for the prediction of rockhead position in rock and geotechnical engineering.     

Prediction of mode I fracture toughness of rock using linear multiple regression and gene expression programming

Prediction of mode I fracture toughness(KIC) of rock is of significant importance in rock engineering analyses. In this study, linear multiple regression(LMR) and gene expression programming(GEP)methods were used to provide a reliable relationship to determine mode I fracture toughness of rock. The presented model was developed based on 60 datasets taken from the previous literature. To predict fracture parameters, three mechanical parameters of rock mass including uniaxial compressive strength(...     

Machine learning and data-driven prediction of pore pressure from geophysical logs: A case study for the Mangahewa gas field,New Zealand

Pore pressure is an essential parameter for establishing reservoir conditions, geological interpretation and drilling programs. Pore pressure prediction depends on information from various geophysical logs, seismic, and direct down-hole pressure measurements. However, a level of uncertainty accompanies the prediction of pore pressure because insufficient information is usually recorded in many wells. Applying machine learning (ML) algorithms can decrease the level of uncertainty of pore pressure prediction uncertainty in cases where available information is limited. In this research, several ML techniques are applied to predict pore pressure through the over-pressured Eocene reservoir section penetrated by four wells in the Mangahewa gas field, New Zealand. Their predictions substantially outperform, in terms of prediction performance, those generated using a multiple linear regression (MLR) model. The geophysical logs used as input variables are sonic, temperature and density logs, and some direct pore pressure measurements were available at the reservoir level to calibrate the predictions. A total of 25,935 data records involving six well-log input variables were evaluated across the four wells. All ML methods achieved credible levels of pore pressure prediction performance. The most accurate models for predicting pore pressure in individual wells on a supervised basis are decision tree (DT), adaboost (ADA), random forest (RF) and transparent open box (TOB). The DT achieved root mean square error (RMSE) ranging from 0.25 psi to 14.71 psi for the four wells. The trained models were less accurate when deployed on a semi-supervised basis to predict pore pressure in the other wellbores. For two wells (Mangahewa-03 and Mangahewa-06), semi-supervised prediction achieved acceptable prediction performance of RMSE of 130–140 psi; while for the other wells, semi-supervised prediction performance was reduced to RMSE > 300 psi. The results suggest that these models can be used to predict pore pressure in nearby locations, i.e. similar geology at corresponding depths within a field, but they become less reliable as the step-out distance increases and geological conditions change significantly. In comparison to other approaches to predict pore pressures, this study has identified that application of several ML algorithms involving a large number of data records can lead to more accurate prediction results.     

Investigation of feature contribution to shield tunneling-induced settlement using Shapley additive explanations method

Accurate prediction of shield tunneling-induced settlement is a complex problem that requires consideration of many influential parameters. Recent studies reveal that machine learning(ML) algorithms can predict the settlement caused by tunneling. However, well-performing ML models are usually less interpretable. Irrelevant input features decrease the performance and interpretability of an ML model. Nonetheless, feature selection, a critical step in the ML pipeline, is usually ignored in most stu...     

Artificial neural network optimized by differential evolution for predicting diameters of jet grouted columns

A novel and effective artificial neural network (ANN) optimized using differential evolution (DE) is first introduced to provide a robust and reliable forecasting of jet grouted column diameters. The proposed computational method adopts the DE algorithm to tackle the difficulties in the training and performance of neural networks and optimize the four quintessential hyper-parameters (i.e. the epoch size, the number of neurons in a hidden layer, the number of hidden layers, and the regularization parameter) that govern the neural network efficacy. This approach is further enhanced by a stochastic gradient optimization algorithm to allow ‘expensive’ computation efforts. The ANN-DE is first trained using a prepared jet grouting dataset, then verified and compared with the prevalent machine learning tools, i.e. neural networks and support vector machine (SVM). The results show that, the ANN-DE outperforms the existing methods for predicting the diameter of jet grouting columns since it well balances training efficiency and model performance. Specifically, the ANN-DE achieved root mean square error (RMSE) values of 0.90603 and 0.92813 for the training and testing phases, respectively. The corresponding values were 0.8905 and 0.9006 for the optimized ANN, then, 0.87569 and 0.89968 for the optimized SVM, respectively. The proposed paradigm is bound to be useful for solving various geotechnical engineering problems regardless of multi-dimension and nonlinearity.     

Classification of clustered microseismic events in a coal mine using machine learning

Discrimination of seismicity distributed in different areas is essential for reliable seismic risk assessment in mines. Although machine learning has been widely applied in seismic data processing, feasibility and reliability of applying this technique to classify spatially clustered seismic events in underground mines are yet to be investigated. In this research, two groups of seismic events with a minimum local magnitude (M_L) of −3 were observed in an underground coal mine. They were respectively located around a dyke and the longwall face. Additionally, two types of undesired signals were also recorded. Four machine learning methods, i.e. random forest (RF), support vector machine (SVM), deep convolutional neural network (DCNN), and residual neural network (ResNN), were used for classifying these signals. The results obtained based on a primary dataset showed that these seismic events could be classified with at least 91% accuracy. The DCNN using seismogram images as the inputs reached the best performance with more than 94% accuracy. As mining is a dynamic progress which could change the characteristics of seismic signals, the temporal variance in the prediction performance of DCNN was also investigated to assess the reliability of this classifier during mining. A cascaded workflow consisting of database update, model training, signal prediction, and results review was established. By progressively calibrating the DCNN model, it achieved up to 99% prediction accuracy. The results demonstrated that machine learning is a reliable tool for the automatic discrimination of spatially clustered seismicity in underground mining.     

Concrete crack detection using context‐aware deep semantic segmentation network

Computer‐vision and deep‐learning techniques are being increasingly applied to inspect, monitor, and assess infrastructure conditions including detection of cracks. Traditional vision‐based methods to detect cracks lack accuracy and generalization to work on complicated infrastructural conditions. This paper presents a novel context‐aware deep convolutional semantic segmentation network to effectively detect cracks in structural infrastructure under various conditions. The proposed method applies a pixel‐wise deep semantic segmentation network to segment the cracks on images with arbitrary sizes without retraining the prediction network. Meanwhile, a context‐aware fusion algorithm that leverages local cross‐state and cross‐space constraints is proposed to fuse the predictions of image patches. This method is evaluated on three datasets: CrackForest Dataset (CFD) and Tomorrows Road Infrastructure Monitoring, Management Dataset (TRIMMD) and a Customized Field Test Dataset (CFTD) and achieves Boundary F1 (BF) score of 0.8234, 0.8252, and 0.7937 under 2‐pixel error tolerance margin in CFD, TRIMMD, and CFTD, respectively. The proposed method advances the state‐of‐the‐art performance of BF score by approximately 2.71% in CFD, 1.47% in TRIMMD, and 4.14% in CFTD. Moreover, the averaged processing time of the proposed system is 0.7 s on a typical desktop with Intel^® Quad‐Core? i7‐7700 CPU@3.6 GHz Processor, 16GB RAM and NVIDIA GeForce GTX 1060 6GB GPU for an image of size 256 × 256 pixels.     

Hybrid ensemble soft computing approach for predicting penetration rate of tunnel boring machine in a rock environment

This study implements a hybrid ensemble machine learning method for forecasting the rate of penetration (ROP) of tunnel boring machine (TBM), which is becoming a prerequisite for reliable cost assessment and project scheduling in tunnelling and underground projects in a rock environment. For this purpose, a sum of 185 datasets was collected from the literature and used to predict the ROP of TBM. Initially, the main dataset was utilised to construct and validate four conventional soft computing (CSC) models, i.e. minimax probability machine regression, relevance vector machine, extreme learning machine, and functional network. Consequently, the estimated outputs of CSC models were united and trained using an artificial neural network (ANN) to construct a hybrid ensemble model (HENSM). The outcomes of the proposed HENSM are superior to other CSC models employed in this study. Based on the experimental results (training RMSE = 0.0283 and testing RMSE = 0.0418), the newly proposed HENSM is potential to assist engineers in predicting ROP of TBM in the design phase of tunnelling and underground projects.     

Developing cation exchange capacity and soil index properties relationships using a neuro-fuzzy approach

Artificial intelligence methods are employed to predict cation exchange capacity (CEC) from five different soil index properties, namely specific surface area (SSA), liquid limit, plasticity index, activity (ACT), and clay fraction (CF). Artificial neural networks (ANNs) analyses were first employed to determine the most related index parameters with cation exchange capacity. For this purpose, 40 datasets were employed to train the network and 10 datasets were used to test it. The ANN analyses were conducted with 15 different input vector combinations using same datasets. As a result of this investigation, the ANN analyses revealed that SSA and ACT are the most effective parameters on the CEC. Next, based upon these most effective input parameters, the fuzzy logic (FL) model was developed for the CEC. In the developed FL model, triangular membership functions were employed for both the input (SSA and ACT) variables and the output variable (CEC). A total of nine Mamdani fuzzy rules were deduced from the datasets, used for the training of the ANN model. Minimization (min) inferencing, maximum (max) composition, and centroid defuzzification methods are employed for the constructed FL model. The developed FL model was then tested against the remaining datasets, which were also used for testing the ANN model. The prediction results are satisfactory with a determination coefficient, R ² = 0.94 and mean absolute error, (MAE) = 7.1.     

Forecasting short-term electricity load using hybrid support vector regression with grey catastrophe and random forest modeling

This paper develops a novel short-term load forecasting model that hybridizes several machine learning methods, such as support vector regression (SVR), grey catastrophe (GC (1,1)), and random forest (RF) modeling. The modeling process is based on the minimization of both SVR and risk. GC is used to process and extract catastrophe points in the long term to reduce randomness. RF is used to optimize forecasting performance by exploiting its superior optimization capability. The proposed SVR-GC-RF model has higher forecasting accuracy (MAPE values are 6.35% and 6.21%, respectively) using electric loads from Australian-Energy-Market-Operator; it can provide analytical support to forecast electricity consumption accurately.     

Application of machine learning in predicting the rate-dependent compressive strength of rocks

Accurate prediction of compressive strength of rocks relies on the rate-dependent behaviors of rocks, and correlation among the geometrical, physical, and mechanical properties of rocks. However, these properties may not be easy to control in laboratory experiments, particularly in dynamic compression experiments. By training three machine learning models based on the support vector machine (SVM), back-propagation neural network (BPNN), and random forest (RF) algorithms, we isolated different input parameters, such as static compressive strength, P-wave velocity, specimen dimension, grain size, bulk density, and strain rate, to identify their importance in the strength prediction. Our results demonstrated that the RF algorithm shows a better performance than the other two algorithms. The strain rate is a key input parameter influencing the performance of these models, while the others (e.g. static compressive strength and P-wave velocity) are less important as their roles can be compensated by alternative parameters. The results also revealed that the effect of specimen dimension on the rock strength can be overshadowed at high strain rates, while the effect on the dynamic increase factor (i.e. the ratio of dynamic to static compressive strength) becomes significant. The dynamic increase factors for different specimen dimensions bifurcate when the strain rate reaches a relatively high value, a clue to improve our understanding of the transitional behaviors of rocks from low to high strain rates.     

Assessment of different machine learning techniques in predicting the compressive strength of self-compacting concrete

The compressive strength of self-compacting concrete (SCC) needs to be determined during the construction design process. This paper shows that the compressive strength of SCC (CS of SCC) can be successfully predicted from mix design and curing age by a machine learning (ML) technique named the Extreme Gradient Boosting (XGB) algorithm, including non-hybrid and hybrid models. Nine ML techniques, such as Linear regression (LR), K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Decision Trees (DTR), Random Forest (RF), Gradient Boosting (GB), and Artificial Neural Network using two training algorithms LBFGS and SGD (denoted as ANN_LBFGS and ANN_SGD), are also compared with the XGB model. Moreover, the hybrid models of eight ML techniques and Particle Swarm Optimization (PSO) are constructed to highlight the reliability and accuracy of SCC compressive strength prediction by the XGB_PSO hybrid model. The highest number of SCC samples available in the literature is collected for building the ML techniques. Compared with previously published works’ performance, the proposed XGB method, both hybrid and non-hybrid models, is the most reliable and robust of the examined techniques, and is more accurate than existing ML methods (R² = 0.9644, RMSE = 4.7801, and MAE = 3.4832). Therefore, the XGB model can be used as a practical tool for engineers in predicting the CS of SCC.     

Optimization of machine learning models for predicting the compressive strength of fiber-reinforced self-compacting concrete

Fiber-reinforced self-compacting concrete (FRSCC) is a typical construction material, and its compressive strength (CS) is a critical mechanical property that must be adequately determined. In the machine learning (ML) approach to estimating the CS of FRSCC, the current research gaps include the limitations of samples in databases, the applicability constraints of models owing to limited mixture components, and the possibility of applying recently proposed models. This study developed different ML models for predicting the CS of FRSCC to address these limitations. Artificial neural network, random forest, and categorical gradient boosting (CatBoost) models were optimized to derive the best predictive model with the aid of a 10-fold cross-validation technique. A database of 381 samples was created, representing the most significant FRSCC dataset compared with previous studies, and it was used for model development. The findings indicated that CatBoost outperformed the other two models with excellent predictive abilities (root mean square error of 2.639 MPa, mean absolute error of 1.669 MPa, and coefficient of determination of 0.986 for the test dataset). Finally, a sensitivity analysis using a partial dependence plot was conducted to obtain a thorough understanding of the effect of each input variable on the predicted CS of FRSCC. The results showed that the cement content, testing age, and superplasticizer content are the most critical factors affecting the CS.     

A hierarchical system to predict behavior of soil and cantilever sheet wall by data-driven models

The study proposes a framework combining machine learning (ML) models into a logical hierarchical system which evaluates the stability of the sheet wall before other predictions. The study uses the hardening soil (HS) model to develop a 200-sample finite element analysis (FEA) database, to develop the ML models. Consequently, a system containing three trained ML models is proposed to first predict the stability status (random forest classification, RFC) followed by 1) the cantilever top horizontal displacement of sheet wall (artificial neural network regression models, RANN1) and 2) vertical settlement of soil (RANN2). The uncertainty of this data-driven system is partially investigated by developing 1000 RFC models, based on the application of random sampling technique in the data splitting process. Investigation on the distribution of the evaluation metrics reveals negative skewed data toward the 1.0000 value. This implies a high performance of RFC on the database with medians of accuracy, precision, and recall, on test set are 1.0000, 1.0000, and 0.92857, respectively. The regression ANN models have coefficient of determinations on test set, as high as 0.9521 for RANN1, and 0.9988 for RANN2, respectively. The parametric study for these regressions is also provided to evaluate the relative insight influence of inputs to output.     

Application of non-linear regression analysis and artificial intelligence algorithms for performance prediction of hard rock TBMs

Prediction of machine performance is an essential step for planning, cost estimation and selection of excavation method to assure success of tunneling operation by hard rock TBMs. Penetration rate is a principal measure of TBM performance and is used to evaluate the feasibility of using a machine in a given ground condition and to predict TBM advance rate. In this study, a database of TBM field performance from two hard rock tunneling projects in Iran including Zagros lot 1B and 2 for a total length of 14.3 km has been used to assess applicability of various analysis methods for developing reliable predictive models. The first method used for this purpose was principal component analysis (PCA) which resulted in development of a set of new empirical equations. Also, two Soft computing techniques including adaptive neuro-fuzzy inference system (ANFIS) and support vector regression (SVR) have been employed for this purpose. As statistical indices, root mean square error (RMSE), correlation coefficient (R²), variance account for (VAF), and mean absolute percentage error (MAPE) were used to evaluate the efficiency of the developed artificial intelligence models for TBM performance prediction. The results of the analysis show that AI based methods can effectively be implemented for prediction of TBM performance. Moreover, it was concluded that performance of the SVR model is better than the ANFIS model. A high correlation was observed between predicted and measured TBM performance for the SVR model. This study shows the feasibility of using these systems and subsequent work is underway to expand the database of TBM field performance and use the aforementioned methods to develop a more comprehensive TBM performance prediction model.