Tabular data: Deep learning is not all you need

A key element in solving real-life data science problems is selecting the types of models to use. Tree ensemble models (such as XGBoost) are usually recommended for classification and regression problems with tabular data. However, several deep learning models for tabular data have recently been proposed, claiming to outperform XGBoost for some use cases. This paper explores whether these deep models should be a recommended option for tabular data by rigorously comparing the new deep models to XGBoost on various datasets. In addition to systematically comparing their performance, we consider the tuning and computation they require. Our study shows that XGBoost outperforms these deep models across the datasets, including the datasets used in the papers that proposed the deep models. We also demonstrate that XGBoost requires much less tuning. On the positive side, we show that an ensemble of deep models and XGBoost performs better on these datasets than XGBoost alone.     

Identifying catalyst layer compositions of proton exchange membrane fuel cells through machine-learning-based approach

Membrane electrode assembly (MEA) is considered a key component of a proton exchange membrane fuel cell (PEMFC). However, developing a new MEA to meet desired properties, such as operation under low-humidity conditions without a humidifier, is a time- and cost-consuming process. This study employs a machine-learning-based approach using K-nearest neighbor (KNN) and neural networks (NN) in the MEA development process by identifying a suitable catalyst layer (CL) recipe in MEA. Minimum redundancy maximum relevance and principal component analysis were implemented to specify the most important predictor and reduce the data dimension. The number of predictors was found to play an essential role in the accuracy of the KNN and NN models although the predictors have self-correlations. The KNN model with a K of 7 was found to minimize the model loss with a loss of 11.9%. The NN model constructed by three corresponding hidden layers with nine, eight, and nine nodes can achieve the lowest error of 0.1293 for the Pt catalyst and 0.031 for PVA as a good additive blending in the CL of the MEA. However, even if the error is low, the prediction of PVA seems to be inaccurate, regardless of the model structure. Therefore, the KNN model is more appropriate for CL recipe prediction.     

Marine Phospholipids from Fishery By-Products Attenuate Atherosclerosis

In this study, the anti-atherosclerotic properties of three marine phospholipids (MPLs) extracts from fishery by-products including codfish roe, squid gonad, and shrimp head are verified. Their effects on key factors involved in atherosclerosis are examined and compared to explore whether the differences in their constitutions lead to the differences in the function. All three MPLs dampen oxidation of low- density lipoproteins (LDL) in vitro. Treating RAW264.7 macrophages and HUVECs endothelial cells with each MPLs ranging 10–100 µg mL⁻¹ does not decrease cell viability, yet ox-LDL caused cytotoxicity of both cells are alleviated by 50 or 100 µg mL⁻¹ MPLs treatment. In addition, the three MPLs reduce ox-LDL induced macrophage foam-like transition, mainly through inhibition of lipid uptake. Of the three MPLs, the one from squid gonad exhibits the best effect. On the other hand, all three MPLs modulate inflammatory responses, equally, by inhibiting the adhesion of monocytes to endothelial cells, and decreasing secretion of pro-inflammatory cytokines IL-6 and MCP-1. Using a high-cholesterol diet induced zebrafish model, it is found that all three MPLs, especially the one from squid gonad, alleviates cholesterol accumulation in early plaques, and decreases total cholesterol as well as lipid peroxide in vivo. Practical Applications: As a way of making the best of the increasingly scarce marine resources, valuable lipid components can be recovered from by-products and wastes from the fishery industry. Here, we tested the anti-atherosclerotic effects and the mechanisms of three MPLs extracted from codfish roe, squid gonad, and shrimp head. Our study provides further evidence that marine phospholipids extracted from fishery by-products could protect against atherosclerosis, and helps to elucidate the structure-function relationship of MPLs.     

Predicting Prostephanus truncatus (Horn) (Coleoptera: Bostrichidae) populations and associated grain damage in smallholder farmers’ maize stores: A machine learning approach

Prostephanus truncatus is a notorious pest of stored-maize grain and its spread throughout sub-Saharan Africa has led to increased levels of grain storage losses. The current study developed models to predict the level of P. truncatus infestation and associated damage of maize grain in smallholder farmer stores. Data were gathered from grain storage trials conducted in Hwedza and Mbire districts of Zimbabwe and correlated with weather data for each site. Insect counts of P. truncatus and other common stored grain insect pests had a strong correlation with time of year with highest recorded numbers from January to May. Correlation analysis showed insect-generated grain dust from boring and feeding activity to be the best indicator of P. truncatus presence in stores (r = 0.70), while a moderate correlation (r = 0.48) was found between P. truncatus numbers and storage insect parasitic wasps, and grain damage levels significantly correlated with the presence of Tribolium castaneum (r = 0.60). Models were developed for predicting P. truncatus infestation and grain damage using parameter selection algorithms and decision-tree machine learning algorithms with 10-fold cross-validation. The P. truncatus population size prediction model performance was weak (r = 0.43) due to the complicated sampling and detection of the pest and eight-week long period between sampling events. The grain damage prediction model had a stronger correlation coefficient (r = 0.93) and is a good estimator for in situ stored grain insect damage. The models were developed for use under southern African climatic conditions and can be improved with more input data to create more precise models for building decision-support tools for smallholder maize-based production systems.     

Soft sensor for real-time cement fineness estimation

This paper describes the design and implementation of soft sensors to estimate cement fineness. Soft sensors are mathematical models that use available data to provide real-time information on process variables when the information, for whatever reason, is not available by direct measurement. In this application, soft sensors are used to provide information on process variable normally provided by off-line laboratory tests performed at large time intervals. Cement fineness is one of the crucial parameters that define the quality of produced cement. Providing real-time information on cement fineness using soft sensors can overcome limitations and problems that originate from a lack of information between two laboratory tests. The model inputs were selected from candidate process variables using an information theoretic approach. Models based on multi-layer perceptrons were developed, and their ability to estimate cement fineness of laboratory samples was analyzed. Models that had the best performance, and capacity to adopt changes in the cement grinding circuit were selected to implement soft sensors. Soft sensors were tested using data from a continuous cement production to demonstrate their use in real-time fineness estimation. Their performance was highly satisfactory, and the sensors proved to be capable of providing valuable information on cement grinding circuit performance. After successful off-line tests, soft sensors were implemented and installed in the control room of a cement factory. Results on the site confirm results obtained by tests conducted during soft sensor development.     

Questioning numerical integration methods for microsphere (and microplane) constitutive equations

In the last few years, more and more complex microsphere models have been proposed to predict the mechanical response of various polymers. Similarly than for microplane models, they consist in deriving a one-dimensional force vs. stretch equation and to integrate it over the unit sphere to obtain a three-dimensional constitutive equation. In this context, the focus of authors is laid on the physics of the one-dimensional relationship, but in most of the case the influence of the integration method on the prediction is not investigated.Here we compare three numerical integration schemes: a classical Gaussian scheme, a method based on a regular geometric meshing of the sphere, and an approach based on spherical harmonics. Depending on the method, the number of integration points may vary from 4 to 983,040! Considering simple quantities, i.e. principal (large) strain invariants, it is shown that the integration method must be carefully chosen. Depending on the quantities retained to described the one-dimensional equation and the required error, the performances of the three methods are discussed. Consequences on stress–strain prediction are illustrated with a directional version of the classical Mooney–Rivlin hyperelastic model. Finally, the paper closes with some advices for the development of new microsphere constitutive equations.     

Towards a Better Prediction of Cell Settling on Nanostructure Arrays—Simple Means to Complicated Ends

Vertical arrays of nanostructures (NSs) are emerging as promising platforms for probing and manipulating live mammalian cells. The broad range of applications requires different types of interfaces, but cell settling on NS arrays is not yet fully controlled and understood. Cells are both seen to deform completely into NS arrays and to stay suspended like tiny fakirs, which have hitherto been explained with differences in NS spacing or density. Here, a better understanding of this phenomenon is provided by using a model that takes into account the extreme membrane deformation needed for a cell to settle into a NS array. It is shown that, in addition to the NS density, cell settling depends strongly on the dimensions of the single NS, and that the settling can be predicted for a given NS array geometry. The predictive power of the model is confirmed by experiments and good agreement with cases from the literature. Furthermore, the influence of cell‐related parameters is evaluated theoretically and a generic method of tuning cell settling through surface coating is demonstrated experimentally. These findings allow a more rational design of NS arrays for the numerous exciting biological applications where the mode of cell settling is crucial.     

State-space ARIMA for supply-chain forecasting

ARIMA is seldom used in supply chains in practice. There are several reasons, not the least of which is the small sample size of available data, which restricts the usage of the model. Keeping in mind this restriction, we discuss in this paper a state-space ARIMA model with a single source of error and show how it can be efficiently used in the supply-chain context, especially in cases when only two seasonal cycles of data are available. We propose a new order selection algorithm for the model and compare its performance with the conventional ARIMA on real data. We show that the proposed model performs well in terms of both accuracy and computational time in comparison with other ARIMA implementations, which makes it efficient in the supply-chain context.     

A unified critical state model for geomaterials with an application to tunnelling

This paper is prepared in honour of Professor E.T. Brown for his outstanding contributions to rock mechanics and geotechnical engineering and also for his personal influence on the first author's research career in geomechanics and geotechnical engineering. As a result, we have picked a topic that reflects two key research areas in which Professor E.T. Brown has made seminal contributions over a long and distinguished career. These two areas are concerned with the application of the critical state concept to modelling geomaterials and the analysis of underground excavation or tunnelling in geomaterials.Partially due to Professor Brown's influence, the first author has also been conducting research in these two areas over many years. In particular, this paper aims to describe briefly the development of a unified critical state model for geomaterials together with an application to cavity contraction problems and tunnelling in soils.