Tabular data: Deep learning is not all you need

A key element in solving real-life data science problems is selecting the types of models to use. Tree ensemble models (such as XGBoost) are usually recommended for classification and regression problems with tabular data. However, several deep learning models for tabular data have recently been proposed, claiming to outperform XGBoost for some use cases. This paper explores whether these deep models should be a recommended option for tabular data by rigorously comparing the new deep models to XGBoost on various datasets. In addition to systematically comparing their performance, we consider the tuning and computation they require. Our study shows that XGBoost outperforms these deep models across the datasets, including the datasets used in the papers that proposed the deep models. We also demonstrate that XGBoost requires much less tuning. On the positive side, we show that an ensemble of deep models and XGBoost performs better on these datasets than XGBoost alone.     

Breeding schemes with optimum-contribution selection or truncation selection for beef cattle destined for use on dairy females

We tested the hypothesis that the size of a beef cattle population destined for use on dairy females is smaller under optimum-contribution selection (OCS) than under truncation selection (TRS) at the same genetic gain (ΔG) and the same rate of inbreeding (ΔF). We used stochastic simulation to estimate true ΔG realized at a 0.005 ΔF in breeding schemes with OCS or TRS. The schemes for the beef cattle population also differed in the number of purebred offspring per dam and the total number of purebred offspring per generation. Dams of the next generation were exclusively selected among the one-year-old heifers. All dams were donors for embryo transfer and produced a maximum of 5 or 10 offspring. The total number of purebred offspring per generation was: 400, 800, 1,600 or 4,000 calves, and it was used as a measure of population size. Rate of inbreeding was predicted and controlled using pedigree relationships. Each OCS (TRS) scheme was simulated for 10 discrete generations and replicated 100 (200) times. The OCS scheme and the TRS scheme with a maximum of 10 offspring per dam required approximately 783 and 1,257 purebred offspring per generation to realize a true ΔG of €14 and a ΔF of 0.005 per generation. Schemes with a maximum of 5 offspring per dam required more purebred offspring per generation to realize a similar true ΔG and a similar ΔF. Our results show that OCS and multiple ovulation and embryo transfer act on selection intensity through different mechanisms to achieve fewer selection candidates and fewer selected sires and dams than under TRS at the same ΔG and a fixed ΔF. Therefore, we advocate the use of a breeding scheme with OCS and multiple ovulation and embryo transfer for beef cattle destined for use on dairy females because it is favorable both from an economic perspective and a carbon footprint perspective.     

Prediction of mode I fracture toughness of rock using linear multiple regression and gene expression programming

Prediction of mode I fracture toughness (K_IC) of rock is of significant importance in rock engineering analyses. In this study, linear multiple regression (LMR) and gene expression programming (GEP) methods were used to provide a reliable relationship to determine mode I fracture toughness of rock. The presented model was developed based on 60 datasets taken from the previous literature. To predict fracture parameters, three mechanical parameters of rock mass including uniaxial compressive strength (UCS), Brazilian tensile strength (BTS), and elastic modulus (E) have been selected as the input parameters. A cluster of data was collected and divided into two random groups of training and testing datasets. Then, different statistical linear and artificial intelligence based nonlinear analyses were conducted on the training data to provide a reliable prediction model of K_IC. These two predictive methods were then evaluated based on the testing data. To evaluate the efficiency of the proposed models for predicting the mode I fracture toughness of rock, various statistical indices including coefficient of determination (R²), root mean square error (RMSE), and mean absolute error (MAE) were utilized herein. In the case of testing datasets, the values of R², RMSE, and MAE for the GEP model were 0.87, 0.188, and 0.156, respectively, while they were 0.74, 0.473, and 0.223, respectively, for the LMR model. The results indicated that the selected GEP model delivered superior performance with a higher R² value and lower errors.     

Marine Phospholipids from Fishery By-Products Attenuate Atherosclerosis

In this study, the anti-atherosclerotic properties of three marine phospholipids (MPLs) extracts from fishery by-products including codfish roe, squid gonad, and shrimp head are verified. Their effects on key factors involved in atherosclerosis are examined and compared to explore whether the differences in their constitutions lead to the differences in the function. All three MPLs dampen oxidation of low- density lipoproteins (LDL) in vitro. Treating RAW264.7 macrophages and HUVECs endothelial cells with each MPLs ranging 10–100 µg mL⁻¹ does not decrease cell viability, yet ox-LDL caused cytotoxicity of both cells are alleviated by 50 or 100 µg mL⁻¹ MPLs treatment. In addition, the three MPLs reduce ox-LDL induced macrophage foam-like transition, mainly through inhibition of lipid uptake. Of the three MPLs, the one from squid gonad exhibits the best effect. On the other hand, all three MPLs modulate inflammatory responses, equally, by inhibiting the adhesion of monocytes to endothelial cells, and decreasing secretion of pro-inflammatory cytokines IL-6 and MCP-1. Using a high-cholesterol diet induced zebrafish model, it is found that all three MPLs, especially the one from squid gonad, alleviates cholesterol accumulation in early plaques, and decreases total cholesterol as well as lipid peroxide in vivo. Practical Applications: As a way of making the best of the increasingly scarce marine resources, valuable lipid components can be recovered from by-products and wastes from the fishery industry. Here, we tested the anti-atherosclerotic effects and the mechanisms of three MPLs extracted from codfish roe, squid gonad, and shrimp head. Our study provides further evidence that marine phospholipids extracted from fishery by-products could protect against atherosclerosis, and helps to elucidate the structure-function relationship of MPLs.     

Improved error performance for generalised spatial modulation with enhanced spectral efficiency

The existing analytical average bit error rate (ABER) expression of conventional generalised spatial modulation (CGSM) does not agree well with the Monte Carlo simulation results in the low signal‐to‐noise ratio (SNR) region. Hence, the first contribution of this paper is to derive a new and easy way to evaluate analytical ABER expression that improves the validation of the simulation results at low SNRs. Secondly, a novel system termed CGSM with enhanced spectral efficiency (CGSM‐ESE) is presented. This system is realised by applying a rotation angle to one of the two active transmit antennas. As a result, the overall spectral efficiency is increased by 1 bit/s/Hz when compared with the equivalent CGSM system. In order to validate the simulation results of CGSM‐ESE, the third contribution is to derive an analytical ABER expression. Finally, to improve the ABER performance of CGSM‐ESE, three link adaptation algorithms are developed. By assuming full knowledge of the channel at the receiver, the proposed algorithms select a subset of channel gain vector (CGV) pairs based on the Euclidean distance between all CGV pairs, CGV splitting, CGV amplitudes, or a combination of these.     

一种新的多渐消因子容积卡尔曼滤波

将强跟踪思想引入容积卡尔曼滤波（cubature Kalman filter，CKF），建立强跟踪CKF能有效克服CKF在模型不确定、状态突变等情况下，滤波性能下降的问题。通过分析现有多渐消因子计算方法，发现它们均只利用了协方差矩阵的对角线元素，并没有考虑各个状态之间的相关性，不能充分发挥多渐消因子的优势。为此，本文提出渐消因子矩阵，基于正交原理推导渐消因子矩阵的求解方法，提出多渐消因子强跟踪CKF算法。多渐消因子强跟踪CKF算法突破了传统多渐消因子为向量的限制，也不再要求渐消因子取值要大于1。仿真验证了算法具有更好的滤波精度何鲁棒性，能更好的满足工程应用的要求。     

Soft sensor for real-time cement fineness estimation

This paper describes the design and implementation of soft sensors to estimate cement fineness. Soft sensors are mathematical models that use available data to provide real-time information on process variables when the information, for whatever reason, is not available by direct measurement. In this application, soft sensors are used to provide information on process variable normally provided by off-line laboratory tests performed at large time intervals. Cement fineness is one of the crucial parameters that define the quality of produced cement. Providing real-time information on cement fineness using soft sensors can overcome limitations and problems that originate from a lack of information between two laboratory tests. The model inputs were selected from candidate process variables using an information theoretic approach. Models based on multi-layer perceptrons were developed, and their ability to estimate cement fineness of laboratory samples was analyzed. Models that had the best performance, and capacity to adopt changes in the cement grinding circuit were selected to implement soft sensors. Soft sensors were tested using data from a continuous cement production to demonstrate their use in real-time fineness estimation. Their performance was highly satisfactory, and the sensors proved to be capable of providing valuable information on cement grinding circuit performance. After successful off-line tests, soft sensors were implemented and installed in the control room of a cement factory. Results on the site confirm results obtained by tests conducted during soft sensor development.     

Questioning numerical integration methods for microsphere (and microplane) constitutive equations

In the last few years, more and more complex microsphere models have been proposed to predict the mechanical response of various polymers. Similarly than for microplane models, they consist in deriving a one-dimensional force vs. stretch equation and to integrate it over the unit sphere to obtain a three-dimensional constitutive equation. In this context, the focus of authors is laid on the physics of the one-dimensional relationship, but in most of the case the influence of the integration method on the prediction is not investigated.Here we compare three numerical integration schemes: a classical Gaussian scheme, a method based on a regular geometric meshing of the sphere, and an approach based on spherical harmonics. Depending on the method, the number of integration points may vary from 4 to 983,040! Considering simple quantities, i.e. principal (large) strain invariants, it is shown that the integration method must be carefully chosen. Depending on the quantities retained to described the one-dimensional equation and the required error, the performances of the three methods are discussed. Consequences on stress–strain prediction are illustrated with a directional version of the classical Mooney–Rivlin hyperelastic model. Finally, the paper closes with some advices for the development of new microsphere constitutive equations.     

Towards a Better Prediction of Cell Settling on Nanostructure Arrays—Simple Means to Complicated Ends

Vertical arrays of nanostructures (NSs) are emerging as promising platforms for probing and manipulating live mammalian cells. The broad range of applications requires different types of interfaces, but cell settling on NS arrays is not yet fully controlled and understood. Cells are both seen to deform completely into NS arrays and to stay suspended like tiny fakirs, which have hitherto been explained with differences in NS spacing or density. Here, a better understanding of this phenomenon is provided by using a model that takes into account the extreme membrane deformation needed for a cell to settle into a NS array. It is shown that, in addition to the NS density, cell settling depends strongly on the dimensions of the single NS, and that the settling can be predicted for a given NS array geometry. The predictive power of the model is confirmed by experiments and good agreement with cases from the literature. Furthermore, the influence of cell‐related parameters is evaluated theoretically and a generic method of tuning cell settling through surface coating is demonstrated experimentally. These findings allow a more rational design of NS arrays for the numerous exciting biological applications where the mode of cell settling is crucial.     

State-space ARIMA for supply-chain forecasting

ARIMA is seldom used in supply chains in practice. There are several reasons, not the least of which is the small sample size of available data, which restricts the usage of the model. Keeping in mind this restriction, we discuss in this paper a state-space ARIMA model with a single source of error and show how it can be efficiently used in the supply-chain context, especially in cases when only two seasonal cycles of data are available. We propose a new order selection algorithm for the model and compare its performance with the conventional ARIMA on real data. We show that the proposed model performs well in terms of both accuracy and computational time in comparison with other ARIMA implementations, which makes it efficient in the supply-chain context.