Tabular data: Deep learning is not all you need

A key element in solving real-life data science problems is selecting the types of models to use. Tree ensemble models (such as XGBoost) are usually recommended for classification and regression problems with tabular data. However, several deep learning models for tabular data have recently been proposed, claiming to outperform XGBoost for some use cases. This paper explores whether these deep models should be a recommended option for tabular data by rigorously comparing the new deep models to XGBoost on various datasets. In addition to systematically comparing their performance, we consider the tuning and computation they require. Our study shows that XGBoost outperforms these deep models across the datasets, including the datasets used in the papers that proposed the deep models. We also demonstrate that XGBoost requires much less tuning. On the positive side, we show that an ensemble of deep models and XGBoost performs better on these datasets than XGBoost alone.     

No-Reference Video Quality Assessment using novel hybrid features and two-stage hybrid regression for score level fusion

This paper presents a novel No-Reference Video Quality Assessment (NR-VQA) model that utilizes proposed 3D steerable wavelet transform-based Natural Video Statistics (NVS) features as well as human perceptual features. Additionally, we proposed a novel two-stage regression scheme that significantly improves the overall performance of quality estimation. In the first stage, transform-based NVS and human perceptual features are separately passed through the proposed hybrid regression scheme: Support Vector Regression (SVR) followed by Polynomial curve fitting. The two visual quality scores predicted from the first stage are then used as features for the similar second stage. This predicts the final quality scores of distorted videos by achieving score level fusion. Extensive experiments were conducted using five authentic and four synthetic distortion databases. Experimental results demonstrate that the proposed method outperforms other published state-of-the-art benchmark methods on synthetic distortion databases and is among the top performers on authentic distortion databases. The source code is available at https://github.com/anishVNIT/two-stage-vqa.     

Prediction of Flooding in Packed Liquid-Liquid and High-Pressure Extraction Columns Using a Gaussian Process

Reliable prediction of flooding conditions is needed for sizing and operating packed extraction columns. Due to the complex interplay of physicochemical properties, operational parameters and the packing-specific properties, it is challenging to develop accurate semi-empirical or rigorous models with a high validity range. State of the art models may therefore fail to predict flooding accurately. To overcome this problem, a data-driven model based on Gaussian processes is developed to predict flooding for packed liquid-liquid and high-pressure extraction columns. The optimized Gaussian process for the liquid-liquid extraction column results in an average absolute relative error (AARE) of 15.23 %, whereas the algorithm for the high-pressure extraction column results in an AARE of 13.68 %. Both algorithms can predict flooding curves for different packing geometries and chemical systems precisely.     

Marine Phospholipids from Fishery By-Products Attenuate Atherosclerosis

In this study, the anti-atherosclerotic properties of three marine phospholipids (MPLs) extracts from fishery by-products including codfish roe, squid gonad, and shrimp head are verified. Their effects on key factors involved in atherosclerosis are examined and compared to explore whether the differences in their constitutions lead to the differences in the function. All three MPLs dampen oxidation of low- density lipoproteins (LDL) in vitro. Treating RAW264.7 macrophages and HUVECs endothelial cells with each MPLs ranging 10–100 µg mL⁻¹ does not decrease cell viability, yet ox-LDL caused cytotoxicity of both cells are alleviated by 50 or 100 µg mL⁻¹ MPLs treatment. In addition, the three MPLs reduce ox-LDL induced macrophage foam-like transition, mainly through inhibition of lipid uptake. Of the three MPLs, the one from squid gonad exhibits the best effect. On the other hand, all three MPLs modulate inflammatory responses, equally, by inhibiting the adhesion of monocytes to endothelial cells, and decreasing secretion of pro-inflammatory cytokines IL-6 and MCP-1. Using a high-cholesterol diet induced zebrafish model, it is found that all three MPLs, especially the one from squid gonad, alleviates cholesterol accumulation in early plaques, and decreases total cholesterol as well as lipid peroxide in vivo. Practical Applications: As a way of making the best of the increasingly scarce marine resources, valuable lipid components can be recovered from by-products and wastes from the fishery industry. Here, we tested the anti-atherosclerotic effects and the mechanisms of three MPLs extracted from codfish roe, squid gonad, and shrimp head. Our study provides further evidence that marine phospholipids extracted from fishery by-products could protect against atherosclerosis, and helps to elucidate the structure-function relationship of MPLs.     

Flexible Distribution-Based Regression Models for Count Data: Application to Medical Diagnosis

Abstract

Data mining techniques have been successfully utilized in different applications of significant fields, including medical research. With the wealth of data available within the health-care systems, there is a lack of practical analysis tools to discover hidden relationships and trends in data. The complexity of medical data that is unfavorable for most models is a considerable challenge in prediction. The ability of a model to perform accurately and efficiently in disease diagnosis is extremely significant. Thus, the model must be selected to fit the data better, such that the learning from previous data is most efficient, and the diagnosis of the disease is highly accurate. This work is motivated by the limited number of regression analysis tools for multivariate counts in the literature. We propose two regression models for count data based on flexible distributions, namely, the multinomial Beta-Liouville and multinomial scaled Dirichlet, and evaluated the proposed models in the problem of disease diagnosis. The performance is evaluated based on the accuracy of the prediction which depends on the nature and complexity of the dataset. Our results show the efficiency of the two proposed regression models where the prediction performance of both models is competitive to other previously used regression models for count data and to the best results in the literature.     

Soft sensor for real-time cement fineness estimation

This paper describes the design and implementation of soft sensors to estimate cement fineness. Soft sensors are mathematical models that use available data to provide real-time information on process variables when the information, for whatever reason, is not available by direct measurement. In this application, soft sensors are used to provide information on process variable normally provided by off-line laboratory tests performed at large time intervals. Cement fineness is one of the crucial parameters that define the quality of produced cement. Providing real-time information on cement fineness using soft sensors can overcome limitations and problems that originate from a lack of information between two laboratory tests. The model inputs were selected from candidate process variables using an information theoretic approach. Models based on multi-layer perceptrons were developed, and their ability to estimate cement fineness of laboratory samples was analyzed. Models that had the best performance, and capacity to adopt changes in the cement grinding circuit were selected to implement soft sensors. Soft sensors were tested using data from a continuous cement production to demonstrate their use in real-time fineness estimation. Their performance was highly satisfactory, and the sensors proved to be capable of providing valuable information on cement grinding circuit performance. After successful off-line tests, soft sensors were implemented and installed in the control room of a cement factory. Results on the site confirm results obtained by tests conducted during soft sensor development.     

Questioning numerical integration methods for microsphere (and microplane) constitutive equations

In the last few years, more and more complex microsphere models have been proposed to predict the mechanical response of various polymers. Similarly than for microplane models, they consist in deriving a one-dimensional force vs. stretch equation and to integrate it over the unit sphere to obtain a three-dimensional constitutive equation. In this context, the focus of authors is laid on the physics of the one-dimensional relationship, but in most of the case the influence of the integration method on the prediction is not investigated.Here we compare three numerical integration schemes: a classical Gaussian scheme, a method based on a regular geometric meshing of the sphere, and an approach based on spherical harmonics. Depending on the method, the number of integration points may vary from 4 to 983,040! Considering simple quantities, i.e. principal (large) strain invariants, it is shown that the integration method must be carefully chosen. Depending on the quantities retained to described the one-dimensional equation and the required error, the performances of the three methods are discussed. Consequences on stress–strain prediction are illustrated with a directional version of the classical Mooney–Rivlin hyperelastic model. Finally, the paper closes with some advices for the development of new microsphere constitutive equations.     

Output-relevant Variational autoencoder for Just-in-time soft sensor modeling with missing data

Main challenges for developing data-based models lie in the existence of high-dimensional and possibly missing observations that exist in stored data from industry process. Variational autoencoder (VAE) as one of the deep learning methods has been applied for extracting useful information or features from high-dimensional dataset. Considering that existing VAE is unsupervised, an output-relevant VAE is proposed for extracting output-relevant features in this work. By using correlation between process variables, different weight is correspondingly assigned to each input variable. With symmetric Kullback–Leibler (SKL) divergence, the similarity is evaluated between the stored samples and a query sample. According to the values of the SKL divergence, data relevant for modeling are selected. Subsequently, Gaussian process regression (GPR) is utilized to establish a model between the input and the corresponding output at the query sample. In addition, owing to the common existence of missing data in output data set, the parameters and missing data in the GPR are estimated simultaneously. A practical debutanizer industrial process is utilized to illustrate the effectiveness of the proposed method.     

Economic growth,CO2 emissions,and energy consumption in the five ASEAN countries

This paper investigates the relationship between economic growth, carbon dioxide (CO₂) emissions, and energy consumption with an aim to test the validity of the Environmental Kuznets Curve (EKC) hypothesis in five ASEAN (Association of South East Asian Nations) countries (Indonesia, Malaysia, Philippines, Singapore, and Thailand) by applying the panel smooth transition regression (PSTR) model as a new econometric technique. The PSTR model is more flexible and appropriate for describing cross-country heterogeneity and time instability. Our empirical results strongly rejected the null hypothesis of linearity, and the test for no remaining nonlinearity indicated a model with one transition function and two threshold parameters. The first regime (levels of GDP per capita below 4686 USD) showed that environmental degradation increases with economic growth while the trend was reversed in the second regime (GDP per capita above 4686 USD). The results also showed that energy consumption with either the first or the second regime lead to increase CO₂. The overall results support the validity of the EKC hypothesis in the ASEAN countries.     

Towards a Better Prediction of Cell Settling on Nanostructure Arrays—Simple Means to Complicated Ends

Vertical arrays of nanostructures (NSs) are emerging as promising platforms for probing and manipulating live mammalian cells. The broad range of applications requires different types of interfaces, but cell settling on NS arrays is not yet fully controlled and understood. Cells are both seen to deform completely into NS arrays and to stay suspended like tiny fakirs, which have hitherto been explained with differences in NS spacing or density. Here, a better understanding of this phenomenon is provided by using a model that takes into account the extreme membrane deformation needed for a cell to settle into a NS array. It is shown that, in addition to the NS density, cell settling depends strongly on the dimensions of the single NS, and that the settling can be predicted for a given NS array geometry. The predictive power of the model is confirmed by experiments and good agreement with cases from the literature. Furthermore, the influence of cell‐related parameters is evaluated theoretically and a generic method of tuning cell settling through surface coating is demonstrated experimentally. These findings allow a more rational design of NS arrays for the numerous exciting biological applications where the mode of cell settling is crucial.