Tabular data: Deep learning is not all you need

A key element in solving real-life data science problems is selecting the types of models to use. Tree ensemble models (such as XGBoost) are usually recommended for classification and regression problems with tabular data. However, several deep learning models for tabular data have recently been proposed, claiming to outperform XGBoost for some use cases. This paper explores whether these deep models should be a recommended option for tabular data by rigorously comparing the new deep models to XGBoost on various datasets. In addition to systematically comparing their performance, we consider the tuning and computation they require. Our study shows that XGBoost outperforms these deep models across the datasets, including the datasets used in the papers that proposed the deep models. We also demonstrate that XGBoost requires much less tuning. On the positive side, we show that an ensemble of deep models and XGBoost performs better on these datasets than XGBoost alone.     

Noncentrosymmetric Tetrel Pnictides RuSi4P4 and IrSi3P3: Nonlinear Optical Materials with Outstanding Laser Damage Threshold

Noncentrosymmetric (NCS) tetrel pnictides have recently generated interest as nonlinear optical (NLO) materials due to their second harmonic generation (SHG) activity and large laser damage threshold (LDT). Herein nonmetal-rich silicon phosphides RuSi₄P₄ and IrSi₃P₃ are synthesized and characterized. Their crystal structures are reinvestigated using single crystal X-ray diffraction and ²⁹Si and ³¹P magic angle spinning NMR. In agreement with previous report RuSi₄P₄ crystallizes in NCS space group P1, while IrSi₃P₃ is found to crystallize in NCS space group Cm, in contrast with the previously reported space group C2. A combination of DFT calculations and diffuse reflectance measurements reveals RuSi₄P₄ and IrSi₃P₃ to be wide bandgap (E_g) semiconductors, E_g = 1.9 and 1.8 eV, respectively. RuSi₄P₄ and IrSi₃P₃ outperform the current state-of-the-art infrared SHG material, AgGaS₂, both in SHG activity and laser inducer damage threshold. Due to the combination of high thermal stabilities (up to 1373 K), wide bandgaps (≈2 eV), NCS crystal structures, strong SHG responses, and large LDT values, RuSi₄P₄ and IrSi₃P₃ are promising candidates for longer wavelength NLO materials.     

Systemic Inflammation and the Breakdown of Intestinal Homeostasis Are Key Events in Chronic Spinal Cord Injury Patients

Our aim was to investigate the subset distribution and function of circulating monocytes, proinflammatory cytokine levels, gut barrier damage, and bacterial translocation in chronic spinal cord injury (SCI) patients. Thus, 56 SCI patients and 28 healthy donors were studied. The levels of circulating CD14^+highCD16⁻, CD14^+highCD16⁺, and CD14^+lowCD16⁺ monocytes, membrane TLR2, TLR4, and TLR9, phagocytic activity, ROS generation, and intracytoplasmic TNF-α, IL-1, IL-6, and IL-10 after lipopolysaccharide (LPS) stimulation were analyzed by polychromatic flow cytometry. Serum TNF-α, IL-1, IL-6 and IL-10 levels were measured by Luminex and LPS-binding protein (LBP), intestinal fatty acid-binding protein (I-FABP) and zonulin by ELISA. SCI patients had normal monocyte counts and subset distribution. CD14^+highCD16⁻ and CD14^+highCD16⁺ monocytes exhibited decreased TLR4, normal TLR2 and increased TLR9 expression. CD14^+highCD16⁻ monocytes had increased LPS-induced TNF-α but normal IL-1, IL-6, and IL-10 production. Monocytes exhibited defective phagocytosis but normal ROS production. Patients had enhanced serum TNF-α and IL-6 levels, normal IL-1 and IL-10 levels, and increased circulating LBP, I-FABP, and zonulin levels. Chronic SCI patients displayed impaired circulating monocyte function. These patients exhibited a systemic proinflammatory state characterized by enhanced serum TNF-α and IL-6 levels. These patients also had increased bacterial translocation and gut barrier damage.     

Centimeter-scale low-damage micromachining on single-crystal 4H–SiC substrates using a femtosecond laser with square-shaped Flat-Top focus spots

Femtosecond (fs) lasers have been proved to be reliable tools for high-precision and high-quality micromachining of ceramic materials. Nevertheless, fs laser processing using a single-mode beam with a Gaussian intensity distribution is difficult to obtain large-area flat and uniform processed surfaces. In this study, we utilize a customized diffractive optical element (DOE) to redistribute the laser pulse energy from Gaussian to square-shaped Flat-Top profile to realize centimeter-scale low-damage micromachining on single-crystal 4H–SiC substrates. We systematically investigated the effects of processing parameters on the changes in surface morphology and composition, and an optimal processing strategy was provided. Mechanisms of the formation of surface nanoparticles and the removal of surface micro-burrs were discussed. We also examined the distribution of subsurface defects caused by fs laser processing by removing a thin surface layer with a certain depth through chemical mechanical polishing (CMP). Our results show that laser-induced periodic surface structures (LIPSSs) covered by fine SiO₂ nanoparticles form on the fs laser-processed areas. Under optimal parameters, the redeposition of SiO₂ nanoparticles can be minimized, and the surface roughness Sa of processed areas reaches 120 ± 8 nm after the removal of a 10 μm thick surface layer. After the laser processing, micro-burrs on original surfaces are effectively removed, and thus the average profile roughness Rz of 2 mm long surface profiles decreases from 920 ± 120 nm to 286 ± 90 nm. No visible micro-pits can be found after removing ~1 μm thick surface layer from the laser-processed substrates.     

The Age-Sensitive Efficacy of Calorie Restriction on Mitochondrial Biogenesis and mtDNA Damage in Rat Liver

Calorie restriction (CR) is the most efficacious treatment to delay the onset of age-related changes such as mitochondrial dysfunction. However, the sensitivity of mitochondrial markers to CR and the age-related boundaries of CR efficacy are not fully elucidated. We used liver samples from ad libitum-fed (AL) rats divided in: 18-month-old (AL-18), 28-month-old (AL-28), and 32-month-old (AL-32) groups, and from CR-treated (CR) 28-month-old (CR-28) and 32-month-old (CR-32) counterparts to assay the effect of CR on several mitochondrial markers. The age-related decreases in citrate synthase activity, in TFAM, MFN2, and DRP1 protein amounts and in the mtDNA content in the AL-28 group were prevented in CR-28 counterparts. Accordingly, CR reduced oxidative mtDNA damage assessed through the incidence of oxidized purines at specific mtDNA regions in CR-28 animals. These findings support the anti-aging effect of CR up to 28 months. Conversely, the protein amounts of LonP1, Cyt c, OGG1, and APE1 and the 4.8 Kb mtDNA deletion content were not affected in CR-28 rats. The absence of significant differences between the AL-32 values and the CR-32 counterparts suggests an age-related boundary of CR efficacy at this age. However, this only partially curtails the CR benefits in counteracting the generalized aging decline and the related mitochondrial involvement.     

Adaptation to Endoplasmic Reticulum Stress Enhances Resistance of Oral Cancer Cells to Cisplatin by Up-Regulating Polymerase η and Increasing DNA Repair Efficiency

Endoplasmic reticulum (ER) stress response is an adaptive program to cope with cellular stress that disturbs the function and homeostasis of ER, which commonly occurs during cancer progression to late stage. Late-stage cancers, mostly requiring chemotherapy, often develop treatment resistance. Chemoresistance has been linked to ER stress response; however, most of the evidence has come from studies that correlate the expression of stress markers with poor prognosis or demonstrate proapoptosis by the knockdown of stress-responsive genes. Since ER stress in cancers usually persists and is essentially not induced by genetic manipulations, we used low doses of ER stress inducers at levels that allowed cell adaptation to occur in order to investigate the effect of stress response on chemoresistance. We found that prolonged tolerable ER stress promotes mesenchymal–epithelial transition, slows cell-cycle progression, and delays the S-phase exit. Consequently, cisplatin-induced apoptosis was significantly decreased in stress-adapted cells, implying their acquisition of cisplatin resistance. Molecularly, we found that proliferating cell nuclear antigen (PCNA) ubiquitination and the expression of polymerase η, the main polymerase responsible for translesion synthesis across cisplatin-DNA damage, were up-regulated in ER stress-adaptive cells, and their enhanced cisplatin resistance was abrogated by the knockout of polymerase η. We also found that a fraction of p53 in stress-adapted cells was translocated to the nucleus, and that these cells exhibited a significant decline in the level of cisplatin-DNA damage. Consistently, we showed that the nuclear p53 coincided with strong positivity of glucose-related protein 78 (GRP78) on immunostaining of clinical biopsies, and the cisplatin-based chemotherapy was less effective for patients with high levels of ER stress. Taken together, this study uncovers that adaptation to ER stress enhances DNA repair and damage tolerance, with which stressed cells gain resistance to chemotherapeutics.     

Marine Phospholipids from Fishery By-Products Attenuate Atherosclerosis

In this study, the anti-atherosclerotic properties of three marine phospholipids (MPLs) extracts from fishery by-products including codfish roe, squid gonad, and shrimp head are verified. Their effects on key factors involved in atherosclerosis are examined and compared to explore whether the differences in their constitutions lead to the differences in the function. All three MPLs dampen oxidation of low- density lipoproteins (LDL) in vitro. Treating RAW264.7 macrophages and HUVECs endothelial cells with each MPLs ranging 10–100 µg mL⁻¹ does not decrease cell viability, yet ox-LDL caused cytotoxicity of both cells are alleviated by 50 or 100 µg mL⁻¹ MPLs treatment. In addition, the three MPLs reduce ox-LDL induced macrophage foam-like transition, mainly through inhibition of lipid uptake. Of the three MPLs, the one from squid gonad exhibits the best effect. On the other hand, all three MPLs modulate inflammatory responses, equally, by inhibiting the adhesion of monocytes to endothelial cells, and decreasing secretion of pro-inflammatory cytokines IL-6 and MCP-1. Using a high-cholesterol diet induced zebrafish model, it is found that all three MPLs, especially the one from squid gonad, alleviates cholesterol accumulation in early plaques, and decreases total cholesterol as well as lipid peroxide in vivo. Practical Applications: As a way of making the best of the increasingly scarce marine resources, valuable lipid components can be recovered from by-products and wastes from the fishery industry. Here, we tested the anti-atherosclerotic effects and the mechanisms of three MPLs extracted from codfish roe, squid gonad, and shrimp head. Our study provides further evidence that marine phospholipids extracted from fishery by-products could protect against atherosclerosis, and helps to elucidate the structure-function relationship of MPLs.     

Predicting Prostephanus truncatus (Horn) (Coleoptera: Bostrichidae) populations and associated grain damage in smallholder farmers’ maize stores: A machine learning approach

Prostephanus truncatus is a notorious pest of stored-maize grain and its spread throughout sub-Saharan Africa has led to increased levels of grain storage losses. The current study developed models to predict the level of P. truncatus infestation and associated damage of maize grain in smallholder farmer stores. Data were gathered from grain storage trials conducted in Hwedza and Mbire districts of Zimbabwe and correlated with weather data for each site. Insect counts of P. truncatus and other common stored grain insect pests had a strong correlation with time of year with highest recorded numbers from January to May. Correlation analysis showed insect-generated grain dust from boring and feeding activity to be the best indicator of P. truncatus presence in stores (r = 0.70), while a moderate correlation (r = 0.48) was found between P. truncatus numbers and storage insect parasitic wasps, and grain damage levels significantly correlated with the presence of Tribolium castaneum (r = 0.60). Models were developed for predicting P. truncatus infestation and grain damage using parameter selection algorithms and decision-tree machine learning algorithms with 10-fold cross-validation. The P. truncatus population size prediction model performance was weak (r = 0.43) due to the complicated sampling and detection of the pest and eight-week long period between sampling events. The grain damage prediction model had a stronger correlation coefficient (r = 0.93) and is a good estimator for in situ stored grain insect damage. The models were developed for use under southern African climatic conditions and can be improved with more input data to create more precise models for building decision-support tools for smallholder maize-based production systems.     

Soft sensor for real-time cement fineness estimation

This paper describes the design and implementation of soft sensors to estimate cement fineness. Soft sensors are mathematical models that use available data to provide real-time information on process variables when the information, for whatever reason, is not available by direct measurement. In this application, soft sensors are used to provide information on process variable normally provided by off-line laboratory tests performed at large time intervals. Cement fineness is one of the crucial parameters that define the quality of produced cement. Providing real-time information on cement fineness using soft sensors can overcome limitations and problems that originate from a lack of information between two laboratory tests. The model inputs were selected from candidate process variables using an information theoretic approach. Models based on multi-layer perceptrons were developed, and their ability to estimate cement fineness of laboratory samples was analyzed. Models that had the best performance, and capacity to adopt changes in the cement grinding circuit were selected to implement soft sensors. Soft sensors were tested using data from a continuous cement production to demonstrate their use in real-time fineness estimation. Their performance was highly satisfactory, and the sensors proved to be capable of providing valuable information on cement grinding circuit performance. After successful off-line tests, soft sensors were implemented and installed in the control room of a cement factory. Results on the site confirm results obtained by tests conducted during soft sensor development.     

Questioning numerical integration methods for microsphere (and microplane) constitutive equations

In the last few years, more and more complex microsphere models have been proposed to predict the mechanical response of various polymers. Similarly than for microplane models, they consist in deriving a one-dimensional force vs. stretch equation and to integrate it over the unit sphere to obtain a three-dimensional constitutive equation. In this context, the focus of authors is laid on the physics of the one-dimensional relationship, but in most of the case the influence of the integration method on the prediction is not investigated.Here we compare three numerical integration schemes: a classical Gaussian scheme, a method based on a regular geometric meshing of the sphere, and an approach based on spherical harmonics. Depending on the method, the number of integration points may vary from 4 to 983,040! Considering simple quantities, i.e. principal (large) strain invariants, it is shown that the integration method must be carefully chosen. Depending on the quantities retained to described the one-dimensional equation and the required error, the performances of the three methods are discussed. Consequences on stress–strain prediction are illustrated with a directional version of the classical Mooney–Rivlin hyperelastic model. Finally, the paper closes with some advices for the development of new microsphere constitutive equations.