Tabular data: Deep learning is not all you need

A key element in solving real-life data science problems is selecting the types of models to use. Tree ensemble models (such as XGBoost) are usually recommended for classification and regression problems with tabular data. However, several deep learning models for tabular data have recently been proposed, claiming to outperform XGBoost for some use cases. This paper explores whether these deep models should be a recommended option for tabular data by rigorously comparing the new deep models to XGBoost on various datasets. In addition to systematically comparing their performance, we consider the tuning and computation they require. Our study shows that XGBoost outperforms these deep models across the datasets, including the datasets used in the papers that proposed the deep models. We also demonstrate that XGBoost requires much less tuning. On the positive side, we show that an ensemble of deep models and XGBoost performs better on these datasets than XGBoost alone.     

Data fusion and transfer learning empowered granular trust evaluation for Internet of Things

In the Internet of Things (IoT), a huge amount of valuable data is generated by various IoT applications. As the IoT technologies become more complex, the attack methods are more diversified and can cause serious damages. Thus, establishing a secure IoT network based on user trust evaluation to defend against security threats and ensure the reliability of data source of collected data have become urgent issues, in this paper, a Data Fusion and transfer learning empowered granular Trust Evaluation mechanism (DFTE) is proposed to address the above challenges. Specifically, to meet the granularity demands of trust evaluation, time–space empowered fine/coarse grained trust evaluation models are built utilizing deep transfer learning algorithms based on data fusion. Moreover, to prevent privacy leakage and task sabotage, a dynamic reward and punishment mechanism is developed to encourage honest users by dynamically adjusting the scale of reward or punishment and accurately evaluating users’ trusts. The extensive experiments show that: (i) the proposed DFTE achieves high accuracy of trust evaluation under different granular demands through efficient data fusion; (ii) DFTE performs excellently in participation rate and data reliability.     

Learn decision trees with deep visual primitives

In this paper, we strive to propose a self-interpretable framework, termed PrimitiveTree, that incorporates deep visual primitives condensed from deep features with a conventional decision tree, bridging the gap between deep features extracted from deep neural networks (DNNs) and trees’ transparent decision-making processes. Specifically, we utilize a codebook, which embeds the continuous deep features into a finite discrete space (deep visual primitives) to distill the most common semantic information. The decision tree adopts the spatial location information and the mapped primitives to present the decision-making process of the deep features in a tree hierarchy. Moreover, the trained interpretable PrimitiveTree can inversely explain the constituents of the deep features, highlighting the most critical and semantic-rich image patches attributing to the final predictions of the given DNN. Extensive experiments and visualization results validate the effectiveness and interpretability of our method.     

A data-driven digital-twin prognostics method for proton exchange membrane fuel cell remaining useful life prediction

Prognostics and health management of proton exchange membrane fuel cell (PEMFC) systems have driven increasing research attention in recent years as the durability of PEMFC stack remains as a technical barrier for its large-scale commercialization. To monitor the health state during PEMFC operation, digital twin (DT), as a smart manufacturing technique, is applied in this paper to establish an ensemble remaining useful life prediction system. A data-driven DT is constructed to integrate the physical knowledge of the system and a deep transfer learning model based on stacked denoising autoencoder is used to update the DT with online measurement. A case study with experimental PEMFC degradation data is presented where the proposed data-driven DT prognostics method has applied and reached a high prediction accuracy. Furthermore, the predicted results are proved to be less affected even with limited measurement data.     

高深溜井井筒堵塞的爆破处理实践

溜井是采用平硐-溜井方式开拓矿山的运输咽喉,溜井正常与否对矿山生产影响极大。本文通过黑沟铁矿高深溜井井筒堵塞处理实例,对其堵塞爆破处理方法及经验做了系统分析。重点介绍的爆破冲击波破拱疏通高深溜井井筒高位堵塞的爆破方法,富有新意,可供国内外同类型矿山参考借鉴。     

Metal chlorides-promoted ammonia absorption of deep eutectic solvent

Ammonia is considered as a promising hydrogen or energy carrier. Ammonia absorption or adsorption is an important aspect for both ammonia removal, storage and separation applications. To these ends, a wide range of solid and liquid sorbents have been investigated. Among these, the deep eutectic solvent (DES) is emerging as a promising class of ammonia absorbers. Herein, we report a novel type of DES, i.e., metal-containing DESs for ammonia absorption. Specifically, the NH₃ absorption capacity is enhanced by ca. 18.1–36.9% when a small amount of metal chlorides, such as MgCl₂, MnCl₂ etc., are added into a DES composed of resorcinol (Res) and ethylene glycol (EG). To our knowledge, the MgCl₂/Res/EG (0.1:1:2) DES outperforms most of the reported DESs. The excellent NH₃ absorption performances of metal–containing DESs have been attributed to the synergy of Lewis acid–base and hydrogen bonding interactions. Additionally, good reversibility and high NH₃/CO₂ selectivity are achieved over the MgCl₂/Res/EG (0.1:1:2) DES, which enables it to be a potential NH₃ absorber for further investigations.     

Deep reinforcement learning-based cooperative interactions among heterogeneous vehicular networks

Most real-world vehicle nodes can be structured into an interconnected network of vehicles. Through structuring these services and vehicle device interactions into multiple types, such internet of vehicles becomes multidimensional heterogeneous overlay networks. The heterogeneousness of the overlays makes it difficult for the overlay networks to coordinate with each other to improve their performance. Therefore, it poses an interesting but critical challenge to the effective analysis of heterogeneous virtual vehicular networks. A variety of virtual vehicular networks can be easily deployed onto the native network by applying the concept of SDN (Software Defined Networking). These virtual networks reflect their heterogeneousness due to their different performance goals, and they compete for the same physical resources of the underlying network, so that a sub-optimal performance of the virtual networks may be achieved. Therefore, we propose a Deep Reinforcement Learning (DRL) approach to make the virtual networks cooperate with each other through the SDN controller. A cooperative solution based on the asymmetric Nash bargaining is proposed for co-existing virtual networks to improve their performance. Moreover, the Markov Chain model and DRL resolution are introduced to leverage the heterogeneous performance goals of virtual networks. The implementation of the approach is introduced, and simulation results confirm the performance improvement of the latency sensitive, loss-rate sensitive and throughput sensitive heterogeneous vehicular networks using our cooperative solution.     

An automated patient monitoring using discrete‐time wireless sensor networks

In recent years, Internet of Things (IoT) devices are used for remote health monitoring. For remotely monitoring a patient, only the health information at different time points are not sufficient; predicted values of biomarkers (for some future time points) are also important. In this article, we propose a powerful statistical model for an efficient dynamic patient monitoring using wireless sensor nodes through Bayesian Learning (BL). We consider the setting where a set of correlated biomarkers are measured from a patient through wireless sensors, but the sensors only report the ordinal outcomes (say, good, fair, high, or very high) to the sink based on some prefixed thresholds. The challenge is to use the ordinal outcomes for monitoring and predicting the health status of the patient under consideration. We propose a linear mixed model where interbiomarker correlations and intrabiomarker dependence are modeled simultaneously. The estimated and the predicted values of the biomarkers are transferred over the internet so that health care providers and the family members of the patient can remotely monitor the patient. Extensive simulation studies are performed to assess practical usefulness of our proposed joint model, and the performance of the proposed joint model is compared to that of some other traditional models used in the literature.     

Controlling the slides: Does clicking help adults learn?

When utilizing screen media as an educational platform, maintaining control over one's experience may lead to more successful learning outcomes. In the current work, adults learned four new action sequences, each via a different slideshow type. The computer advanced slides automatically, but each version had a different pausing mechanism: (1) free pause (viewers could click the mouse at any point to pause the show), (2) subgoal pause (show paused after subgoals, viewer clicked to continue), (3) timed pause (show paused every 20 slides, viewer clicked to continue), and (4) no pause (no viewer interaction). Participants completed a written memory test, live performance test, cognitive load measures, and satisfaction measures. Results indicated that memory recall was significantly lower in the no pause version when compared to the versions with pause capability. Also, over half of participants reported that the no pause version was their least favorite format to learn from. Conversely, over half of participants selected the free pause as their favorite slideshow format, and participants reported that they felt most in control of the free pause version. These reports occurred in spite of only one-quarter of all participants actually using the click-to-pause feature in the free pause slideshow. Perhaps the mindset of being in control, rather than the pausing itself, increased likeability of the program. This research has implications for program design and education, pointing to flexible pacing features being helpful in enhancing users' enjoyment of the program and ability to extract novel information.     

Multiple Empirical Kernel Learning with Majority Projection for imbalanced problems

Traditional Multiple Empirical Kernel Learning (MEKL) expands the expressions of the sample and brings better classification ability by using different empirical kernels to map the original data space into multiple kernel spaces. To make MEKL suit for the imbalanced problems, this paper introduces a weight matrix and a regularization term into MEKL. The weight matrix assigns high misclassification cost to the minority samples to balanced misclassification cost between minority and majority class. The regularization term named Majority Projection (MP) is used to make the classification hyperplane fit the distribution shape of majority samples and enlarge the between-class distance of minority and majority class. The contributions of this work are: (i) assigning high cost to minority samples to deal with imbalanced problems, (ii) introducing a new regularization term to concern the property of data distribution, (iii) and modifying the original PAC-Bayes bound to test the error upper bound of MEKL-MP. Through analyzing the experimental results, the proposed MEKL-MP is well suited to the imbalanced problems and has lower generalization risk in accordance with the value of PAC-Bayes bound.