Justification for the Use of Cohen’s Kappa Statistic in Experimental Studies of NLP and Text Mining

Modern metrics for evaluating agreement coefficients between the experimental results and expert opinion are compared, and the possibility of using these metrics in experimental research in automatic text processing by machine learning methods is assessed. The choice of Cohen’s kappa coefficient as a measure of expert opinion agreement in the NLP and Text Mining problems is justified. An example of using Cohen’s kappa coefficient for evaluating the level of agreement between the opinion of an expert and the results of ML classification and the measure of agreement of expert opinions in the alignment of sentences of the Kazakh-Russian parallel corpus is given. Based on this analysis, it is proved that Cohen’s kappa coefficient is one of the best statistical methods for determining the level of agreement in experimental studies due to its ease of use, computing simplicity, and high accuracy of the results.

     

An Efficient Modified Dragonfly Optimization Based MIMO-OFDM for Enhancing QoS in Wireless Multimedia Communication

Wireless Personal Communications - Multiple inputs multiple outputs (MIMO) is a reliable technique which can manage the increased wireless data traffic in the future generation of wireless...     

Organizing Production at High-Tech Enterprises in the Digital Era

Russian Engineering Research - The modernization of manufacturing by the comprehensive application of digital technology—in both production and management—is considered. Principles are...     

Structural Aspects of P2-Type Na0.67Mn0.6Ni0.2Li0.2O2 (MNL) Stabilization by Lithium Defects as a Cathode Material for Sodium-Ion Batteries

A known strategy for improving the properties of layered oxide electrodes in sodium-ion batteries is the partial substitution of transition metals by Li. Herein, the role of Li as a defect and its impact on sodium storage in P2-Na_0.67Mn_0.6Ni_0.2Li_0.2O₂ is discussed. In tandem with electrochemical studies, the electronic and atomic structure are studied using solid-state NMR, operando XRD, and density functional theory (DFT). For the as-synthesized material, Li is located in comparable amounts within the sodium and the transition metal oxide (TMO) layers. Desodiation leads to a redistribution of Li ions within the crystal lattice. During charging, Li ions from the Na layer first migrate to the TMO layer before reversing their course at low Na contents. There is little change in the lattice parameters during charging/discharging, indicating stabilization of the P2 structure. This leads to a solid-solution type storage mechanism (sloping voltage profile) and hence excellent cycle life with a capacity of 110 mAh g^-1 after 100 cycles. In contrast, the Li-free compositions Na_0.67Mn_0.6Ni_0.4O₂ and Na_0.67Mn_0.8Ni_0.2O₂ show phase transitions and a stair-case voltage profile. The capacity is found to originate from mainly Ni³⁺/Ni⁴⁺ and O^2-/O^2-δ redox processes by DFT, although a small contribution from Mn⁴⁺/Mn⁵⁺ to the capacity cannot be excluded.     

QoS metrics-in-the-loop for endowing runtime self-adaptation to robotic software architectures

Multimedia Tools and Applications - The design of robots capable of operating autonomously in changing and unstructured environments, requires using complex software architectures in which,...     

Motion of a Robot Mower with Directional Control

Russian Engineering Research - The stability of robot-mower motion in a specific direction is considered. The direction is regulated by means of an angular sensor and a programmable controller...     

Quantitative Analysis of Valley–Orbit Coupling in Germanium Doped with Group-V Donors

Semiconductors - The wave functions of electrons localized at P, As, and Sb shallow donors in Ge are calculated in the envelope function approximation taking into account valley–orbit...     

As the number falls,alternatives to the Hagberg–Perten falling number method: A review

This review examines the application, limitations, and potential alternatives to the Hagberg–Perten falling number (FN) method used in the global wheat industry for detecting the risk of poor end-product quality mainly due to starch degradation by the enzyme α-amylase. By viscometry, the FN test indirectly detects the presence of α-amylase, the primary enzyme that digests starch. Elevated α-amylase results in low FN and damages wheat product quality resulting in cakes that fall, and sticky bread and noodles. Low FN can occur from preharvest sprouting (PHS) and late maturity α-amylase (LMA). Moist or rainy conditions before harvest cause PHS on the mother plant. Continuously cool or fluctuating temperatures during the grain filling stage cause LMA. Due to the expression of additional hydrolytic enzymes, PHS has a stronger negative impact than LMA. Wheat grain with low FN/high α-amylase results in serious losses for farmers, traders, millers, and bakers worldwide. Although blending of low FN grain with sound wheat may be used as a means of moving affected grain through the marketplace, care must be taken to avoid grain lots from falling below contract-specified FN. A large amount of sound wheat can be ruined if mixed with a small amount of sprouted wheat. The FN method is widely employed to detect α-amylase after harvest. However, it has several limitations, including sampling variability, high cost, labor intensiveness, the destructive nature of the test, and an inability to differentiate between LMA and PHS. Faster, cheaper, and more accurate alternatives could improve breeding for resistance to PHS and LMA and could preserve the value of wheat grain by avoiding inadvertent mixing of high- and low-FN grain by enabling testing at more stages of the value stream including at harvest, delivery, transport, storage, and milling. Alternatives to the FN method explored here include the Rapid Visco Analyzer, enzyme assays, immunoassays, near-infrared spectroscopy, and hyperspectral imaging.     

Analyzing the Conditions for the Electrolytic Formation of Ensembles from Metal Nanowires in the Pores of Track Membranes

Theoretical Foundations of Chemical Engineering - The effect of the electrolyte composition, mass-transfer conditions, pore diameter, interpore distance, and electric parameters on the formation of...