Justification for the Use of Cohen’s Kappa Statistic in Experimental Studies of NLP and Text Mining

Modern metrics for evaluating agreement coefficients between the experimental results and expert opinion are compared, and the possibility of using these metrics in experimental research in automatic text processing by machine learning methods is assessed. The choice of Cohen’s kappa coefficient as a measure of expert opinion agreement in the NLP and Text Mining problems is justified. An example of using Cohen’s kappa coefficient for evaluating the level of agreement between the opinion of an expert and the results of ML classification and the measure of agreement of expert opinions in the alignment of sentences of the Kazakh-Russian parallel corpus is given. Based on this analysis, it is proved that Cohen’s kappa coefficient is one of the best statistical methods for determining the level of agreement in experimental studies due to its ease of use, computing simplicity, and high accuracy of the results.

     

An Efficient Modified Dragonfly Optimization Based MIMO-OFDM for Enhancing QoS in Wireless Multimedia Communication

Wireless Personal Communications - Multiple inputs multiple outputs (MIMO) is a reliable technique which can manage the increased wireless data traffic in the future generation of wireless...     

Organizing Production at High-Tech Enterprises in the Digital Era

Russian Engineering Research - The modernization of manufacturing by the comprehensive application of digital technology—in both production and management—is considered. Principles are...     

Structural Aspects of P2-Type Na0.67Mn0.6Ni0.2Li0.2O2 (MNL) Stabilization by Lithium Defects as a Cathode Material for Sodium-Ion Batteries

A known strategy for improving the properties of layered oxide electrodes in sodium-ion batteries is the partial substitution of transition metals by Li. Herein, the role of Li as a defect and its impact on sodium storage in P2-Na_0.67Mn_0.6Ni_0.2Li_0.2O₂ is discussed. In tandem with electrochemical studies, the electronic and atomic structure are studied using solid-state NMR, operando XRD, and density functional theory (DFT). For the as-synthesized material, Li is located in comparable amounts within the sodium and the transition metal oxide (TMO) layers. Desodiation leads to a redistribution of Li ions within the crystal lattice. During charging, Li ions from the Na layer first migrate to the TMO layer before reversing their course at low Na contents. There is little change in the lattice parameters during charging/discharging, indicating stabilization of the P2 structure. This leads to a solid-solution type storage mechanism (sloping voltage profile) and hence excellent cycle life with a capacity of 110 mAh g^-1 after 100 cycles. In contrast, the Li-free compositions Na_0.67Mn_0.6Ni_0.4O₂ and Na_0.67Mn_0.8Ni_0.2O₂ show phase transitions and a stair-case voltage profile. The capacity is found to originate from mainly Ni³⁺/Ni⁴⁺ and O^2-/O^2-δ redox processes by DFT, although a small contribution from Mn⁴⁺/Mn⁵⁺ to the capacity cannot be excluded.     

QoS metrics-in-the-loop for endowing runtime self-adaptation to robotic software architectures

Multimedia Tools and Applications - The design of robots capable of operating autonomously in changing and unstructured environments, requires using complex software architectures in which,...     

Motion of a Robot Mower with Directional Control

Russian Engineering Research - The stability of robot-mower motion in a specific direction is considered. The direction is regulated by means of an angular sensor and a programmable controller...     

Quantitative Analysis of Valley–Orbit Coupling in Germanium Doped with Group-V Donors

Semiconductors - The wave functions of electrons localized at P, As, and Sb shallow donors in Ge are calculated in the envelope function approximation taking into account valley–orbit...     

Analyzing the Conditions for the Electrolytic Formation of Ensembles from Metal Nanowires in the Pores of Track Membranes

Theoretical Foundations of Chemical Engineering - The effect of the electrolyte composition, mass-transfer conditions, pore diameter, interpore distance, and electric parameters on the formation of...