Validation of scientific topic models using graph analysis and corpus metadata

Probabilistic topic modeling algorithms like Latent Dirichlet Allocation (LDA) have become powerful tools for the analysis of large collections of documents (such as papers, projects, or funding applications) in science, technology an innovation (STI) policy design and monitoring. However, selecting an appropriate and stable topic model for a specific application (by adjusting the hyperparameters of the algorithm) is not a trivial problem. Common validation metrics like coherence or perplexity, which are focused on the quality of topics, are not a good fit in applications where the quality of the document similarity relations inferred from the topic model is especially relevant. Relying on graph analysis techniques, the aim of our work is to state a new methodology for the selection of hyperparameters which is specifically oriented to optimize the similarity metrics emanating from the topic model. In order to do this, we propose two graph metrics: the first measures the variability of the similarity graphs that result from different runs of the algorithm for a fixed value of the hyperparameters, while the second metric measures the alignment between the graph derived from the LDA model and another obtained using metadata available for the corresponding corpus. Through experiments on various corpora related to STI, it is shown that the proposed metrics provide relevant indicators to select the number of topics and build persistent topic models that are consistent with the metadata. Their use, which can be extended to other topic models beyond LDA, could facilitate the systematic adoption of this kind of techniques in STI policy analysis and design.

     

Modernization of Air Supply Unit for Oxidation Towers Used in Bitumen Production

Chemical and Petroleum Engineering - The hydrodynamics of oxidation towers used for bitumen production were studied using a model tower having transparent walls. Experiments were carried out in two...     

Modeling the Destruction of an Anisotropic Composite Barrier in Interaction with Slender Strikers at an Angle

Journal of Engineering Physics and Thermophysics - A numerical investigation has been made into the interaction of slender (5–20 calibers) steel cylinder strikers with orthotropic compost...     

Motion of a Robot Mower with Directional Control

Russian Engineering Research - The stability of robot-mower motion in a specific direction is considered. The direction is regulated by means of an angular sensor and a programmable controller...     

Quantitative Analysis of Valley–Orbit Coupling in Germanium Doped with Group-V Donors

Semiconductors - The wave functions of electrons localized at P, As, and Sb shallow donors in Ge are calculated in the envelope function approximation taking into account valley–orbit...     

Personalized web service recommendation through mishmash technique and deep learning model

Multimedia Tools and Applications - Discovering the relevant web services for specific applications in the dynamically changing business world becomes very critical. Researchers have used many...     

Analyzing the Conditions for the Electrolytic Formation of Ensembles from Metal Nanowires in the Pores of Track Membranes

Theoretical Foundations of Chemical Engineering - The effect of the electrolyte composition, mass-transfer conditions, pore diameter, interpore distance, and electric parameters on the formation of...     

Phase formation,structure and properties of light-weight aluminosilicate proppants based on clay-diabase and clay-granite binary mixes

One of the drawbacks of fusible clays is the narrow sintering interval due to a sharp increase in the amount of iron-silicate melt at a temperature of 1000–1100 °C, which hardens in the form of a glass phase upon cooling. This leads to a relatively low mechanical strength of the calcined samples and causes the danger of melting the granular material surface from such clays during the firing process. To increase the strength of samples of fusible clays, the influence of diabase and granitoid rocks was considered. It was found that the strengthening effect of diabase and granitoid rock additives in an amount of 20–50% in a mixture with fusible clay is due to an increase of total content of the crystalline phase (mullite, cristobalite and residual quartz) from 18–20% in clays without additives to 22–28 % - in mixtures with diabase and to 28–34% - with granitoid additives) at a temperature of 1050–1100 °C. This increase is due to the activation of synthesis processes of secondary mullite and crystallization from alkali-rich feldspar melt of amorphous silica, released from the structure of clay minerals. The established influence of the igneous rocks used made it possible to develop compositions and propose process flow sheet for producing aluminosilicate proppants based on fusible clays. The use of granitoid and diabase rocks in an amount of 20–70% with fusible clays produces lightweight aluminosilicate proppants with bulk density of 1.40–1.46 g/cm³ at temperature range of 1050–1100 °C, which can endure destructive pressures up to 34.5–52 MPa.