On the Convergence of Temporal-Difference Learning with Linear Function Approximation

The asymptotic properties of temporal-difference learning algorithms with linear function approximation are analyzed in this paper. The analysis is carried out in the context of the approximation of a discounted cost-to-go function associated with an uncontrolled Markov chain with an uncountable finite-dimensional state-space. Under mild conditions, the almost sure convergence of temporal-difference learning algorithms with linear function approximation is established and an upper bound for their asymptotic approximation error is determined. The obtained results are a generalization and extension of the existing results related to the asymptotic behavior of temporal-difference learning. Moreover, they cover cases to which the existing results cannot be applied, while the adopted assumptions seem to be the weakest possible under which the almost sure convergence of temporal-difference learning algorithms is still possible to be demonstrated.     

TreePlus: interactive exploration of networks with enhanced tree layouts

Despite extensive research, it is still difficult to produce effective interactive layouts for large graphs. Dense layout and occlusion make food Webs, ontologies and social networks difficult to understand and interact with. We propose a new interactive visual analytics component called TreePlus that is based on a tree-style layout. TreePlus reveals the missing graph structure with visualization and interaction while maintaining good readability. To support exploration of the local structure of the graph and gathering of information from the extensive reading of labels, we use a guiding metaphor of "plant a seed and watch it grow." It allows users to start with a node and expand the graph as needed, which complements the classic overview techniques that can be effective at (but often limited to) revealing clusters. We describe our design goals, describe the interface and report on a controlled user study with 28 participants comparing TreePlus with a traditional graph interface for six tasks. In general, the advantage of TreePlus over the traditional interface increased as the density of the displayed data increased. Participants also reported higher levels of confidence in their answers with TreePlus and most of them preferred TreePlus     

Novel Models of Crohn’s Disease Pathogenesis Associated with the Occurrence of Mitochondrial Dysfunction in Intestinal Cells

Crohn’s disease remains one of the challenging problems of modern medicine, and the development of new and effective and safer treatments against it is a dynamic field of research. To make such developments possible, it is important to understand the pathologic processes underlying the onset and progression of Crohn’s disease at the molecular and cellular levels. During the recent years, the involvement of mitochondrial dysfunction and associated chronic inflammation in these processes became evident. In this review, we discuss the published works on pathogenetic models of Crohn’s disease. These models make studying the role of mitochondrial dysfunction in the disease pathogenesis possible and advances the development of novel therapies.     

Harnessing “Click”‐Type Chemistry for the Preparation of Novel Electronic Materials

Sequence‐independent or “click”‐type chemistry is applied for the preparation of novel π‐conjugated oligomers. A variety of bi‐functional monomers for Wittig–Horner olefination are developed and applied in a sequential protection–deprotection process for the preparation of structurally similar π‐conjugated oligomers. Selected oligomers are incorporated as the organic semiconductors in light‐emitting diodes and a field‐effect transistor, demonstrating the potential of the approach.     

Possibilities of production of nanopowders with high power ELV electron accelerator

Electron-beam evaporation of various natural and industrial materials in the atmosphere of different gases at atmospheric pressure can be used for the synthesis of nanosize powders. These powders are characterized by high purity and may exhibit unusual properties. In particular, nanopowders of silicon dioxide and oxide (SiO₂, SiO), magnesia (MgO), alumina (Al₂O₃), titania (TiO₂), gadolinium oxide (Gd₂O₃), various metals (tantalum, molybdenum, nickel, aluminium, copper, silver), semiconductor (Si), nitrides (AlN, TiN), and some other substances had been produced. The process of nanopowder synthesis is highly effective; in particular, the yield of oxides can exceed ten kilograms per hour.     

Large-scale synthesis of hierarchical alpha-FeOOH flowers by ultrasonic-assisted hydrothermal route

In this paper, we report a facile, an environmental friendly ultrasonic-assisted hydrothermal route for preparation of goethite flower structures using Fe nanopowders at low temperature (85°C). The flower structure consisted of tens of hundreds of nanowires and such structures can further self-assemble with the flake with micro size area. Structural, morphological, and elemental analysis revealed that the products consisted of flower-like structures with high structural uniformity, good crystal quality, and high yields. Influencing factors such as the reaction temperature, pH value, and the deposition time were systematically investigated. A possible formation mechanism was proposed on the basis of the experimental results. Magnetic measurements showed that the as-obtained goethite flowers exhibited weakly ferromagnetic characteristics at room temperature, which were quite different from those of the corresponding bulk materials.     

Event sorting methods of γ-ray spectroscopic data

The paper presents several sorting methods of γ-ray events which were implemented in the data acquisition, processing and visualization system, developed at the Institute of Physics of the Slovak Academy of Sciences. The sorting methods using various shapes of gates (conditions) are presented, including rectangular windows, polygons, gates defined by arithmetic functions, spherical, ellipsoidal and composed gates. The examples illustrating the use of these methods are presented as well.     

Modulating mTOR Signaling as a Promising Therapeutic Strategy for Atherosclerosis

For more than a decade, atherosclerosis has been one of the leading causes of death in developed countries. The issue of treatment and prevention of the disease is especially acute. Despite the huge amount of basic and clinical research, a significant number of gaps remain in our understanding of the pathogenesis of atherosclerosis, and only their closure will bring us closer to understanding the causes of the disease at the cellular and molecular levels and, accordingly, to the development of an effective treatment. One of the seemingly well-studied elements of atherogenesis is the mTOR signaling pathway. However, more and more new details are still being clarified. Therapeutic strategies associated with rapamycin have worked well in a number of different diseases, and there is every reason to believe that targeting components of the mTOR pathway may pay off in atherosclerosis as well.     

Heparin-Functionalized Adsorbents Eliminate Central Effectors of Immunothrombosis,including Platelet Factor 4, High-Mobility Group Box 1 Protein and Histones

Inflammation and thrombosis are closely intertwined in numerous disorders, including ischemic events and sepsis, as well as coronavirus disease 2019 (COVID-19). Thrombotic complications are markers of disease severity in both sepsis and COVID-19 and are associated with multiorgan failure and increased mortality. Immunothrombosis is driven by the complement/tissue factor/neutrophil axis, as well as by activated platelets, which can trigger the release of neutrophil extracellular traps (NETs) and release further effectors of immunothrombosis, including platelet factor 4 (PF4/CXCL4) and high-mobility box 1 protein (HMGB1). Many of the central effectors of deregulated immunothrombosis, including activated platelets and platelet-derived extracellular vesicles (pEVs) expressing PF4, soluble PF4, HMGB1, histones, as well as histone-decorated NETs, are positively charged and thus bind to heparin. Here, we provide evidence that adsorbents functionalized with endpoint-attached heparin efficiently deplete activated platelets, pEVs, PF4, HMGB1 and histones/nucleosomes. We propose that this elimination of central effectors of immunothrombosis, rather than direct binding of pathogens, could be of clinical relevance for mitigating thrombotic complications in sepsis or COVID-19 using heparin-functionalized adsorbents.