Cooperative Q‐learning techniques for distributed online power allocation in femtocell networks

In this paper, we address the problem of distributed interference management of femtocells that share the same frequency band with macrocells using distributed multi‐agent Q‐learning. We formulate and solve two problems representing two different Q‐learning algorithms, namely, femto‐based distributed and sub‐carrier‐based distributed power controls using Q‐learning (FBDPC‐Q and SBDPC‐Q). FBDPC‐Q is a multi‐agent algorithm that works on a global basis, for example, deals with the aggregate macrocell and femtocell capacities. Its complexity increases exponentially with the number of sub‐carriers in the system. Also, it does not take into consideration the sub‐carrier macrocell capacity as a constraint. To overcome these problems, SBDPC‐Q is proposed, which is a multi‐agent algorithm that works on a sub‐carrier basis, for example, sub‐carrier macrocell and femtocell capacities. Each of FBDPC‐Q and SBDPC‐Q works in three different learning paradigms: independent (IL), cooperative (CL), and weighted cooperative (WCL). IL is considered the simplest form for applying Q‐learning in multi‐agent scenarios, where all the femtocells learn independently. CL and WCL are the proposed schemes in which femtocells share partial information during the learning process in order to strike a balance between practical relevance and performance. We prove the convergence of the CL paradigm when used in the FBDPC‐Q algorithm. We show via simulations that the CL paradigm outperforms the IL paradigm in terms of the aggregate femtocell capacity, especially in networks with large number of femtocells and large number of power levels. In addition, we propose WCL to address the CL limitations. Finally, we evaluate the robustness and scalability of both FBDPC‐Q and SBDPC‐Q, against several typical dynamics of plausible wireless scenarios (fading, path loss, random activity of femtocells, etc.). We show that the CL paradigm is the most scalable to large number of femtocells and robust to the network dynamics compared with the IL and WCL paradigms. Copyright © 2014 John Wiley & Sons, Ltd.     

On the inhomogeneous hydration kinetics and stiffness evolution of HNBR‐MgO reactive elastomer composites

Swellable elastomers are widely used in oilfield industry for sealing and zonal isolation applications. These materials need to sustain a large amount of external load after swelling. A newly developed reactive hydrogenated nitrile butadiene rubber (HNBR) based elastomer composite with magnesium oxide (MgO) as filler can swell and stiffen when exposed to water, which makes it ideal for oil field applications. However, both the filler hydration and the stiffness evolution inside this composite material are observed to be highly inhomogeneous even for samples on the length scale of millimeters. To understand this coupled diffusion‐hydration process is critical for applications of these materials with larger length scales. In this work, the hydration kinetics and stiffness evolution of the HNBR‐MgO composite are quantitatively studied on microscopic level. The extent of MgO hydration along the thickness of the sample are measured at the different stage of swelling. These results are used to determine the diffusion coefficient of water inside the composite. The diffusivity increases orders of magnitude after the filler hydration. In addition, the modulus change is non‐proportional to the degree of filler hydration as demonstrated by instrumented grid indentation on the hydrated composites. © 2016 Wiley Periodicals, Inc. J. Appl. Polym. Sci. 2016 , 133, 43420.     

Electrochemical assessment of inhibitive behavior of some antibacterial drugs on 316 stainless steel in acidic medium

In this work, the inhibitive effect of some antibacterial drugs against the corrosion of 316 stainless steel in 1M HCl has been studied by weight loss, potentiodynamic polarization and electrochemical impedance spectroscopy (EIS). The inhibiting effect explained by adsorption of the additives on steel surface. The inhibition efficiency increases with increasing the inhibitors concentrations and decreases with increasing the temperature. The data obtained fit well to Langmuir adsorption isotherm and the kinetic-thermodynamic model. The results of polarization studies indicate that the investigated antibacterial drugs are mixed type inhibitors. Increasing the inhibition efficiency of the investigated inhibitors with the addition of iodide ions indicates that iodide ions play important role in the adsorption process. The efficiencies obtained from the different electrochemical techniques were in good agreement which prove the validity of these tools in the measurements of the tested inhibitors.     

Pistacia lentiscus extract as a green inhibitor for copper corrosion in 0.5 M of H2SO4: electrochemical characterization and theoretical investigations

Journal of Applied Electrochemistry - The current work aims to study the effect of Pistacia lentiscus (Pil) essential oil originating from Chefchaouen city, which is located in northeastern Morocco...     

Method to Stop Geopolymer Reaction

The objective of this study was to develop a method to stop geopolymer reaction at early ages so that the molecular structure can be determined and its link to setting behavior probed. Solvent extraction, using a mixture of alcohol and acetone to remove water, was seen to suspend reaction up to at least 53 h, allowing enough time for nuclear magnetic resonance (NMR) tests to determine structure. However, this method caused precipitation of soluble species present at early ages, confounding interpretation of the spectra and thus making it suitable only for mature geopolymers. A combination of water treatment to extract soluble species and solvent treatment to extract water was seen to stop the geopolymer reaction long enough (> 1 week) for NMR tests in specimens with and without calcium.     

Active/passive control of sound radiation and power flow in fluid-loaded shells

The vibration and noise radiation from fluid-loaded cylindrical shells are controlled by using multiple stiffeners and passive constrained layer damping treatment. Dynamic and fluid finite elements are developed to study the fundamental phenomena governing the coupling between the stiffened shell, with and without damping, and the fluid domain surrounding it. The models are used to predict the response of the shell and to evaluate the effect of stiffening rings and damping treatment on both the structural vibration and noise radiation in the fluid domain. The geometry of the shell and fluid domain allows the formulation of a harmonic-based model, which uncouples the fluid–structural response of modes corresponding to different numbers of circumferential nodes.In this study, it is shown that stiffening of the shell reduces the amplitude of the vibration and noise radiation, particularly for high-order lobar modes. The attenuation of the shell response and sound radiation can be increased significantly through the application of passive constrained layer damping treatments on the inner surface of the stiffening rings.     

Reactor thermal behaviors under kinetics parameters variations in fast reactivity insertion

The influences of variations in some of the kinetics parameters affecting the reactivity insertion are considered in this study, it has been accomplished in order to acquire knowledge about the role that kinetic parameters play in prompt critical transients from the safety point of view. The kinetics parameters variations are limited to the effective delayed neutron fraction (β_eff) and the prompt neutron generation time (Λ). The reactor thermal behaviors under the variations in effective delayed neutron fraction and prompt neutron generation time included, the reactor power, maximum fuel temperature, maximum clad temperature, maximum coolant temperature and the mass flux variations at the hot channel. The analysis is done for a typical swimming pool, plate type research reactor with low enriched uranium. The scram system is disabled during the accidents simulations. Calculations were done using PARET code. As a result of simulations, it is concluded that, the reactor (ETRR2) thermal behavior is considerably more sensitive to the variation in the effective delayed neutron fraction than to the variation in prompt neutron generation time and the fast reactivity insertion in both cases causes a flow expansion and contraction at the hot channel exit. The amplitude of the oscillated flow is a qualitatively increases with the decrease in both β_eff and Λ.     

VAE/MPM/GA Technique for DoA Estimation Using Optimized Antenna Arrays

Many algorithms have been proposed to estimate the direction of arrival for the targets, but through using a large number of snapshots. In real time applications such as automotive radar, this is unacceptable as it causes delay and heavy processing. Instead, if only a small number of snapshots or, optimally, a single snapshot is available for DoA estimation, it will be fast and efficient. Single snapshot algorithms have a drawback as they require a large number of antenna elements, which considered a limiting factor. In this paper, a single snapshot DoA estimation technique is introduced by using optimized antenna arrays. The proposed algorithm is based on utilization of virtual array extension, matrix pencil method, and the genetic algorithm. The use of virtual array extension greatly improves the MPM performance. Furthermore, it exhibits a high DoA estimation accuracy by using a reduced number of antenna elements. The genetic algorithm is employed to determine the minimum number of antenna elements, which are required to estimate the DoAs with minimal root mean square error.

     

Structured literature image finder: Parsing text and figures in biomedical literature

The SLIF project combines text-mining and image processing to extract structured information from biomedical literature.SLIF extracts images and their captions from published papers. The captions are automatically parsed for relevant biological entities (protein and cell type names), while the images are classified according to their type (e.g., micrograph or gel). Fluorescence microscopy images are further processed and classified according to the depicted subcellular localization.The results of this process can be queried online using either a user-friendly web-interface or an XML-based web-service. As an alternative to the targeted query paradigm, SLIF also supports browsing the collection based on latent topic models which are derived from both the annotated text and the image data.The SLIF web application, as well as labeled datasets used for training system components, is publicly available at http://slif.cbi.cmu.edu.