Schedule-Based Cooperative Multi-agent Reinforcement Learning for Multi-channel Communication in Wireless Sensor Networks

Wireless sensor networks (WSNs) have become an important component in the Internet of things (IoT) field. In WSNs, multi-channel protocols have been developed to overcome some limitations related to the throughput and delivery rate which have become necessary for many IoT applications that require sufficient bandwidth to transmit a large amount of data. However, the requirement of frequent negotiation for channel assignment in distributed multi-channel protocols incurs an extra-large communication overhead which results in a reduction of the network lifetime. To deal with this requirement in an energy-efficient way is a challenging task. Hence, the Reinforcement Learning (RL) approach for channel assignment is used to overcome this problem. Nevertheless, the use of the RL approach requires a number of iterations to obtain the best solution which in turn creates a communication overhead and time-wasting. In this paper, a Self-schedule based Cooperative multi-agent Reinforcement Learning for Channel Assignment (SCRL CA) approach is proposed to improve the network lifetime and performance. The proposal addresses both regular traffic scheduling and assignment of the available orthogonal channels in an energy-efficient way. We solve the cooperation between the RL agents problem by using the self-schedule method to accelerate the RL iterations, reduce the communication overhead and balance the energy consumption in the route selection process. Therefore, two algorithms are proposed, the first one is for the Static channel assignment (SSCRL CA) while the second one is for the Dynamic channel assignment (DSCRL CA). The results of extensive simulation experiments show the effectiveness of our approach in improving the network lifetime and performance through the two algorithms.

     

Particleboards production from date palm biomass

Date palm biomass is a renewable natural resource that has not widely been utilized in industry. The objective of this study was to examine some chemical properties of date palm trunk and rachis (holocellulose, cellulose, lignin and extractives) and to evaluate their suitability to produce composite panels. Particleboards were produced using trunk and rachis as an alternative raw material for forest products industry in the presence of two types of polycondensation resins (phenol–formaldehyde and melamine urea–formaldehyde) which were selected as binding agents. The panels were tested for their physical (water absorption and thickness swelling) and mechanical (modulus of rupture, modulus of elasticity and internal bond strength) properties. The internal bond strength of date palm trunk and date palm rachis based boards met the requirements of the general purpose product standards (EN 312) at 0.70 g/cm³ density. The panels made with phenol–formaldehyde resin showed better performance with respect to the panels made with melamine urea–formaldehyde. In addition, the particleboard made with date palm trunk particles had better quality compared to the particleboard made from date palm rachis particles. Based on preliminary results of this work, raw materials from date palm trunks and rachis can have a promising potential in the manufacture of particleboards and as a substitute for wood in board production.     

Stress distribution in thick-walled cylinder due to non-uniform radial pressure on the example of reinforcement corrosion in concrete

This paper presents an analytical solution to the non-uniform pressure on thick-walled cylinder. The formulation is based on the linear elasticity theory (plain strain) and stress function method. As an example, the proposed solution is used to model the stress distribution due to non-uniform steel reinforcement corrosion in concrete. The model is formulated considering different scenarios of corrosion pressure distribution. It is validated against the finite element model for different cases of non-uniform pressure distributions. The results show that the corrosion-induced cracks are likely to start just beyond the anodic zone. This is confirmed by the experimental tests on concrete cylinder exposed to non-uniform accelerated corrosion of steel reinforcement. The model can be effectively used to calculate the distribution of corrosion-induced stresses in concrete.     

Infiltration behavior of Cu and Ti fillers into Ti2AlC/Ti3AlC2 composites during tungsten inert gas (TIG)brazing

Herein we study the infiltration behavior of Ti and Cu fillers into a Ti₂AlC/Ti₃AlC₂MAX phase composites using a TIG-brazing process. The microstructures of the interfaces were investigated by scanning electron microscopy and energy dispersive spectrometry. When Ti₂AlC/Ti₃AlC₂ comes into contact with molten Ti, it starts decomposing into TiC_x, a Ti-richandTi₃AlC; when in contact with molten Cu, the resulting phases are Ti₂Al(Cu)C, Cu(Al), AlCu₂Ti and TiC. In the presence of Cu at approximately 1630 °C, a defective Ti₂Al(Cu)C phase was formed having a P63/mmc structure. Ti₃AlC₂ MAX phase was completely decomposed in presence of Cu or Ti filler-materials. The decomposition of Ti₂AlC to Ti₃AlC₂ was observed in the heat-affected zone of the composite. Notably, no cracks were observed during TIG-brazing of Ti₂AlC/Ti₃AlC₂ composite with Ti or Cu filler materials.     

Maintainability defects detection and correction: a multi-objective approach

Software defects often lead to bugs, runtime errors and software maintenance difficulties. They should be systematically prevented, found, removed or fixed all along the software lifecycle. However, detecting and fixing these defects is still, to some extent, a difficult, time-consuming and manual process. In this paper, we propose a two-step automated approach to detect and then to correct various types of maintainability defects in source code. Using Genetic Programming, our approach allows automatic generation of rules to detect defects, thus relieving the designer from a fastidious manual rule definition task. Then, we correct the detected defects while minimizing the correction effort. A correction solution is defined as the combination of refactoring operations that should maximize as much as possible the number of corrected defects with minimal code modification effort. We use the Non-dominated Sorting Genetic Algorithm (NSGA-II) to find the best compromise. For six open source projects, we succeeded in detecting the majority of known defects, and the proposed corrections fixed most of them with minimal effort.     

An improved radial impulse turbine for OWC

Traditionally, wells turbines have been widely used in OWC plants. However, an alternative has been studied over recent years: a self-rectifying turbine known as an impulse turbine. We are interested in the radial version of the impulse turbine, which was initially proposed by M. McCormick. Previous research was carried out using CFD (FLUENT^®), which aimed to improve knowledge of the local flow behavior and the prediction of the performance for this kind of turbine. This previous work was developed with a geometry taken from the literature, but now our goal is to develop a new geometry design with a better performance. To achieve this, we have redesigned the blade and vane profiles and improved the interaction between them by means of a new relation between their setting angles. Under sinusoidal flow conditions the new design improves the turbine efficiency by up to 5% more than the geometry proposed by Professor Setoguchi, in 2002. In this paper, the design criteria we have used is described, and the flow behavior and the performance of this new design are compared with the previous one.     

Degenerate-wave mixing in new dithienylethylenes

We report the measurement of the degenerate fourth-wave mixing (DFWM) of new dithienylethylenes in chloroform solutions at λ=532 nm in ps regime with different numbers of π-conjugated bonds. From these measurements, we evaluated the values of the second order hyperpolarizabilities γ, which are about 10³ larger than the γ value of CS₂. The influence of π-conjugated bonds on the third-order susceptibilities and appropriate figures of merits is discussed. The more important seems to be the possibility of a simultaneous increase of the third-order susceptibilities, together with the decrease of the absorption coefficients that open a possibility of their use as promising materials for laser wavelengths mixing.     

Performance comparison of AlGaAs,GaAs and InGaP tunnel junctions for concentrated multijunction solar cells

Four tunnel junction (TJ) designs for multijunction (MJ) solar cells under high concentration are studied to determine the peak tunnelling current and resistance change as a function of the doping concentration. These four TJ designs are: AlGaAs/AlGaAs, GaAs/GaAs, AlGaAs/InGaP and AlGaAs/GaAs. Time‐dependent and time‐average methods are used to experimentally characterize the entire current–voltage profile of TJ mesa structures. Experimentally calibrated numerical models are used to determine the minimum doping concentration required for each TJ design to operate within a MJ solar cell up to 2000‐suns concentration. The AlGaAs/GaAs TJ design is found to require the least doping concentration to reach a resistance of <10⁻⁴ Ω cm² followed by the GaAs/GaAs TJ and finally the AlGaAs/AlGaAs TJ. The AlGaAs/InGaP TJ is only able to obtain resistances of ≥5 × 10⁻⁴ Ω cm² within the range of doping concentrations studied. Copyright © 2010 John Wiley & Sons, Ltd.     

Direct simulation vs volume-averaged treatment of adiabatic, premixed flame in a porous medium

For the case of flame thickness being of the order of the pore linear dimension, the flame structure and speed in adiabatic, premixed methane-air combustion in porous media are examined. The local, volume-averaged conservation equations that assume a local thermal equilibrium between the solid and the gas phases (i.e. the single-medium treatment) or allow for a thermal nonequilibrium (i.e. the two-medium treatment) are used along with the direct application of the pointwise conservation equation to a two-dimensional porous medium model (ordered arrangement of discrete or connected square cylinders). The effective properties of the porous medium in the volume-averaged treatments, including the interfacial Nusselt number, are found by applying the local volume-averaging principles. The results show that, although significant variations of the temperature and species concentrations occur over a pore, the flame structure, thickness, speed, and excess temperature (i.e. local gas temperature in excess of the adiabatic temperature) are fairly well predicted by the two-medium model (the single-medium treatment is unable to predict the local excess temperature). However, the volume-averaged treatments are unable to predict the pore-level, local high temperature region in the gas phase (which can be up to 40% above the adiabatic temperature), and the pore-level variation in the flame speed with respect to the flame location in the pore (which can vary by up to 20%). Other shortcomings of the volume-averaged treatments are also revealed through a parametric examination involving the pore-geometry variables, solid to gas conductivity ratio, equivalence ratio, porosity, and flame location within the pore.