Integration of imitation learning using GAIL and reinforcement learning using task-achievement rewards via probabilistic graphical model

The integration of reinforcement learning (RL) and imitation learning (IL) is an important problem that has long been studied in the field of intelligent robotics. RL optimizes policies to maximize the cumulative reward, whereas IL attempts to extract general knowledge about the trajectories demonstrated by experts, i.e, demonstrators. Because each has its own drawbacks, many methods combining them and compensating for each set of drawbacks have been explored thus far. However, many of these methods are heuristic and do not have a solid theoretical basis. This paper presents a new theory for integrating RL and IL by extending the probabilistic graphical model (PGM) framework for RL, control as inference. We develop a new PGM for RL with multiple types of rewards, called probabilistic graphical model for Markov decision processes with multiple optimality emissions (pMDP-MO). Furthermore, we demonstrate that the integrated learning method of RL and IL can be formulated as a probabilistic inference of policies on pMDP-MO by considering the discriminator in generative adversarial imitation learning (GAIL) as an additional optimality emission. We adapt the GAIL and task-achievement reward to our proposed framework, achieving significantly better performance than policies trained with baseline methods.     

Optimized dual-function varistor-capacitor ceramics of core-shell structured xBi2/3Cu3Ti4O12/(1-x)CaCu3Ti4O12 composites

xBi_2/3Cu₃Ti₄O₁₂/(1-x)CaCu₃Ti₄O₁₂ composites were prepared by traditional solid-state reaction method. Extremely high nonlinear coefficient of 25 and breakdown field of 18.92 kV·cm⁻¹ were obtained in small current range of 0.1−1 mA·cm^-2. In addition, reduced dielectric loss of 0.055 was achieved with high dielectric constant of 1369. Optimized nonlinear and dielectric properties were integrated to make the composites a promising dual-function varistor-capacitor candidate. Microstructure analysis discovered two areas with various Bi/Ca ratio, designated as Bi-H and Bi-L respectively. It was found that the maximum ratio of Bi-H/Bi-L heterogeneous interface corresponded to optimized nonlinear and dielectric performance, which was associated with elevated potential barrier height and huge grain boundary resistance. Combined with relaxation analysis, a core-shell structure was proposed to elaborate microstructure evolution in xBi_2/3Cu₃Ti₄O₁₂/(1-x)CaCu₃Ti₄O₁₂ composite. According to the core-shell model, variation of heterogeneous interface was illustrated on how to influence nonlinear properties, which was well fitted to experimental results.     

回采巷道过断层施工技术

受断层影响,巷道过断层期间掘进速度缓慢,影响采掘接替和矿井生产效率。为了更好地促进矿井生产,以23上04轨顺掘进为研究对象,采用FLAC 3D软件模拟巷道过断层时巷道围岩变形量和塑性区范围,并将围岩划分为正常围岩、过渡带和破碎带3部分。根据模拟结果可知,围岩变形量和塑性区范围都在过渡带开始增大,在破碎带达到最大值。巷道采用后退卧底法过断层,并对断层破碎带及时采用锚网索、注浆、U型钢棚进行支护,通过联合支护相互配合,可以共同提高巷道支护强度,增强巷道顶帮抗变形能力。     

Strengthened interfacial bonding and its effects on fracture mode of TaC ceramics with addition of B

TaC ceramics with 0-0.237 wt% B addition were prepared by hot pressing. The effect of B addition on the phase constitution, interfacial chemistry/bonding and mechanical properties of the TaC ceramics were investigated. Upon B addition, the elimination of O impurity and segregation of B at grain boundaries were evidenced, accompanied by an increase in bonding strength of the TaC grains, to result in a fracture mode change from intergranular to transgranular and a reduced fracture toughness. Addition of excessive B resulted in the formation of TaB₂ and C within TaC ceramics. Further, TaC-TaB₂-SiC composites were prepared by Si addition. Coherent bonding between TaB₂ and TaC was preserved in the TaC-TaB₂-SiC composites, and residual stresses due to thermal expansion mismatch of the different phases increased flexural strength and fracture toughness of the composites.     

Role of Nd-Ni on structural,spectral and dielectric properties of strontium-barium based nano-sized X-type ferrites

The influence of neodymium and nickel substitution on structural and dielectric parameters was investigated in strontium-barium X-type hexagonal ferrites having composition SrBaCu_2?xNi_xNd_yFe_28?yO₄₆ (x = 0, 0.2, 0.4, 0.6, 0.8, 1 and y = 0, 0.02, 0.04, 0.06, 0.08, 0.1). Sol-gel method was employed for synthesizing these hexagonal ferrites. The XRD plots of all studied materials which were annealed at 1250 °C show single phase characteristics. Lattice parameter ‘c’ increased as a consequence of larger radius of rare earth ion (Nd³⁺) as compared to (Fe³⁺), while lattice parameter ‘a’ showed very small variation. The cell volume was obtained in the range 2508.32–2523.75 (ų). The inclusion of Nd-Ni also affected X-ray density, bulk density and porosity. The FTIR spectroscopy indicated the particular absorption peaks of hexagonal ferrites and it was performed in the range of 500–700 cm^?1. On account of Nd-Ni doping, the dielectric constant, dielectric loss and AC-conductivity showed decreasing trend. The occupancy of Nd³⁺ ions at octahedral site impedes the valence alternation of Fe³⁺; therefore there was decrease in dielectric permittivity. Ac conductivity has been decreased from 9.14 to 6.49 (Ω cm)^?1 at frequency of 2.7 GHz. The Cole-Cole plots of synthesized materials noticeably revealed grain boundary contribution. The appearance of single semi-circle in impedance Cole-Cole graphs confirms the exceptional role of grain boundaries in the conduction process. The considerably lower dielectric parameters of investigated nano X-type ferrites propose their feasibility for high-frequency applications (phase shifters, dielectric resonators, stealth technology etc).     

Thermal Bending Analysis of Doubly Curved Composite Laminated Shell Panels with General Boundary Conditions and Laminations

Thermal bending analysis of doubly curved laminated shell panels with general boundary conditions and laminations is presented. The equations of equilibrium are derived in the form of two coupled sets of ordinary differential equations based on a general shell theory and solved through the state-space approach in a repeated manner. It is depicted that the results of the present method are in great agreement with analytical solutions. Cylindrical shell panels with general boundary conditions and laminations, where no analytical solution is available, are solved. It is found that the present method exhibits a high convergence rate as well as presenting accurate results in all cases.     

氧化石墨烯改性碳纤维复合材料抗冲击行为研究

使用单层纳米氧化石墨烯（NGO）粒子对环氧树脂进行改性处理，采用真空辅助树脂传递模塑成型工艺制备了[±45/0/90]_2S铺层角度下的纯树脂及单层NGO改性碳纤维复合材料（CFRP）层合板。通过落锤冲击试验、超声C扫描检测、冲击后压缩试验等对纯树脂及单层NGO改性CFRP进行实验研究。结果表明，纯树脂及单层NGO改性CFRP在损伤阻抗及损伤容限实验中均存在拐点现象，且拐点出现在相同深度位置，其中纯树脂CFRP拐点位置为0.51 mm，单层NGO改性CFRP拐点位置为0.43 mm；相对于纯树脂CFRP，单层NGO改性CFRP可以显著提高复合材料的抗冲击性能及冲击后的压缩性能；通过对冲击后凹坑深度及凹坑面积进行数据模拟，可以用拟合公式实现对复合材料的损伤预测。     

A Novel Beam Search to Improve Neural Machine Translation for English-Chinese

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, overcoming the weaknesses of conventional phrase-based translation systems. Although NMT based systems have gained their popularity in commercial translation applications, there is still plenty of room for improvement. Being the most popular search algorithm in NMT, beam search is vital to the translation result. However, traditional beam search can produce duplicate or missing translation due to its target sequence selection strategy. Aiming to alleviate this problem, this paper proposed neural machine translation improvements based on a novel beam search evaluation function. And we use reinforcement learning to train a translation evaluation system to select better candidate words for generating translations. In the experiments, we conducted extensive experiments to evaluate our methods. CASIA corpus and the 1,000,000 pairs of bilingual corpora of NiuTrans are used in our experiments. The experiment results prove that the proposed methods can effectively improve the English to Chinese translation quality.     

Automated classification of simulated wind field patterns from multiphysics ensemble forecasts

In this study, we have proposed an automated classification approach to identify meaningful patterns in wind field data. Utilizing an extensive simulated wind database, we have demonstrated that the proposed approach can identify low‐level jets, near‐uniform profiles, and other patterns in a reliable manner. We have studied the dependence of these wind profile patterns on locations (eg, offshore vs onshore), seasons, and diurnal cycles. Furthermore, we have found that the probability distributions of some of the patterns depend on the underlying planetary boundary layer schemes in a significant way. The future potential of the proposed approach in wind resource assessment and, more generally, in mesoscale model parameterization improvement is touched upon in this paper.