Point-based online value iteration algorithm in large POMDP

Partially observable Markov decision process (POMDP) is an ideal framework for sequential decision-making under uncertainty in stochastic domains. However, it is notoriously computationally intractable to solving POMDP in real-time system. In order to address this problem, this paper proposes a point-based online value iteration (PBOVI) algorithm which involves performing value backup at specific reachable belief points, rather than over the entire belief simplex, to speed up computation processes, exploits branch-and-bound pruning approach to prune the AND/OR tree of belief states online, and proposes a novel idea to reuse the belief states that have been searched to avoid repeated computation. The experiment and simulation results show that the proposed algorithm can simultaneously satisfy the requirement of low errors and high timeliness in real-time system.     

Preparation,characterization, and adsorption properties for metal ions of a novel chelating resin containing sulfoxide and diethylene glycol

A novel chelating resin containing sulfoxide and diethylene glycol, poly{4‐vinylbenzyl‐[2‐2‐(hydroxyethyl)ethoxyl]sulfoxide} (PVESO) was synthesized using chloromethylated polystyrene (PS‐Cl) as material. Its structure was characterized by elemental analysis, infrared spectra, and scanning electron microscopy (SEM). The adsorption capacities of the resin for Hg²⁺, Ag⁺, Cu²⁺, Zn²⁺, and Pb²⁺ at various pH values were determined. The maximum adsorption capacities for Hg²⁺ and Ag⁺ were 1.56 and 0.75 mmol g^?1 respectively. The resin had high selectivity for Hg²⁺ and Ag⁺ over the pH range 1.0–7.0. The adsorption capacities for Hg²⁺ and Ag⁺ under competitive condition were also determined by batch experiment method. In addition, the adsorption kinetics of the resin towards Hg²⁺ at different temperatures was also investigated. The results showed that the adsorption rate was governed by film diffusion at 20°C and 25°C, by particle diffusion at 30°C and 35°C. © 2006 Wiley Periodicals, Inc. J Appl Polym Sci 102: 6054–6059, 2006     

玻璃钢筋混凝土的有限元计算与试验

钢筋混凝土广泛应用于土木工程领域，但其结构耐久性因钢筋本身的锈蚀成为现今急待解决的问题。人们一直在寻找对钢筋混凝土进行改良的途径，用玻璃钢筋代替普通钢筋是解决这一问题的一个有效的方法，为此进行了试验和ANSYS有限元分析，结果证明此法具有可行性。     

Phase Assemblages of Pr α-sialon Derived from SHS-ed Powders and TEM Study on the Nucleation of Pr α-sialon

The Pr α-sialon powders prepared by self-propagating high-temperature synthesis (SHS), consisting of 55 wt% Pr α-sialon and 45 wt% of β-sialon (abbreviated as α' and β'), were hot-pressed at 1800°C for 1 h. The results showed that Pr α' phase would transfer to β' with the appearance of JEM phase (Pr(Si_{6− z} Al _z )(N_{10− z} O _z )) after sintering, thus resulting in the increase of β' phase to 86 wt%. The addition of Y₂O₃ into SHS-ed Pr α' powders as the starting materials restrains the transformation of α' to β' and prevents the formation of JEM phase as well. The nucleation mechanism of Pr α' grain during hot-pressing was investigated in terms of transmission electron microscope and energy-dispersive spectrometer analysis. Two nucleation modes of Pr α' grains were found, i.e., nucleating on the undissolved Pr α' grains and on the nuclei of (Pr, Y) α' grains precipitated from liquid phase.     

Flow regime, hydrodynamics, floc size distribution and sludge properties in activated sludge bubble column, air-lift and aerated stirred reactors

This paper presents a comparative study how reactor configuration, sludge loading and air flowrate affect flow regimes, hydrodynamics, floc size distribution and sludge solids-liquid separation properties. Three reactor configurations were studied in bench scale activated sludge bubble column reactor (BCR), air-lift reactor (ALR) and aerated stirred reactor (ASR). The ASR demonstrated the highest capacity of gas holdup and resistance, and homogeneity in flow regimes and shearing forces, resulting in producing large numbers of small and compact flocs. The fluid dynamics in the ALR created regularly directed recirculation forces to enhance the gas holdup and sludge flocculation. The BCR distributed a high turbulent flow regime and non-homogeneity in gas holdup and mixing, and generated large numbers of larger and looser flocs. The sludge size distributions, compressibility and settleability were significantly influenced by the reactor configurations associated with the flow regimes and hydrodynamics.     

Relationship of hydrocarbon and source-rock in Nos.3-5 tectonic belts of the Lenghu area, northern Qaidam Basin

Based on analyses of the components of crude oil hydrocarbons and carbon isotopes, the content of normal alkane de-creased from 49.00% to 20.10% when moving from the No.3 to No.5 tectonic belt of the Lenghu area of the Qaidam Basin, while cycloalkanes increased from 30.00% to 52.20% and aromatic and branch chain alkanes increased gradually as well. The maturity of sterane in crude oil is higher than that of its source-rock, which shows that the hydrocarbons were generated from a deep source-rock of high maturity around the tectonic belts of the Lenghu area. The analysis of the characteristics of carbon isotopes also shows that these isotopes of hydrocarbon compounds in the No.4 and No.5 tectonic belt are apparently heavier than those in the No.3 belt. The results of our research show that the hydrocarbons in the No.3 tectonic belt are mainly from a relatively rich sapropelic substance, while the hydrocarbons in the No.4 and No.5 tectonic belt originated mainly from organic matter of a rela-tively rich humic type substance.     

金属离子掺杂TiO2光催化材料的光催化性能研究

用溶胶-凝胶法制备金属离子掺杂的TiO2光催化剂,以紫外灯和太阳光为光源,用罗丹明B溶液为模拟废水,研究TiO2掺杂金属离子催化剂光催化性能,探讨金属离子的半径、价态及电子构型等因素对掺杂TiO2催化活性的影响.     

一款新型太阳辐射测量仪的结构设计与热仿真

近年来由于人类生产活动日益加剧,引起的大气气溶胶和臭氧等大气粒子含量的变化对全球气候变化有着重要影响.为了监测上述大气粒子含量,在总结国内外研究现状的基础上,提出使用合理的温控结构来设计制造一款新型多波段太阳辐射测量仪,用来适应国内纬度跨越大、温差大的工作环境.新型太阳辐射测量仪涵盖可见-红外波段,采用九个带通滤光片分别对应两个光电探测器的结构,可以避免探测器相互定标引起的定标误差并减少定标工作量.经ANSYS Workbench热-力耦合仿真,上述太阳辐射测量仪所采用的温控结构在两个极端温度条件下的变形量满足设计要求.     

Research on Action Strategies and Simulations of DRL and MCTS-based Intelligent Round Game

International Journal of Control, Automation and Systems - The reinforcement learning problem of complex action control in multiplayer online battlefield games has brought considerable interest in...     

一种基于并联机构的航天器姿态模拟装置的设计开发

航天器发射升空前进行地面测试和试验是航天器研制过程中的重要环节。文中针对一种基于并联机构的姿态模拟装置的设计开发,从位置分析、速度分析和虚拟样机的建造和仿真分析等方面对3UPS-PU并联机构进行研究,完成姿态模拟装置的设计,为航天器装配、试验和测试设备的设计提供一种新的思路。