Point-based online value iteration algorithm in large POMDP

Partially observable Markov decision process (POMDP) is an ideal framework for sequential decision-making under uncertainty in stochastic domains. However, it is notoriously computationally intractable to solving POMDP in real-time system. In order to address this problem, this paper proposes a point-based online value iteration (PBOVI) algorithm which involves performing value backup at specific reachable belief points, rather than over the entire belief simplex, to speed up computation processes, exploits branch-and-bound pruning approach to prune the AND/OR tree of belief states online, and proposes a novel idea to reuse the belief states that have been searched to avoid repeated computation. The experiment and simulation results show that the proposed algorithm can simultaneously satisfy the requirement of low errors and high timeliness in real-time system.     

Preparation,characterization, and adsorption properties for metal ions of a novel chelating resin containing sulfoxide and diethylene glycol

A novel chelating resin containing sulfoxide and diethylene glycol, poly{4‐vinylbenzyl‐[2‐2‐(hydroxyethyl)ethoxyl]sulfoxide} (PVESO) was synthesized using chloromethylated polystyrene (PS‐Cl) as material. Its structure was characterized by elemental analysis, infrared spectra, and scanning electron microscopy (SEM). The adsorption capacities of the resin for Hg²⁺, Ag⁺, Cu²⁺, Zn²⁺, and Pb²⁺ at various pH values were determined. The maximum adsorption capacities for Hg²⁺ and Ag⁺ were 1.56 and 0.75 mmol g^?1 respectively. The resin had high selectivity for Hg²⁺ and Ag⁺ over the pH range 1.0–7.0. The adsorption capacities for Hg²⁺ and Ag⁺ under competitive condition were also determined by batch experiment method. In addition, the adsorption kinetics of the resin towards Hg²⁺ at different temperatures was also investigated. The results showed that the adsorption rate was governed by film diffusion at 20°C and 25°C, by particle diffusion at 30°C and 35°C. © 2006 Wiley Periodicals, Inc. J Appl Polym Sci 102: 6054–6059, 2006     

玻璃钢筋混凝土的有限元计算与试验

钢筋混凝土广泛应用于土木工程领域，但其结构耐久性因钢筋本身的锈蚀成为现今急待解决的问题。人们一直在寻找对钢筋混凝土进行改良的途径，用玻璃钢筋代替普通钢筋是解决这一问题的一个有效的方法，为此进行了试验和ANSYS有限元分析，结果证明此法具有可行性。     

Phase Assemblages of Pr α-sialon Derived from SHS-ed Powders and TEM Study on the Nucleation of Pr α-sialon

The Pr α-sialon powders prepared by self-propagating high-temperature synthesis (SHS), consisting of 55 wt% Pr α-sialon and 45 wt% of β-sialon (abbreviated as α' and β'), were hot-pressed at 1800°C for 1 h. The results showed that Pr α' phase would transfer to β' with the appearance of JEM phase (Pr(Si_{6− z} Al _z )(N_{10− z} O _z )) after sintering, thus resulting in the increase of β' phase to 86 wt%. The addition of Y₂O₃ into SHS-ed Pr α' powders as the starting materials restrains the transformation of α' to β' and prevents the formation of JEM phase as well. The nucleation mechanism of Pr α' grain during hot-pressing was investigated in terms of transmission electron microscope and energy-dispersive spectrometer analysis. Two nucleation modes of Pr α' grains were found, i.e., nucleating on the undissolved Pr α' grains and on the nuclei of (Pr, Y) α' grains precipitated from liquid phase.     

Flow regime, hydrodynamics, floc size distribution and sludge properties in activated sludge bubble column, air-lift and aerated stirred reactors

This paper presents a comparative study how reactor configuration, sludge loading and air flowrate affect flow regimes, hydrodynamics, floc size distribution and sludge solids-liquid separation properties. Three reactor configurations were studied in bench scale activated sludge bubble column reactor (BCR), air-lift reactor (ALR) and aerated stirred reactor (ASR). The ASR demonstrated the highest capacity of gas holdup and resistance, and homogeneity in flow regimes and shearing forces, resulting in producing large numbers of small and compact flocs. The fluid dynamics in the ALR created regularly directed recirculation forces to enhance the gas holdup and sludge flocculation. The BCR distributed a high turbulent flow regime and non-homogeneity in gas holdup and mixing, and generated large numbers of larger and looser flocs. The sludge size distributions, compressibility and settleability were significantly influenced by the reactor configurations associated with the flow regimes and hydrodynamics.     

Relationship of hydrocarbon and source-rock in Nos.3-5 tectonic belts of the Lenghu area, northern Qaidam Basin

Based on analyses of the components of crude oil hydrocarbons and carbon isotopes, the content of normal alkane de-creased from 49.00% to 20.10% when moving from the No.3 to No.5 tectonic belt of the Lenghu area of the Qaidam Basin, while cycloalkanes increased from 30.00% to 52.20% and aromatic and branch chain alkanes increased gradually as well. The maturity of sterane in crude oil is higher than that of its source-rock, which shows that the hydrocarbons were generated from a deep source-rock of high maturity around the tectonic belts of the Lenghu area. The analysis of the characteristics of carbon isotopes also shows that these isotopes of hydrocarbon compounds in the No.4 and No.5 tectonic belt are apparently heavier than those in the No.3 belt. The results of our research show that the hydrocarbons in the No.3 tectonic belt are mainly from a relatively rich sapropelic substance, while the hydrocarbons in the No.4 and No.5 tectonic belt originated mainly from organic matter of a rela-tively rich humic type substance.     

一款新型太阳辐射测量仪的结构设计与热仿真

近年来由于人类生产活动日益加剧,引起的大气气溶胶和臭氧等大气粒子含量的变化对全球气候变化有着重要影响.为了监测上述大气粒子含量,在总结国内外研究现状的基础上,提出使用合理的温控结构来设计制造一款新型多波段太阳辐射测量仪,用来适应国内纬度跨越大、温差大的工作环境.新型太阳辐射测量仪涵盖可见-红外波段,采用九个带通滤光片分别对应两个光电探测器的结构,可以避免探测器相互定标引起的定标误差并减少定标工作量.经ANSYS Workbench热-力耦合仿真,上述太阳辐射测量仪所采用的温控结构在两个极端温度条件下的变形量满足设计要求.     

Research on Action Strategies and Simulations of DRL and MCTS-based Intelligent Round Game

International Journal of Control, Automation and Systems - The reinforcement learning problem of complex action control in multiplayer online battlefield games has brought considerable interest in...     

Polybrominated Diphenyl Ethers in Surface Sediment from Songhua River Basin, Northeast of China

Sixty sediment samples were collected from the main Songhua River in three years. Twelve polybrominated diphenyl ether ( PBDE) congeners ( BDE17, 28, 47, 66, 99, 100, 153, 154, 138, 183, and BDE?209) w...     

当前网络政治参与中存在的问题与对策

针对我国当前网络政治参与中存在着非法参与行为多、政务信息不公开致使公众政治参与缺乏信息基础、政府对公众网络政治参与的行为与观点缺乏回应等问题,本文提出了采取完善政治参与和网络政治参与的法治化机制,建立健全网络参政相关法规,保障公民网络参政议政权益,规范和打击非法政治参与行为;修改政府信息公开的法律法规,加大政府信息公开力度与规范网络监督机制;建立政府对公民网络政治参与的回应制度,以解决公民网络政治参与的相关问题,推动法治文明.