基于Q-learning的不确定环境BDI Agent最优策略规划研究

BDI模型能够很好地解决在特定环境下的Agent的推理和决策问题,但在动态和不确定环境下缺少决策和学习的能力。强化学习解决了Agent在未知环境下的决策问题,却缺少BDI模型中的规则描述和逻辑推理。针对BDI在未知和动态环境下的策略规划问题,提出基于强化学习Q-learning算法来实现BDI Agent学习和规划的方法,并针对BDI的实现模型ASL的决策机制做出了改进,最后在ASL的仿真平台Jason上建立了迷宫的仿真,仿真实验表明,在加入Q-learning学习机制后的新的ASL系统中,Agent在不确定环境下依然可以完成任务。     

Enhancing urban infrastructure investment planning practices for a changing climate.

Climate change raises many concerns for urban water management because of the effects on all aspects of the hydrological cycle. Urban water infrastructure has traditionally been designed using historical observations and assuming stationary climatic conditions. The capability of this infrastructure, whether for storm-water drainage, or water supply, may be over- or under-designed for future climatic conditions. In particular, changes in the frequency and intensity of extreme rainfall events will have the most acute effect on storm-water drainage systems. Therefore, it is necessary to take future climatic conditions into consideration in engineering designs in order to enhance water infrastructure investment planning practices in a long time horizon. This paper provides the initial results of a study that is examining ways to enhance urban infrastructure investment planning practices against changes in hydrologic regimes for a changing climate. Design storms and intensity-duration-frequency curves that are used in the engineering design of storm-water drainage systems are developed under future climatic conditions by empirically adjusting the general circulation model output, and using the Gumbel distribution and the Chicago method. Simulations are then performed on an existing storm-water drainage system from NE Calgary to investigate the resiliency of the system under climate change.     

Ecophysiology and niche differentiation of Nitrospira-like bacteria, the key nitrite oxidizers in wastewater treatment plants.

Nitrite-oxidizing bacteria of the genus Nitrospira are key nitrifiers in wastewater treatment plants. Pure cultures of these organisms are unavailable, but cultivation-independent molecular methods make it possible to detect Nitrospira-like bacteria in environmental samples and to investigate their ecophysiology. Comprehensive screening of natural and engineered habitats and of public databases for 16S rRNA sequences of Nitrospira-like bacteria revealed a surprisingly high biodiversity in the genus Nitrospira, which comprises at least four phylogenetic sublineages. All Nitrospira-like bacteria detected in wastewater treatment plants belonged to the sublineages I and II. Subsequently, the population dynamics of different Nitrospira-like bacteria were monitored, by quantitative fluorescence in situ hybridization with rRNA-targeted probes, confocal laser scanning microscopy and digital image analysis, during incubation of nitrifying activated sludge in media containing different nitrite concentrations. These experiments showed that Nitrospira-like bacteria, which were affiliated with the phylogenetic sublineages I or II of the genus Nitrospira, responded differently to nitrite concentration shifts. Previously unknown properties of Nitrospira-like bacteria were discovered in the course of an environmental genomics project. Implications of the obtained results for fundamental understanding of the microbial ecology of nitrite oxidizers as well as for future improvement of nutrient removal in wastewater treatment plants are discussed.     

Optimizing the tapping regime on a blast furnace operating at variable speed

The main factors that determine the uniformity with which smelting products are tapped from a blast furnace are the rate of accumulation of the products in the hearth and the tapping rate. The first parameter is in turn determined by the stability of the furnace’s operation and can vary significantly even over the course of 24 h. The second parameter is determined mainly by the condition of the iron notch, the maintenance it receives, any changes that occur in the diameter of the channel of the notch, and the quality of the materials used to form the notch. Recommendations are presented to optimize tapping of the smelting products.     

Reliable eye-diagram analysis of data links via device macromodels

This paper addresses the impact of device macromodels on the accuracy of signal integrity and performance predictions for critical digital interconnecting systems. It exploits nonlinear parametric models for both single-ended and differential devices, including the effects of power supply fluctuations and receiver bit detection. The analysis demonstrates that the use of well-designed macromodels dramatically speeds up the simulation as well it preserves timing accuracy even for long bit sequences.     

Catalytic epoxidation of olefins in the presence of a vanadyl porphyrin complex

It was found that vanadyl porphyrin complexes synthesized from petroleum metal porphyrin concentrates stimulated epoxidation during the olefin oxygenation process. The yields of obtained oxiranes turned out to be 38–75%, depending on the olefin structure. An epoxidation mechanism that suggests the formation of a protonated dioxygen adduct as an intermediate during oxygenation of olefins in the presence of vanadyl porphyrin complexes was proposed. An analogy is drawn between the epoxide formation reaction upon the catalytic oxygenation of olefins and the Prilezhaev reaction.     

Vacuum degassing of chromium-nickel-molybdenum steel at the Magnitogorsk Metallurgical Combine

The Magnitogorsk Metallurgical Combine has conducted a study of the effect of technological factors on the hydrogen content of chromium-nickel-molybdenum steel after vacuum degassing. It was established that the most important factor is the hydrogen content of the steel before the degassing operation. The study also determined the effects of the circulation coefficient, the duration of the degassing operation, and the vacuum used in the treatment. __________ Translated from Metallurg, No. 7, pp. 68–69, July, 2006.     

Java multimedia telecollaboration

Using Java-based tools in multimedia collaborative environments accessed over the Internet can increase an application's client base. Most operating systems support Java, and its "compile once-run everywhere" architecture is easy to maintain and update. The Java-based tools presented here let users share Internet resources, including resources originally designed for single use.     

Unresolved controversies concerning psychopathy: Implications for clinical and forensic decision making.

At some point in their careers, clinicians who work or consult in forensic and correctional settings will almost certainly encounter individuals who exhibit psychopathic personality features. Because of the widespread use of this disorder to inform legal and clinical decision making, psychologists should be exceedingly familiar with the relevant research literature on this topic before venturing into these settings. This article reviews the empirical bases of several clinically relevant claims and assertions regarding psychopathy and concludes that many areas of research are decidedly more equivocal in their findings than is commonly perceived. Although there is much to be gained by assessing psychopathy in various contexts, clinicians need to be cautious about drawing overzealous and empirically questionable conclusions about an important disorder that also has great potential for abuse. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Untersuchung der Verteilung und Intensität filamentierter Barrierenplasmen für die Behandlung von Oberflächen

The application of barrier discharges at atmospheric pressure in air expands on the market of plasma technology, because it is an ecological and cost‐effective alternative to other processes of surface treatment. These plasmas usually consist of a multitude of spatially and temporally localized filaments, whose distribution should be as even as possible for homogeneous treatment. This holds especially for the plasma treatment of sensitive goods such as wool or other textiles. In equipment for continuous pass of material the barrier arrangements often consist of a system cylinder – cylinder or cylinder – plane, whereby the gap width changes locally. Space distribution and intensity of filaments has been investigated by means of short‐time photography and spatially resolved measurement of current distribution and energy distribution derived from it. The local dependency found can be explained by means of a capacitive equivalent circuit.