基于Q-learning的不确定环境BDI Agent最优策略规划研究

BDI模型能够很好地解决在特定环境下的Agent的推理和决策问题,但在动态和不确定环境下缺少决策和学习的能力。强化学习解决了Agent在未知环境下的决策问题,却缺少BDI模型中的规则描述和逻辑推理。针对BDI在未知和动态环境下的策略规划问题,提出基于强化学习Q-learning算法来实现BDI Agent学习和规划的方法,并针对BDI的实现模型ASL的决策机制做出了改进,最后在ASL的仿真平台Jason上建立了迷宫的仿真,仿真实验表明,在加入Q-learning学习机制后的新的ASL系统中,Agent在不确定环境下依然可以完成任务。     

乌江索风营水电站地下厂房岩锚梁镜面混凝土施工技术

镜面混凝土是水电工程建设中新兴的一门施工技术,在乌江索风营水电站地下厂房岩锚梁混凝土施工中采用了镜面混凝土,这在技术上是一次大胆的尝试和创新,既满足了功能上的要求,同时也达到了美观和装饰地下厂房的效果,为今后水电工程施工中广泛采用镜面混凝土技术提供了样本和宝贵经验。     

Synthesis of amphiphilic magnetic microspheres by dispersion copolymerization of styrene and poly(ethylene oxide) macromonomer

Amphiphilic magnetic microspheres ranging in diameter from 5 to 100 µm were prepared by dispersion copolymerization of styrene and poly(ethylene oxide) vinylbenzyl (PEO‐VB) macromonomer (MPEO) in the presence of Fe₃O₄ magnetic fluid. The effects of various polymerization parameters on the average particle size were systematically investigated. The average particle size was found to increase with increasing styrene concentration and initiator concentration. It also increased with decreasing stabilizer concentration and molecular weight of MPEO. The content of the hydroxyl groups localized in the microspheres ranged from 0.01 to 0.2 mmol g^?1. © 2003 Society of Chemical Industry     

住宅设计的分析与研究

总结了住宅设计的发展,概括了住宅各个功能区的特点。通过设计的实例说明了各不同功能区的设计,成果可供进一步的研究参考。     

Uplink Scheduling in CDMA Packet-Data Systems

Uplink scheduling in wireless systems is gaining importance due to arising uplink intensive data services (ftp, image uploads etc.), which could be hampered by the currently in-built asymmetry in favor of the downlink. In this work, we propose and study algorithms for efficient uplink packet-data scheduling in a CDMA cell. The algorithms attempt to maximize system throughput under transmit power limitations on the mobiles assuming instantaneous knowledge of user queues and channels. However no channel statistics or traffic characterization is necessary. Apart from increasing throughput, the algorithms also improve fairness of service among users, hence reducing chances of buffer overflows for poorly located users. The major observation arising from our analysis is that it is advantageous on the uplink to schedule “strong” users one-at-a-time, and “weak” users in larger groups. This contrasts with the downlink where one-at-a-time transmission for all users has shown to be the preferred mode in much previous work. Based on the optimal schedules, we propose less complex and more practical approximate methods, both of which offer significant performance improvement compared to one-at-a-time transmission, and the widely acclaimed Proportional Fair (PF) algorithm, in simulations. When queue content cannot be fed back, we propose a simple modification of PF, Uplink PF (UPF), that offers similar improvement. Hereafter, we refer to users with low recieved power at the base even when transmitting at peak transmit power as “weak” users, and the strongly recieved users at the base as “strong” users. Krishnan Kumaran is currently a member of the Complex Systems Modeling section in the Corporate Strategic Research of ExxonMobil Corp., Clinton, NJ. Formerly, he was a Member of Technical Staff in the Mathematics of Networks and Systems Research Department at Bell Labs in Murray Hill, NJ, where his research interests were in modeling, analysis and simulation of design, resource management and scheduling issues in telecommunication networks. Lijun Qian is an assistant professor in the Department of Electrical Engineering at Prairie View A&M University. He received his B.S. from Tsinghua University in Beijing, M.S. from Technion-Israel Institute of Technology, and Ph.D. from WINLAB, Rutgers University, all in electrical engineering. Before joining PVAMU, he was a researcher at Networks and Systems Research Department of Bell Labs in Murray Hill, NJ. His major research interests are in wireless communications and networking technologies, especially in radio resource management, protocol design, TCP/RLP optimization and MPLS traffic engineering.     

电信企业信息化统一模型构建策略

电信企业信息化的实质就是赋予电信企业精细化的企业资源整合能力，本以此认识为出发点，通过定义基本的信息化业务元素，需求参数和基本信息处理机制，构建出带有行业共性的电信企业信息化统一模型，该模型针对目前电信企业信息化中常见的和潜在的问题提供了有效的解决措施。     

世界原油质量趋势及我国面临的挑战

评述了世界原油质量趋势、我国重质油现状以及我国加工含硫原油的现状和前景。     

Layered Wyner-Ziv video coding.

Following recent theoretical works on successive Wyner-Ziv coding (WZC), we propose a practical layered Wyner-Ziv video coder using the DCT, nested scalar quantization, and irregular LDPC code based Slepian-Wolf coding (or lossless source coding with side information at the decoder). Our main novelty is to use the base layer of a standard scalable video coder (e.g., MPEG-4/H.26L FGS or H.263+) as the decoder side information and perform layered WZC for quality enhancement. Similar to FGS coding, there is no performance difference between layered and monolithic WZC when the enhancement bitstream is generated in our proposed coder. Using an H.26L coded version as the base layer, experiments indicate that WZC gives slightly worse performance than FGS coding when the channel (for both the base and enhancement layers) is noiseless. However, when the channel is noisy, extensive simulations of video transmission over wireless networks conforming to the CDMA2000 1X standard show that H.26L base layer coding plus Wyner-Ziv enhancement layer coding are more robust against channel errors than H.26L FGS coding. These results demonstrate that layered Wyner-Ziv video coding is a promising new technique for video streaming over wireless networks.     

连续波雷达测距中的解模糊技术

研究连续波雷达测距中的距离模糊问题，分析几种常用解模糊方法的性能，并讨论参差比的选取对测距范围的影响。