基于Q-learning的不确定环境BDI Agent最优策略规划研究

BDI模型能够很好地解决在特定环境下的Agent的推理和决策问题,但在动态和不确定环境下缺少决策和学习的能力。强化学习解决了Agent在未知环境下的决策问题,却缺少BDI模型中的规则描述和逻辑推理。针对BDI在未知和动态环境下的策略规划问题,提出基于强化学习Q-learning算法来实现BDI Agent学习和规划的方法,并针对BDI的实现模型ASL的决策机制做出了改进,最后在ASL的仿真平台Jason上建立了迷宫的仿真,仿真实验表明,在加入Q-learning学习机制后的新的ASL系统中,Agent在不确定环境下依然可以完成任务。     

乌江索风营水电站地下厂房岩锚梁镜面混凝土施工技术

镜面混凝土是水电工程建设中新兴的一门施工技术,在乌江索风营水电站地下厂房岩锚梁混凝土施工中采用了镜面混凝土,这在技术上是一次大胆的尝试和创新,既满足了功能上的要求,同时也达到了美观和装饰地下厂房的效果,为今后水电工程施工中广泛采用镜面混凝土技术提供了样本和宝贵经验。     

Uplink Scheduling in CDMA Packet-Data Systems

Uplink scheduling in wireless systems is gaining importance due to arising uplink intensive data services (ftp, image uploads etc.), which could be hampered by the currently in-built asymmetry in favor of the downlink. In this work, we propose and study algorithms for efficient uplink packet-data scheduling in a CDMA cell. The algorithms attempt to maximize system throughput under transmit power limitations on the mobiles assuming instantaneous knowledge of user queues and channels. However no channel statistics or traffic characterization is necessary. Apart from increasing throughput, the algorithms also improve fairness of service among users, hence reducing chances of buffer overflows for poorly located users. The major observation arising from our analysis is that it is advantageous on the uplink to schedule “strong” users one-at-a-time, and “weak” users in larger groups. This contrasts with the downlink where one-at-a-time transmission for all users has shown to be the preferred mode in much previous work. Based on the optimal schedules, we propose less complex and more practical approximate methods, both of which offer significant performance improvement compared to one-at-a-time transmission, and the widely acclaimed Proportional Fair (PF) algorithm, in simulations. When queue content cannot be fed back, we propose a simple modification of PF, Uplink PF (UPF), that offers similar improvement. Hereafter, we refer to users with low recieved power at the base even when transmitting at peak transmit power as “weak” users, and the strongly recieved users at the base as “strong” users. Krishnan Kumaran is currently a member of the Complex Systems Modeling section in the Corporate Strategic Research of ExxonMobil Corp., Clinton, NJ. Formerly, he was a Member of Technical Staff in the Mathematics of Networks and Systems Research Department at Bell Labs in Murray Hill, NJ, where his research interests were in modeling, analysis and simulation of design, resource management and scheduling issues in telecommunication networks. Lijun Qian is an assistant professor in the Department of Electrical Engineering at Prairie View A&M University. He received his B.S. from Tsinghua University in Beijing, M.S. from Technion-Israel Institute of Technology, and Ph.D. from WINLAB, Rutgers University, all in electrical engineering. Before joining PVAMU, he was a researcher at Networks and Systems Research Department of Bell Labs in Murray Hill, NJ. His major research interests are in wireless communications and networking technologies, especially in radio resource management, protocol design, TCP/RLP optimization and MPLS traffic engineering.     

Defocusing image to pattern contact holes using attenuated phase shift masks

The patterning of contact holes by selecting out-of-focus image plane (defocus) using attenuated phase shift masks (APSM) has been studied. Defocus is found to enhance the image modulation at low partial coherence for contact holes with negative local average of mask function. Semi-dense holes up to 130 nm in 8% APSM have been printed by 0.5 μm defocus at a partial coherence of 0.31 using KrF scanner with highest numerical aperture of 0.68. However, these holes were closed with in-focus imaging. Defocus is also found to be beneficial for patterning the pitches that have extensive side lobes with in-focus imaging.     

世界原油质量趋势及我国面临的挑战

评述了世界原油质量趋势、我国重质油现状以及我国加工含硫原油的现状和前景。     

Layered Wyner-Ziv video coding.

Following recent theoretical works on successive Wyner-Ziv coding (WZC), we propose a practical layered Wyner-Ziv video coder using the DCT, nested scalar quantization, and irregular LDPC code based Slepian-Wolf coding (or lossless source coding with side information at the decoder). Our main novelty is to use the base layer of a standard scalable video coder (e.g., MPEG-4/H.26L FGS or H.263+) as the decoder side information and perform layered WZC for quality enhancement. Similar to FGS coding, there is no performance difference between layered and monolithic WZC when the enhancement bitstream is generated in our proposed coder. Using an H.26L coded version as the base layer, experiments indicate that WZC gives slightly worse performance than FGS coding when the channel (for both the base and enhancement layers) is noiseless. However, when the channel is noisy, extensive simulations of video transmission over wireless networks conforming to the CDMA2000 1X standard show that H.26L base layer coding plus Wyner-Ziv enhancement layer coding are more robust against channel errors than H.26L FGS coding. These results demonstrate that layered Wyner-Ziv video coding is a promising new technique for video streaming over wireless networks.     

Gamma-irradiation-induced Ag/SiO2 composite films and their optical absorption properties

Small Ag particles or clusters dispersed mesoporous SiO₂ composite films were prepared by a new method: First the matrix SiO₂ films were prepared by sol-gel process combined with the dip-coating technique, then they were soaked in AgNO₃ solutions followed by irradiation of γ-ray at room temperature and in ambient pressure. The structures of these films were examined by X-ray diffraction (XRD), high-resolution transmission electron microscope (HRTEM), and optical absorption spectroscopy. It has been shown that the Ag particles grown within the porous SiO₂ films are very small, and they are isolated and dispersed from each other with very narrow size distributions. With increasing the soaking concentration and an additional annealing, an opposite peakshift effect of the surface plasmon resonance (SPR) was observed in the optical absorption measurements.     

光通信技术发展的新亮点

自光通信问世以来，经历了研究探索、实用化、推广应用、快速发展等时期，直至2001年，达到急剧发展的高潮。随着世界经济的滑坡，通信行业的不景气，使光通信也进入了寒冷的冬天。实际上，即使在经济低速的时期，光通信的技术依然没有停止发展，而且出现了不少继续将光通信推向前进的新亮点。从技术和应用的角度，简要介绍一些光通信的新技术。     

煤矿生产、安全调度LED电子大屏幕显示系统的设计

通过比较煤矿生产、安全调度显示方式的优缺点，提出和分析了适合于煤矿生产安全调度的ＬＥＤ电子大屏幕显示系统配置、功能及特点。