When Does Communication Learning Need Hierarchical Multi-Agent Deep Reinforcement Learning

Abstract

Multi-agent systems need to communicate to coordinate a shared task. We show that a recurrent neural network (RNN) can learn a communication protocol for coordination, even if the actions to coordinate are performed steps after the communication phase. We show that a separation of tasks with different temporal scale is necessary for successful learning. We contribute a hierarchical deep reinforcement learning model for multi-agent systems that separates the communication and coordination task from the action picking through a hierarchical policy. We further on show, that a separation of concerns in communication is beneficial but not necessary. As a testbed, we propose the Dungeon Lever Game and we extend the Differentiable Inter-Agent Learning (DIAL) framework. We present and compare results from different model variations on the Dungeon Lever Game.     

Controlled Secure Direct Communication Protocol via the Three-Qubit Partially Entangled Set of States

In this paper, we first re-examine the previous protocol of controlled quantum secure direct communication of Zhang et al.’s scheme, which was found insecure under two kinds of attacks, fake entangled particles attack and disentanglement attack. Then, by changing the party of the preparation of cluster states and using unitary operations, we present an improved protocol which can avoid these two kinds of attacks. Moreover, the protocol is proposed using the three-qubit partially entangled set of states. It is more efficient by only using three particles rather than four or even more to transmit one bit secret information. Given our using state is much easier to prepare for multiqubit states and our protocol needs less measurement resource, it makes this protocol more convenient from an applied point of view.     

基于组合双向拍卖的云资源调度方法

针对跨数据中心的资源调度问题，提出了一种基于组合双向拍卖（PCDA）的资源调度方案。首先，将云资源拍卖分为三个部分：云用户代理报价、云资源提供商要价、拍卖代理组织拍卖；其次，在定义用户的优先级及任务紧迫度的基础上，在拍卖过程中估算每一个工作发生的服务等级协议（SLA）违规并以此计算云提供商的收益，同时每轮竞拍允许成交多项交易；最终达到根据用户等级合理分配云资源调度的效果。仿真实验结果表明该算法保证了竞拍成功率，与传统一次拍卖成交一项的组合双向拍卖方案相比，PCDA在竞拍时间段产生的能耗降低了35.00%，拍卖云提供商的利润提高了约38.84%。     

Potential of renewable energy system utilisation at decentralised level in the state of Uttarakhand in India

ABSTRACT

Design and implementation of an effective dissemination programme for decentralised renewable energy system necessitate an accurate estimate of its utilisation potential. Hence, in this study, an attempt has been made to develop frameworks to estimate the utilisation potential of decentralised renewable energy systems in the state of Uttarakhand in India. Estimations imply large resource, technical and economic potentials of the domestic solar water heater, solar home system, solar lantern, family size biogas plant and improved biomass cookstove in Uttarakhand. With higher impact on the purchasing power of households, prevailing soft loan scheme has been found to be more appropriate than a capital subsidy for promoting the usage of decentralised renewable energy systems.     

Coupling in situ experiments and modeling – Opportunities for data fusion,machine learning,and discovery of emergent behavior

This paper reviews recent studies, that not only includes both experiments and modeling components, but celebrates a close coupling between these techniques, in order to provide insights into the plasticity and failure of polycrystalline metals. Examples are provided of studies across multiple-scales, including, but not limited to, density functional theory combined with atom probe tomography, molecular dynamics combined with in situ transmission electron miscopy, discrete dislocation dynamics combined with nanopillars experiments, crystal plasticity combined with digital image correlation, and crystal plasticity combined with in situ high energy X-ray diffraction. The close synergy between in situ experiments and modeling provides new opportunities for model calibration, verification, and validation, by providing direct means of comparison, thus removing aspects of epistemic uncertainty in the approach. Further, data fusion between in situ experimental and model-based data, along with data driven approaches, provides a paradigm shift for determining the emergent behavior of deformation and failure, which is the foundation that underpins the mechanical behavior of polycrystalline materials.     

以用户为中心的可见光通信协作传输中训练资源分配算法

以用户为中心的可见光通信协作传输是近年来出现的新架构,这导致虚拟小区之间出现重叠。为避免导频污染问题,每个虚拟小区中的光接入点(AP)或者虚拟小区中选择相同AP的用户发送的训练序列应该是正交的。针对可见光通信中以用户为中心的协作网络,研究训练资源的正交分配问题,提出了一种新的导频分配算法,联合导频分配和用户选择问题,以期最大限度地增加虚拟小区内可被接入的用户数。分析和仿真结果表明,该导频分配方案可以有效改善导频污染问题,提高训练资源利用率,并且相比已有的导频分配方案,性能有所改进。     

智能化救援监控系统在煤矿安全生产中的应用

针对煤矿发生事故后传统救援监控系统无法实时对井下人员进行动态定位，导致矿井救援盲目性大、救援效率差、救援难度大等技术难题，为了进一步提高煤矿救援效率，通过技术研究，设计了一套以通信基站为核心的智能化救援监控系统，分析了该系统结构组成、工作原理，通过在担水沟煤矿井下实际应用效果来看，智能化救援监控系统对人员定位精准度达95%，实现人员动态位置三维成像，救援效率提高至80%以上，有效缩短了煤矿事故救援时间，取得了显著应用成效。     

Levelized cost of energy definition – An economic paradox

Using mean value theorem for integrals we show that the well-known LCOE definition is incorrect.     

A probabilistic load shedding concept considering highly volatile local generation

Automatic load shedding is the ultimate countermeasure against imbalance in a power system and can effectively help preventing large blackouts. Taking into account a high penetration of renewable energy sources (RES) in the distribution grid, a clear distinction between load and generation at the PCC becomes increasingly more difficult. For that reason an adaptation of frequency relay parameters and their locations of installation are necessary. In Europe this is rest on a multi-step plan based on values such as the yearly peak load. In this paper a novel probabilistic method for automatic load shedding is presented that uses the average values instead of peak values for load shedding. Its applicability is verified by a dynamic power system model that was developed to compare the classical and novel probabilistic load shedding principle. The method is verified using data from a German TSO.     

Factors involved in associations between Facebook use and college adjustment: Social competence,perceived usefulness,and use patterns

Although previous research has investigated widespread use of social media, especially Facebook, by youth attending college, the conditions under which these media foster adjustment to college remain unclear. This study tested a model illuminating pathways linking social competence to college adjustment via students’ perceptions about the usefulness of Facebook and ways in which they used the medium. Self-report survey data from 321 college students (M age = 20.09; 58% female; 84% Caucasian) attending a major Midwestern university supported the proposed model, indicating that higher social competence could foster or impede college adjustment, depending upon how it was related to beliefs about the usefulness of different Facebook functions and how these perceptions, in turn, were associated with patterns of Facebook use. Findings underscore the importance of considering connections among personal attributes, perception of media effectiveness, and media behaviors in assessing the implications of social media for users’ psychosocial well-being.