When Does Communication Learning Need Hierarchical Multi-Agent Deep Reinforcement Learning

Abstract

Multi-agent systems need to communicate to coordinate a shared task. We show that a recurrent neural network (RNN) can learn a communication protocol for coordination, even if the actions to coordinate are performed steps after the communication phase. We show that a separation of tasks with different temporal scale is necessary for successful learning. We contribute a hierarchical deep reinforcement learning model for multi-agent systems that separates the communication and coordination task from the action picking through a hierarchical policy. We further on show, that a separation of concerns in communication is beneficial but not necessary. As a testbed, we propose the Dungeon Lever Game and we extend the Differentiable Inter-Agent Learning (DIAL) framework. We present and compare results from different model variations on the Dungeon Lever Game.     

Controlled Secure Direct Communication Protocol via the Three-Qubit Partially Entangled Set of States

In this paper, we first re-examine the previous protocol of controlled quantum secure direct communication of Zhang et al.’s scheme, which was found insecure under two kinds of attacks, fake entangled particles attack and disentanglement attack. Then, by changing the party of the preparation of cluster states and using unitary operations, we present an improved protocol which can avoid these two kinds of attacks. Moreover, the protocol is proposed using the three-qubit partially entangled set of states. It is more efficient by only using three particles rather than four or even more to transmit one bit secret information. Given our using state is much easier to prepare for multiqubit states and our protocol needs less measurement resource, it makes this protocol more convenient from an applied point of view.     

以用户为中心的可见光通信协作传输中训练资源分配算法

以用户为中心的可见光通信协作传输是近年来出现的新架构,这导致虚拟小区之间出现重叠。为避免导频污染问题,每个虚拟小区中的光接入点(AP)或者虚拟小区中选择相同AP的用户发送的训练序列应该是正交的。针对可见光通信中以用户为中心的协作网络,研究训练资源的正交分配问题,提出了一种新的导频分配算法,联合导频分配和用户选择问题,以期最大限度地增加虚拟小区内可被接入的用户数。分析和仿真结果表明,该导频分配方案可以有效改善导频污染问题,提高训练资源利用率,并且相比已有的导频分配方案,性能有所改进。     

智能化救援监控系统在煤矿安全生产中的应用

针对煤矿发生事故后传统救援监控系统无法实时对井下人员进行动态定位，导致矿井救援盲目性大、救援效率差、救援难度大等技术难题，为了进一步提高煤矿救援效率，通过技术研究，设计了一套以通信基站为核心的智能化救援监控系统，分析了该系统结构组成、工作原理，通过在担水沟煤矿井下实际应用效果来看，智能化救援监控系统对人员定位精准度达95%，实现人员动态位置三维成像，救援效率提高至80%以上，有效缩短了煤矿事故救援时间，取得了显著应用成效。     

Digital self-control interventions for distracting media multitasking - A systematic review

Digital distractions can interfere with goal attainment and lead to undesirable habits that are hard to get red rid of. Various digital self-control interventions promise support to alleviate the negative impact of digital distractions. These interventions use different approaches, such as the blocking of apps and websites, goal setting, or visualizations of device usage statistics. While many apps and browser extensions make use of these features, little is known about their effectiveness. This systematic review synthesizes the current research to provide insights into the effectiveness of the different kinds of interventions. From a search of the ‘ACM’, ‘Springer Link’, ‘Web of Science’, ’IEEE Xplore’ and ‘Pubmed’ databases, we identified 28 digital self-control interventions. We categorized these interventions according to their features and their outcomes. The interventions showed varying degrees of effectiveness, and especially interventions that relied purely on increasing the participants' awareness were barely effective. For those interventions that sanctioned the use of distractions, the current literature indicates that the sanctions have to be sufficiently difficult to overcome, as they will otherwise be quickly dismissed. The overall confidence in the results is low, with small sample sizes, short study duration, and unclear study contexts. From these insights, we highlight research gaps and close with suggestions for future research.     

Factors involved in associations between Facebook use and college adjustment: Social competence,perceived usefulness,and use patterns

Although previous research has investigated widespread use of social media, especially Facebook, by youth attending college, the conditions under which these media foster adjustment to college remain unclear. This study tested a model illuminating pathways linking social competence to college adjustment via students’ perceptions about the usefulness of Facebook and ways in which they used the medium. Self-report survey data from 321 college students (M age = 20.09; 58% female; 84% Caucasian) attending a major Midwestern university supported the proposed model, indicating that higher social competence could foster or impede college adjustment, depending upon how it was related to beliefs about the usefulness of different Facebook functions and how these perceptions, in turn, were associated with patterns of Facebook use. Findings underscore the importance of considering connections among personal attributes, perception of media effectiveness, and media behaviors in assessing the implications of social media for users’ psychosocial well-being.     

一种实用的多数据库量子信息检索协议

针对目前量子私有信息检索不能适用与云存储的多数据库问题,基于现在成熟的量子密钥分发方法,提出了一种适合在多数据库环境下,实用的量子私有信息检索协议。对于不同大小的数据库,协议可通过调节参数θ和k,在保证数据库安全及用户隐私的情况下,完成信息的检索。性能分析结果表明,协议的通信复杂度低,检索成功率高、易于实施。     

卫星激光通信粗跟踪系统复合控制策略

针对卫星激光通信粗跟踪系统的跟踪稳定精度指标要求高的特点,建立了基于永磁同步电机直接驱动的粗跟踪系统模型并进行了跟踪稳定误差分析。在采用传统PID控制策略存在跟踪误差较大、动态性能较差等不足的基础上,提出了一种基于粗跟踪系统的改进型前馈复合控制策略。从理论上分析了前馈复合控制策略提高了粗跟踪系统的动态性能,为降低跟踪稳定误差提供了改善方案。地面实验验证结果表明,与传统控制策略相比,改进型复合控制策略极大地降低了系统的动态跟踪误差,动态跟踪误差由606μrad降低至13μrad(1δ)。进一步的在轨实验也验证了改进型复合控制策略的合理性和先进性,总体指标满足了卫星激光通信终端的极高精度要求。本文所提出的控制策略对其他高性能跟踪伺服系统设计也具有较大的借鉴意义。     

Optimal filtering and control for wireless networked closed-loop control systems

This article studies the optimal filtering and control for wireless networked control systems (WNCSs). In WNCSs, packets may be lost in both control and feedback channels and user datagram protocol is usually used to improve the performance of the real-time control. Relevant literature indicates that the conventional optimal filtering for such a system cannot be applied in practice due to the complex calculation with Gaussian mixtures. This paper proposes a novel scheme to realize the optimal filtering and the linear quadratic Gaussian control for WNCSs, in which the controlled node performs a local estimation and the remote-control node performs the final estimation and control, and a synchronization of two estimators is guaranteed by a communication mechanism. An optimal filtering algorithm is developed, the stability condition of the filtering error covariance is obtained, optimal finite-horizon and infinite-horizon control are derived, and the stability of the closed-loop control system is proved. Numerical simulations show the validity and feasibility of the theoretical results.