Deep reinforcement learning-based cooperative interactions among heterogeneous vehicular networks

Most real-world vehicle nodes can be structured into an interconnected network of vehicles. Through structuring these services and vehicle device interactions into multiple types, such internet of vehicles becomes multidimensional heterogeneous overlay networks. The heterogeneousness of the overlays makes it difficult for the overlay networks to coordinate with each other to improve their performance. Therefore, it poses an interesting but critical challenge to the effective analysis of heterogeneous virtual vehicular networks. A variety of virtual vehicular networks can be easily deployed onto the native network by applying the concept of SDN (Software Defined Networking). These virtual networks reflect their heterogeneousness due to their different performance goals, and they compete for the same physical resources of the underlying network, so that a sub-optimal performance of the virtual networks may be achieved. Therefore, we propose a Deep Reinforcement Learning (DRL) approach to make the virtual networks cooperate with each other through the SDN controller. A cooperative solution based on the asymmetric Nash bargaining is proposed for co-existing virtual networks to improve their performance. Moreover, the Markov Chain model and DRL resolution are introduced to leverage the heterogeneous performance goals of virtual networks. The implementation of the approach is introduced, and simulation results confirm the performance improvement of the latency sensitive, loss-rate sensitive and throughput sensitive heterogeneous vehicular networks using our cooperative solution.     

黑龙江省节水增粮行动(2012—2015年)实施方案

文章通过对黑龙江省高效节水现状,存在问题的分析,结合黑龙江省高效节水发展的支撑能力,阐述黑龙江省节水增粮目标、任务及总体布局,为黑龙江省2012—2015年节水增粮实施提供依据。     

Remote Steering of Self‐Propelling Microcircuits by Modulated Electric Field

The principles and design of “active” self‐propelling particles that can convert energy, move directionally on their own, and perform a certain function is an emerging multidisciplinary research field, with high potential for future technologies. A simple and effective technique is presented for on‐demand steering of self‐propelling microdiodes that move electroosmotically on water surface, while supplied with energy by an external alternating (AC) field. It is demonstrated how one can control remotely the direction of diode locomotion by electronically modifying the applied AC signal. The swimming diodes change their direction of motion when a wave asymmetry (equivalent to a DC offset) is introduced into the signal. The data analysis shows that the ability to control and reverse the direction of motion is a result of the electrostatic torque between the asymmetrically polarized diodes and the ionic charges redistributed in the vessel. This novel principle of electrical signal‐coded steering of active functional devices, such as diodes and microcircuits, can find applications in motile sensors, MEMs, and microrobotics.     

Supramolecular Glyco‐nanoparticles Toward Immunological Applications

Glyco‐mimicking nanoparticles (glyco‐NPs) with Förster resonance energy transfer (FRET) donor and acceptor groups formed via dynamic covalent bond of benzoboroxole and sugar from two complementary polymers are prepared. The glyco‐NPs are proved to be quite stable under physiological conditions but sensitive to pH. So the glyco‐NPs can be internalized by dendritic cells with integrity and nontoxicity and then dissociate within the acidic organelles. This particle dissociation is directly observed and visualized in vitro, for the first time via the FRET measurements and fluorescent microscopy. This feature makes controlled release of drug or protein by glyco‐NPs possible, i.e., when model antigen Ovalbumin is loaded in the glyco‐NPs, the released Ovalbumin in dendritic cells stimulates T cells more efficiently than the free Ovalbumin itself as a result of the enhanced antigen processing and presentation. Thus, the results enlighten a bright future of the glyco‐NPs in immunotherapy.     

Restructuring bank networks after mergers and acquisitions: A capacitated delocation model for closing and resizing branches

During restructuring processes, due to mergers and acquisitions, banks frequently face the problem of having redundant branches competing in the same market. In this work, we introduce a new Capacitated Branch Restructuring Model which extends the available literature in delocation models. It considers both closing down and long term operations׳ costs, and addresses the problem of resizing open branches in order to maintain a constant service level. We consider, as well, the presence of competitors and allow for ceding market share whenever the restructuring costs are prohibitively expensive.We test our model in a real life scenario, obtaining a reduction of about 40% of the network size, and annual savings over 45% in operation costs from the second year on. We finally perform a sensitivity analysis on critical parameters. This analysis shows that the final design of the network depends on certain strategic decisions concerning the redundancy of the branches, as well as their proximity to the demand nodes and to the competitor׳s branches. At the same time, this design is quite robust to changes in the parameters associated with the adjustments on service capacity and with the market reaction.     

Assessment of the effectiveness of steel fibre reinforcement for the punching resistance of flat slabs by experimental research and design approach

The present paper deals with the experimental assessment of the effectiveness of steel fibre reinforcement in terms of punching resistance of centrically loaded flat slabs, and to the development of an analytical model capable of predicting the punching behaviour of this type of structures. For this purpose, eight slabs of 2550 × 2550 × 150 mm³ dimensions were tested up to failure, by investigating the influence of the content of steel fibres (0, 60, 75 and 90 kg/m³) and concrete strength class (50 and 70 MPa). Two reference slabs without fibre reinforcement, one for each concrete strength class, and one slab for each fibre content and each strength class compose the experimental program. All slabs were flexurally reinforced with a grid of ribbed steel bars in a percentage to assure punching failure mode for the reference slabs. Hooked ends steel fibres provided the unique shear reinforcement. The results have revealed that steel fibres are very effective in converting brittle punching failure into ductile flexural failure, by increasing both the ultimate load and deflection, as long as adequate fibre reinforcement is assured. An analytical model was developed based on the most recent concepts proposed by the fib Mode Code 2010 for predicting the punching resistance of flat slabs and for the characterization of the behaviour of fibre reinforced concrete. The most refined version of this model was capable of predicting the punching resistance of the tested slabs with excellent accuracy and coefficient of variation of about 5%.     

On‐the‐Spot Immobilization of Quantum Dots,Graphene Oxide,and Proteins via Hydrophobins

Class I hydrophobin Vmh2, a peculiar surface active and versatile fungal protein, is known to self‐assemble into chemically stable amphiphilic films, to be able to change wettability of surfaces, and to strongly adsorb other proteins. Herein, a fast, highly homogeneous and efficient glass functionalization by spontaneous self‐assembling of Vmh2 at liquid–solid interfaces is achieved (in 2 min). The Vmh2‐coated glass slides are proven to immobilize not only proteins but also nanomaterials such as graphene oxide (GO) and quantum dots (QDs). As models, bovine serum albumin labeled with Alexa 555 fluorophore, anti‐immunoglobulin G antibodies, and cadmium telluride QDs are patterned in a microarray fashion in order to demonstrate functionality, reproducibility, and versatility of the proposed substrate. Additionally, a GO layer is effectively and homogeneously self‐assembled onto the studied functionalized surface. This approach offers a quick and simple alternative to immobilize nanomaterials and proteins, which is appealing for new bioanalytical and nanobioenabled applications.     

基于Q-learning的不确定环境BDI Agent最优策略规划研究

BDI模型能够很好地解决在特定环境下的Agent的推理和决策问题,但在动态和不确定环境下缺少决策和学习的能力。强化学习解决了Agent在未知环境下的决策问题,却缺少BDI模型中的规则描述和逻辑推理。针对BDI在未知和动态环境下的策略规划问题,提出基于强化学习Q-learning算法来实现BDI Agent学习和规划的方法,并针对BDI的实现模型ASL的决策机制做出了改进,最后在ASL的仿真平台Jason上建立了迷宫的仿真,仿真实验表明,在加入Q-learning学习机制后的新的ASL系统中,Agent在不确定环境下依然可以完成任务。     

番禺30-1砂岩强水驱气藏储层非均质性研究

针对垂向非均质性严重且边底水能量强的番禺30-1气田面临的潜在开发问题，通过岩心分析及测井二次解释，对其夹层特征及储层非均质性等进行了研究，划分出19个流动单元并定量描述了各流动单元的特征参数，建立了该气田的精细地质模型。综合评价表明，新建的地质模型具有较高的精度，为该气藏合理开发提供了坚实的地质基础。     

教育要有针对性管理要有强制性

分析高职学生思想状态的多层次性,提出以正面的思想教育和启发引导为主,同时加强规章制度的制约性,以提高教育管理工作的效果.