Joint offloading strategy based on quantum particle swarm optimization for MEC-enabled vehicular networks

With the development of the mobile communication technology, a wide variety of envisioned intelligent transportation systems have emerged and put forward more stringent requirements for vehicular communications. Most of computation-intensive and power-hungry applications result in a large amount of energy consumption and computation costs, which bring great challenges to the on-board system. It is necessary to exploit traffic offloading and scheduling in vehicular networks to ensure the Quality of Experience (QoE). In this paper, a joint offloading strategy based on quantum particle swarm optimization for the Mobile Edge Computing (MEC) enabled vehicular networks is presented. To minimize the delay cost and energy consumption, a task execution optimization model is formulated to assign the task to the available service nodes, which includes the service vehicles and the nearby Road Side Units (RSUs). For the task offloading process via Vehicle to Vehicle (V2V) communication, a vehicle selection algorithm is introduced to obtain an optimal offloading decision sequence. Next, an improved quantum particle swarm optimization algorithm for joint offloading is proposed to optimize the task delay and energy consumption. To maintain the diversity of the population, the crossover operator is introduced to exchange information among individuals. Besides, the crossover probability is defined to improve the search ability and convergence speed of the algorithm. Meanwhile, an adaptive shrinkage expansion factor is designed to improve the local search accuracy in the later iterations. Simulation results show that the proposed joint offloading strategy can effectively reduce the system overhead and the task completion delay under different system parameters.     

基于模拟退火机制的车辆用户移动边缘计算任务卸载新方法

在车联网(IOV)环境中,如果将车辆的计算任务都放置在云平台执行,无法满足对于信息处理的实时性,考虑移动边缘计算技术以及任务卸载策略,将用户的计算任务卸载到靠近设备边缘的服务器去执行。但是在密集的环境下,如果所有的任务都卸载到附近的边缘服务器去执行,同样会给边缘服务器带来巨大的负载。该文提出基于模拟退火机制的车辆用户移动边缘计算任务卸载新方法,通过定义用户的任务计算卸载效用,综合考虑时耗和能耗,结合模拟退火机制,根据当前道路的密集程度对系统卸载效用进行优化,改变用户的卸载决策,选择在本地执行或者卸载到边缘服务器上执行,使得在给定的环境下的所有用户都能得到满足低时延高质量的服务。仿真结果表明,该算法在减少用户任务计算时间的同时降低了能量消耗。     

MEC系统中基于多智能体深度增强学习的协作式任务卸载和资源分配

移动边缘计算(MEC)通过将计算任务卸载到MEC服务器上,在缓解智能移动设备计算负载的同时,可以降低服务时延。然而目前在MEC系统中,关于任务卸载和资源分配仍然存在以下问题：1)边缘节点间缺乏协作;2)计算任务到达与实际环境中动态变化的特征不匹配;3)协作式任务卸载和资源分配动态联合优化问题。为解决上述问题,文章在协作式MEC架构的基础上,提出了一种基于多智能体的深度确定性策略梯度算法(MADDPG)的任务卸载和资源分配算法,最小化系统中所有用户的长期平均成本。仿真结果表明,该算法可以有效降低系统的时延及能耗。     

基于NOMA的超密集MEC网络任务卸载和资源分配方案

为了提高移动边缘计算(mobile edge computing,MEC)网络的频谱效率,满足大量用户的服务需求,建立了基于非正交多址接入(non-orthogonal multiple access,NOMA)的超密集MEC系统模型。为了解决多个用户同时卸载带来的严重通信干扰等问题,以高效利用边缘服务器资源,提出了一种联合任务卸载和资源分配的优化方案,在满足用户服务质量的前提下最小化系统总能耗。该方案联合考虑了卸载决策、功率控制、计算资源和子信道资源分配。仿真结果表明,与其他卸载方案相比,所提方案可以在满足用户服务质量的前提下有效降低系统能耗。     

基于区块链的雾网络中的任务卸载优化方案研究

当前物联网(IoT)应用的快速增长对用户设备的计算能力是一个巨大的挑战。雾计算(FC)网络可为用户设备提供近距离、快速的计算服务,为资源紧张,计算能力有限的用户设备提供了解决方案。该文提出一个基于区块链的雾网络模型,该模型中用户设备可以将计算密集型任务卸载到计算能力强的节点处理。为最小化任务处理时延和能耗,引入两种任务卸载模型,即设备到设备(D2D)协作群组任务卸载和雾节点(FNs)任务卸载。此外,针对雾计算网络任务卸载过程的数据安全问题,引入区块链技术构建去中心化分布式账本,防止恶意节点修改交易信息,实现数据安全可靠传输。为降低共识机制时延和能耗,提出了改进的基于投票的委托权益证明(DPoS)共识机制,得票数超过阈值的FNs组成验证集,验证集中的FN轮流作为管理者生成新区块。最后,以最小化网络成本为目标,联合优化任务卸载决策、传输速率分配和计算资源分配,提出任务卸载决策和资源分配(TODRA)算法进行求解,并通过仿真实验验证了该算法的有效性。     

Multiuser computation offloading for edge-cloud collaboration using submodular optimization

A computation offloading scheme based on edge-cloud computing was proposed to improve the system utility of multiuser computation offloading.This scheme improved the system utility while considering the optimization of edge-cloud resources.In order to tackle the problems of computation offloading mode selection and edge-cloud resource allocation,a greedy algorithm based on submodular theory was developed by fully exploiting the computing and communication resources of cloud and edge.The simulation results demonstrate that the proposed scheme effectively reduces the delay and energy consumption of computing tasks.Additionally,when computing tasks are offloaded to edge and cloud from devices,the proposed scheme still maintains stable system utilities under ultra-limited resources.     

车载边缘计算中任务卸载和服务缓存的联合智能优化

针对车载环境下有限的网络资源和大量用户需求之间的矛盾,提出了智能驱动的车载边缘计算网络架构,以实现网络资源的全面协同和智能管理.基于该架构,设计了任务卸载和服务缓存的联合优化机制,对用户任务卸载以及计算和缓存资源的调度进行了建模.鉴于车载网络的动态、随机和时变的特性,利用异步分布式强化学习算法,给出了最优的卸载决策和资...     

异构蜂窝网络中分层任务卸载：建模与优化

为提高计算任务卸载的效率,提出了一种基于D2D通信、移动边缘计算和云计算的分层任务卸载框架,并引入D2D协作中继技术辅助用户接入远端计算资源。针对所提任务卸载框架在多用户场景中可能存在上行通信拥塞、边缘计算资源受限、D2D复用干扰和云计算回程时延等问题,设计了一种基于博弈论的卸载调度和负载均衡方案,充分利用了所提任务卸载框架中各层计算和通信资源。仿真结果表明,所提方案能够有效降低端到端时延和卸载能耗,并在资源受限的条件下具有良好的稳定性。     

Learning for Smart Edge: Cognitive Learning-Based Computation Offloading

With the development of intelligent applications, more and more intelligent applications are computation intensive, data intensive and delay sensitive. Compared with traditional cloud computing, edge computing can reduce communication delay by offloading computing tasks to edge cloud. Furthermore, with the complexity of computing scenarios in edge cloud, deep learning based on computation offloading scheme has attracted wide attention. However, all the learning-based offloading scheme does not consider the where and how to run the offloading scheme itself. Thus, in this paper, we consider the problem of running the learning-based computation offloading scheme for the first time and propose the learning for smart edge architecture. Then, we give the computation offloading optimization problem of mobile devices under multi-user and multi edge cloud scenarios. Furthermore, we propose cognitive learning-based computation offloading (CLCO) scheme for this problem. Finally, experimental results show that compared with other offloading schemes, the CLCO scheme has lower task duration and energy consumption.

     

基于车辆成组的V2V协同计算卸载策略研究

在车联网中引入V2V计算卸载技术可以缓解当前车载计算卸载热点地区路边单元(RSU)计算资源不足的问题.然而,在计算卸载过程中,服务车辆可能因故障离组或自主选择离开车组.如何返回任务结果并高效地分配计算任务是需要进一步研究的关键问题.提出了一个车组内计算任务分配算法,考虑了可能导致车辆离开车组的因素影响,以及组中每辆车能...     

协同边缘网络中智能计算卸载与资源优化算法

针对具有依赖关系的计算密集型应用任务面临的卸载决策难题，提出了一种基于优先级的深度优先搜索调度策略。考虑到用户能量受限和移动性，构建了一种联合用户下行能量捕获和上行计算任务卸载的网络模型，并在此基础上建立了端到端优化目标函数。结合任务优先级及时延约束，利用深度强化学习自学习的优势，将任务卸载决策问题建模为马尔科夫模型，并设计了基于任务相关性的Dueling Double DQN(D3QN)算法对问题进行求解。仿真数据表明，所提算法较其他算法能够满足更多用户的时延要求，并能减少9%～10%的任务执行时延。     

Task distribution offloading algorithm of vehicle edge network based on DQN

In order to achieve the best balance between latency,computational rate and energy consumption,for a edge access network of IoV,a distribution offloading algorithm based on deep Q network (DQN) was considered.Firstly,these tasks of different vehicles were prioritized according to the analytic hierarchy process (AHP),so as to give different weights to the task processing rate to establish a relationship model.Secondly,by introducing edge computing based on DQN,the task offloading model was established by making weighted sum of task processing rate as optimization goal,which realized the long-term utility of strategies for offloading decisions.The performance evaluation results show that,compared with the Q-learning algorithm,the average task processing delay of the proposed method can effectively improve the task offload efficiency.     

V2X offloading and resource allocation under SDN and MEC architecture

To address the serious problem of delay and energy consumption increase and service quality degradation caused by complex network status and huge amounts of computing data in the scenario of vehicle-to-everything (V2X),a vehicular network architecture combining mobile edge computing (MEC) and software defined network (SDN) was constructed.MEC sinks cloud serviced to the edge of the wireless network to compensate for the delay fluctuation caused by remote cloud computing.The SDN controller could sense network information from a global perspective,flexibly schedule resources,and control offload traffic.To further reduce the system overhead,a joint task offloading and resource allocation scheme was proposed.By modeling the MEC-based V2X offloading and resource allocation,the optimal offloading decision,communication and computing resource allocation scheme were derived.Considering the NP-hard attribute of the problem,Agglomerative Clustering was used to select the initial offloading node,and Q-learning was used for resource allocation.The offloading decision was modeled as an exact potential game,and the existence of Nash equilibrium was proved by the potential function structure.The simulation results show that,as compared to other mechanisms,the proposed mechanism can effectively reduce the system overhead.     

Stackelberg game-based task offloading in mobile edge computing-enabled hierarchical multi-coalition unmanned aerial vehicle networks

The unmanned aerial vehicle (UAV) coalition networks have been widely used in emergency mission scenarios. The introduction of the mobile edge computing (MEC) paradigm into multi-coalition UAV networks further improves the mission processing performance of UAV coalitions. In this paper, we investigate the problem of minimizing total task processing delay of UAV members in MEC-enabled coalition-based UAV networks. First, we propose a hierarchical offloading model in which multiple UAV heads decide its position selection strategy and multiple UAV members decide its offloading strategy when offloading tasks to UAV heads. Considering data arrival from multiple UAV member nodes at each UAV head, the first come first served (FCFS) queuing model is introduced when the UAV head processes tasks from members. Second, the hierarchical offloading delay minimization problem is formulated as a multi-leader multi-follower Stackelberg game. The existence of a Stackelberg equilibrium (SE) is proved by showing that multi-leader subgame and multi-follower subgame are exact potential games (EPGs) with Nash equilibrium (NE). We design a best response-based hierarchical iterative offloading algorithm to solve SE. Finally, the simulation results show that the performance of the proposed scheme is better than that of other benchmark methods and the proposed scheme can effectively reduce the total delay for all UAV members.     

车载边缘计算中多任务部分卸载方案研究

现有车载应用设备对时延有更严苛的要求,车载边缘计算(VEC)能够充分利用网络边缘设备,如路边单元(RSU)进行协作处理,可有效地降低时延。现有研究多假设RSU计算资源充足,可提供无限的服务,但实际其计算资源会随着所需处理任务数量的增加而受限,对时延敏感的车载应用造成限制。该文针对此问题,提出一种车载边缘计算中多任务部分卸载方案,该方案在充分利用RSU的计算资源条件下,考虑邻近车辆的剩余可用计算资源,以最小化总任务处理时延。首先在时延限制和资源约束下分配各任务在本地、RSU和邻近车辆的最优卸载决策变量比例,其次以最小处理时延为目的在一跳通信范围内选择合适的空闲车辆作为处理部分任务的邻近车辆。仿真结果表明所提车载边缘计算中多任务部分卸载方案相较现有方案能较好地降低时延。     

NOMA物联网下多UAV辅助MEC系统的资源分配

为解决偏远地区或突发灾害等场景中的物联网(Internet of Things, IoT)设备的任务计算问题,构建了一个非正交多址接入(Non-orthogonal Multiple Access, NOMA)-IoT(NOMA-IoT)下多无人机(Unmanned Aerial Vehicle, UAV)辅助的NOMA多址边缘计算(Multiple Access Edge Computing, MEC)系统。该系统中设备的计算能耗、卸载能耗和MEC服务器计算能耗直接受同信道干扰、计算资源和发射功率的影响,可通过联合优化卸载策略、计算资源和发射功率最小化系统加权总能耗。根据优化问题的非凸性和复杂性,提出了一种有效的迭代算法解决：首先,对固定卸载策略,计算资源和发射功率分配问题可通过连续凸逼近转化为可解的凸问题;其次,对固定计算资源和发射功率,利用联盟形成博弈解决卸载策略问题,以最小化IoT设备之间的同信道干扰。仿真结果表明,较OMA接入方式,NOMA接入方式减少本地计算能耗、卸载能耗及计算能耗约20%;较无卸载策略方法,包含卸载策略方法在减少系统加权总能耗方面效果较为明显。     

Q-learning-based task offloading strategy for satellite edge computing

In this paper, we study the task offloading optimization problem in satellite edge computing environments to reduce the whole communication latency and energy consumption so as to enhance the offloading success rate. A three-tier machine learning framework consisting of collaborative edge devices, edge data centers, and cloud data centers has been proposed to ensure an efficient task execution. To accomplish this goal, we also propose a Q-learning-based reinforcement learning offloading strategy in which both the time-sensitive constraints and data requirements of the computation-intensive tasks are taken into account. It enables various types of tasks to select the most suitable satellite nodes for the computing deployment. Simulation results show that our algorithm outperforms other baseline algorithms in terms of latency, energy consumption, and successful execution efficiency.     

Multi-objective optimization for task offloading based on network calculus in fog environments

With the widespread application of wireless communication technology and continuous improvements to Internet of Things (IoT) technology, fog computing architecture composed of edge, fog, and cloud layers have become a research hotspot. This architecture uses Fog Nodes (FNs) close to users to implement certain cloud functions while compensating for cloud disadvantages. However, because of the limited computing and storage capabilities of a single FN, it is necessary to offload tasks to multiple cooperating FNs for task completion. To effectively and quickly realize task offloading, we use network calculus theory to establish an overall performance model for task offloading in a fog computing environment and propose a Globally Optimal Multi-objective Optimization algorithm for Task Offloading (GOMOTO) based on the performance model. The results show that the proposed model and algorithm can effectively reduce the total delay and total energy consumption of the system and improve the network Quality of Service (QoS).     

DDPG-based intelligent rechargeable fog computation offloading for IoT

In view of the existing computation offloading research on fog computing network scenarios, most scenarios focus on reducing energy consumption and delay and lack the joint consideration of smart device rechargeability. This paper proposes a deep deterministic policy gradient-based intelligent rechargeable fog computation offloading mechanism that is combined with simultaneous wireless information and power transfer technology. Specifically, an optimization problem that minimizes the total energy consumption for completing all tasks in a multiuser scenario is formulated, and the joint optimization of the task offloading ratio, uplink channel bandwidth, power split ratio and computing resource allocation is fully considered. Based on the above nonconvex optimization problem with a continuous action space, a communication, computation and energy harvesting co-aware intelligent computation offloading algorithm is developed. It can achieve the optimal energy consumption and delay, and similar to a double deep Q-network, an inverting gradient updating-based dual actor-critic neural network design can improve the convergence and stability of the training process. Finally, the simulation results validate that the proposed mechanism can converge quickly and can effectively reduce the energy consumption with the lowest task delay.

     

Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms

Computation offloading at mobile edge computing (MEC) servers can mitigate the resource limitation and reduce the communication latency for mobile devices. Thereby, in this study, we proposed an offloading model for a multi-user MEC system with multi-task. In addition, a new caching concept is introduced for the computation tasks, where the application program and related code for the completed tasks are cached at the edge server. Furthermore, an efficient model of task offloading and caching integration is formulated as a nonlinear problem whose goal is to reduce the total overhead of time and energy. However, solving these types of problems is computationally prohibitive, especially for large-scale of mobile users. Thus, an equivalent form of reinforcement learning is created where the state spaces are defined based on all possible solutions and the actions are defined on the basis of movement between the different states. Afterwards, two effective Q-learning and Deep-Q-Network-based algorithms are proposed to derive the near-optimal solution for this problem. Finally, experimental evaluations verify that our proposed model can substantially minimize the mobile devices’ overhead by deploying computation offloading and task caching strategy reasonably.