Q-learning-based task offloading strategy for satellite edge computing

In this paper, we study the task offloading optimization problem in satellite edge computing environments to reduce the whole communication latency and energy consumption so as to enhance the offloading success rate. A three-tier machine learning framework consisting of collaborative edge devices, edge data centers, and cloud data centers has been proposed to ensure an efficient task execution. To accomplish this goal, we also propose a Q-learning-based reinforcement learning offloading strategy in which both the time-sensitive constraints and data requirements of the computation-intensive tasks are taken into account. It enables various types of tasks to select the most suitable satellite nodes for the computing deployment. Simulation results show that our algorithm outperforms other baseline algorithms in terms of latency, energy consumption, and successful execution efficiency.     

Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing

The rapid growth of mobile internet services has yielded a variety of computation-intensive applications such as virtual/augmented reality. Mobile Edge Computing (MEC), which enables mobile terminals to offload computation tasks to servers located at the edge of the cellular networks, has been considered as an efficient approach to relieve the heavy computational burdens and realize an efficient computation offloading. Driven by the consequent requirement for proper resource allocations for computation offloading via MEC, in this paper, we propose a Deep-Q Network (DQN) based task offloading and resource allocation algorithm for the MEC. Specifically, we consider a MEC system in which every mobile terminal has multiple tasks offloaded to the edge server and design a joint task offloading decision and bandwidth allocation optimization to minimize the overall offloading cost in terms of energy cost, computation cost, and delay cost. Although the proposed optimization problem is a mixed integer nonlinear programming in nature, we exploit an emerging DQN technique to solve it. Extensive numerical results show that our proposed DQN-based approach can achieve the near-optimal performance.     

Users' experience matter: Delay sensitivity-aware computation offloading in mobile edge computing

As a promising computing paradigm, Mobile Edge Computing (MEC) provides communication and computing capability at the edge of the network to address the concerns of massive computation requirements, constrained battery capacity and limited bandwidth of the Internet of Things (IoT) systems. Most existing works on mobile edge task ignores the delay sensitivities, which may lead to the degraded utility of computation offloading and dissatisfied users. In this paper, we study the delay sensitivity-aware computation offloading by jointly considering both user's tolerance towards delay of task execution and the network status under computation and communication constraints. Specifically, we use a specific multi-user and multi-server MEC system to define the latency sensitivity of task offloading based on the analysis of delay distribution of task categories. Then, we propose a scoring mechanism to evaluate the sensitivity-dependent utility of task execution and devise a Centralized Iterative Redirection Offloading (CIRO) algorithm to collect all information in the MEC system. By starting with an initial offloading strategy, the CIRO algorithm enables IoT devices to cooperate and iteratively redirect task offloading decisions to optimize the offloading strategy until it converges. Extensive simulation results show that our method can significantly improve the utility of computation offloading in MEC systems and has lower time complexity than existing algorithms.     

移动边缘计算卸载技术综述

移动边缘计算(Mobile Edge Computing,MEC)将云服务器的计算资源扩展到更靠近用户一侧的网络边缘,使得用户可以将任务卸载到边缘服务器,从而克服原先云计算中将任务卸载到云服务器所带来的高时延问题。首先介绍了移动边缘计算的基本概念、基本框架和应用场景,然后围绕卸载决策、联合资源分配的卸载决策分别从单MEC服务器和多MEC服务器两种场景总结了任务卸载技术的研究现状,最后结合当前MEC卸载技术中存在的不足展望了未来MEC卸载技术的研究。     

车载边缘计算中任务卸载和服务缓存的联合智能优化

针对车载环境下有限的网络资源和大量用户需求之间的矛盾,提出了智能驱动的车载边缘计算网络架构,以实现网络资源的全面协同和智能管理.基于该架构,设计了任务卸载和服务缓存的联合优化机制,对用户任务卸载以及计算和缓存资源的调度进行了建模.鉴于车载网络的动态、随机和时变的特性,利用异步分布式强化学习算法,给出了最优的卸载决策和资...     

Joint offloading strategy based on quantum particle swarm optimization for MEC-enabled vehicular networks

With the development of the mobile communication technology, a wide variety of envisioned intelligent transportation systems have emerged and put forward more stringent requirements for vehicular communications. Most of computation-intensive and power-hungry applications result in a large amount of energy consumption and computation costs, which bring great challenges to the on-board system. It is necessary to exploit traffic offloading and scheduling in vehicular networks to ensure the Quality of Experience (QoE). In this paper, a joint offloading strategy based on quantum particle swarm optimization for the Mobile Edge Computing (MEC) enabled vehicular networks is presented. To minimize the delay cost and energy consumption, a task execution optimization model is formulated to assign the task to the available service nodes, which includes the service vehicles and the nearby Road Side Units (RSUs). For the task offloading process via Vehicle to Vehicle (V2V) communication, a vehicle selection algorithm is introduced to obtain an optimal offloading decision sequence. Next, an improved quantum particle swarm optimization algorithm for joint offloading is proposed to optimize the task delay and energy consumption. To maintain the diversity of the population, the crossover operator is introduced to exchange information among individuals. Besides, the crossover probability is defined to improve the search ability and convergence speed of the algorithm. Meanwhile, an adaptive shrinkage expansion factor is designed to improve the local search accuracy in the later iterations. Simulation results show that the proposed joint offloading strategy can effectively reduce the system overhead and the task completion delay under different system parameters.     

任务迁移的移动边缘计算系统中资源分配和任务卸载策略

针对在任务卸载时由于设备的移动而导致任务迁移这一问题,将任务卸载过程建模为马尔科夫决策过程,并通过优化资源分配和任务卸载策略,解决基于联合时延和能耗的损耗函数最小的优化问题。首先将问题转化为最小化损耗函数之和,并在决策前对每个任务的传输功率采用二分法进行优化,然后基于获得的传输功率提出一种QLBA（Q-learning Based Algorithm）来完成卸载决策。仿真结果证实所提方案优于传统算法。     

一种基于车边云协同的车联网计算卸载策略

随着智能交通的快速发展和车联网中数据流量爆炸式的增长,汽车终端请求卸载的任务对时延和带宽有了更加严苛的要求。在现有的云计算服务模式中,车辆可以访问云服务器来获得强大的计算、存储和网络资源,但缺点是通信传输时延较大,仅依靠云计算可能会导致过度的延迟。为了更加合理利用资源、减小时延、优化卸载策略,提出了一种基于粒子群优化算法的“车-边-云”协同卸载方案。首先通过接入点附近的软件定义网络（Software Define Network,SDN)控制器根据终端用户附近边缘节点、本地终端和云计算节点的计算资源和容量情况得出最优的卸载策略,充分利用本地、移动边缘计算（Mobile Edge Computing,MEC）设备、云端的计算资源,然后通过粒子群优化算法得出“车-边-云”各计算节点的卸载系数,即最优卸载策略。实验结果表明,相比于其他卸载策略,所提的卸载机制对时延优化效果明显,提高了计算资源的利用率。     

Research on intelligent computing offloading model based on reputation value in mobile edge computing

Aiming at the problem of high-latency,high-energy-consumption,and low-reliability mobile caused by computing-intensive and delay-sensitive emerging mobile applications in the explosive growth of IoT smart mobile terminals in the mobile edge computing environment,an offload decision-making model where delay and energy consumption were comprehensively included,and a computing resource game allocation model based on reputation that took into account was proposed,then improved particle swarm algorithm and the method of Lagrange multipliers were used respectively to solve models.Simulation results show that the proposed method can meet the service requirements of emerging intelligent applications for low latency,low energy consumption and high reliability,and effectively implement the overall optimized allocation of computing offload resources.     

Task offloading under deterministic demand for vehicular edge computing

In vehicular edge computing (VEC) networks, the rapid expansion of intelligent transportation and the corresponding enormous numbers of tasks bring stringent requirements on timely task offloading. However, many tasks typically appear within a short period rather than arriving simultaneously, which makes it difficult to realize effective and efficient resource scheduling. In addition, some key information about tasks could be learned due to the regular data collection and uploading processes of sensors, which may contribute to developing effective offloading strategies. Thus, in this paper, we propose a model that considers the deterministic demand of multiple tasks. It is possible to generate effective resource reservations or early preparation decisions in offloading strategies if some feature information of the deterministic demand can be obtained in advance. We formulate our scenario as a 0-1 programming problem to minimize the average delay of tasks and transform it into a convex form. Finally, we proposed an efficient optimal offloading algorithm that uses the interior point method. Simulation results demonstrate that the proposed algorithm has great advantages in optimizing offloading utility.     

Survey on computation offloading in mobile edge computing

Computation offloading in mobile edge computing would transfer the resource intensive computational tasks to the edge network.It can not only solve the shortage of mobile user equipment in resource storage,computation performance and energy efficiency,but also deal with the problem of resource occupation,high latency and network load compared to cloud computing.Firstly the architecture of MEC was introduce and a comparative analysis was made according to various deployment schemes.Then the key technologies of computation offloading was studied from three aspects of decision on computation offloading,allocation of computing resource within MEC and system implement of MEC.Based on the analysis of MEC deployment scheme in 5G,two optimization schemes on computation offloading was proposed in 5G MEC.Finally,the current challenges in the mobility management was summarized,interference management and security of computation offloading in MEC.     

Energy‐aware dynamic task offloading and collective task execution in mobile cloud computing

There is a good opportunity for enlightening the services of the mobile devices by introducing computational offloading using cloud technology. Offloading is a process for managing the complexity of the mobile environment by migrating computational load to the cloud. The mobile devices oblige the quick response for the offloading requests; it is dependent on network connectivity. The cloud services take long set‐up time irrespective of network connectivity. In this paper, new system architecture for the dynamic task offloading in the mobile cloud environment is proposed. The architecture includes the offloading algorithm that concentrates on energy consumption of the tasks both in the local and remote environment. The proposed algorithm formulates a collective task execution model for minimizing the energy consumption. The architecture concentrates on the network model by considering the task completion time in three different network scenarios. The experimental results show the efficiency of the suggested architecture in reducing the energy consumption and completion time of the tasks.     

Multi-objective optimization for task offloading based on network calculus in fog environments

With the widespread application of wireless communication technology and continuous improvements to Internet of Things (IoT) technology, fog computing architecture composed of edge, fog, and cloud layers have become a research hotspot. This architecture uses Fog Nodes (FNs) close to users to implement certain cloud functions while compensating for cloud disadvantages. However, because of the limited computing and storage capabilities of a single FN, it is necessary to offload tasks to multiple cooperating FNs for task completion. To effectively and quickly realize task offloading, we use network calculus theory to establish an overall performance model for task offloading in a fog computing environment and propose a Globally Optimal Multi-objective Optimization algorithm for Task Offloading (GOMOTO) based on the performance model. The results show that the proposed model and algorithm can effectively reduce the total delay and total energy consumption of the system and improve the network Quality of Service (QoS).     

An intelligent task offloading algorithm (iTOA) for UAV edge computing network

Unmanned Aerial Vehicle (UAV) has emerged as a promising technology for the support of human activities, such as target tracking, disaster rescue, and surveillance. However, these tasks require a large computation load of image or video processing, which imposes enormous pressure on the UAV computation platform. To solve this issue, in this work, we propose an intelligent Task Offloading Algorithm (iTOA) for UAV edge computing network. Compared with existing methods, iTOA is able to perceive the network’s environment intelligently to decide the offloading action based on deep Monte Calor Tree Search (MCTS), the core algorithm of Alpha Go. MCTS will simulate the offloading decision trajectories to acquire the best decision by maximizing the reward, such as lowest latency or power consumption. To accelerate the search convergence of MCTS, we also proposed a splitting Deep Neural Network (sDNN) to supply the prior probability for MCTS. The sDNN is trained by a self-supervised learning manager. Here, the training data set is obtained from iTOA itself as its own teacher. Compared with game theory and greedy search-based methods, the proposed iTOA improves service latency performance by 33% and 60%, respectively.     

An efficient algorithm for dynamic task offloading using cloudlets in mobile cloud computing

It is a visible fact that the growth of mobile devices is enormous. More computations are required to be carried out for various applications in these mobile devices. But the drawback of the mobile devices is less computation power and low available energy. The mobile cloud computing helps in resolving these issues by integrating the mobile devices with cloud technology. Again, the issue is increased in the latency as the task and data to be offloaded to the cloud environment uses WAN. Hence, to decrease the latency, this paper proposes cloudlet‐based dynamic task offloading (CDTO) algorithm where the task can be executed in device environment, cloudlet environment, cloud server environment, and integrated environment. The proposed algorithm, CDTO, is tested in terms of energy consumption and completion time.     

车联网场景下移动边缘计算协作式资源分配策略

为了有效利用边缘云的计算资源,尽可能降低任务卸载时的平均等待时延,提出了一种满足边缘计算服务器容限阈值和任务卸载成功率约束条件下的多个边缘计算服务器相互协作的资源分配方案,通过单位时间总代价指标优化边缘计算服务器个数.将此方案建模为一个整数优化问题,之后设计了一种最小代价算法求解此优化问题,得到约束条件下的单位时间总代...     

边缘计算中云边任务下发策略研究

目前边缘计算的相关研究大部分着眼于如何将设备端数据卸载至边缘端进行处理,而未考虑云中心如何高效率、低延时地将不同任务下发至边缘节点的问题.针对该问题,文中提出了一种边缘计算架构模型,通过对任务进行统一建模,使用改进的Dijkstra算法得到任务下发最优路径,减少所需计算节点数量和提升计算性能,使其能在最短的时间内下发到...     

Cuckoo: flexible compute‐intensive task offloading in mobile cloud computing

Mobile cloud computing (MCC) is an emerging technology to facilitate complex application execution on mobile devices. Mobile users are motivated to implement various tasks using their mobile devices for great flexibility and portability. However, such advantages are challenged by the limited battery life of mobile devices. This paper presents Cuckoo, a scheme of flexible compute‐intensive task offloading in MCC for energy saving. Cuckoo seeks to balance the key design goals: maximize energy saving (technical feasibility) and minimize the impact on user experience with limited cost for offloading (realistic feasibility). Specifically, using a combination of static analysis and dynamic profiling, compute‐intensive tasks are fine‐grained marked from mobile application codes offline. According to the network transmission technologies supported in mobile devices and the runtime network conditions, adopting “task‐bundled” strategy online offloads these tasks to MCC. In the task‐hosted stage, we propose a skyline‐based online resource scheduling strategy to satisfy the realistic feasibility of MCC. In addition, we adopt resource reservation to reduce the extra energy consumption caused by the task multi‐offloading phenomenon. Further, we evaluate the performance of Cuckoo using real‐life data sets on our MCC testbed. Our extensive experiments demonstrate that Cuckoo is able to balance energy consumption and execution performance. Copyright © 2016 John Wiley & Sons, Ltd.     

边缘计算多约束可信协同任务迁移策略

为保障边缘计算的服务质量,提出一种在多约束条件下边缘计算可信协同任务迁移策略。该策略基于任务需求,由边缘计算协同服务盟主节点组织调度协同服务盟员,基于用户任务迁移的K维权重指标,确定协同盟员调度优先级,以盟员负载均衡性为适应函数,通过贪心算法执行盟员任务分配与调度,基于路由捎带选择备用节点,通过迁移优先级评估,实现协同服务异常时的调度和迁移,由此提高边缘计算任务迁移的服务质量,保障任务迁移的可靠性。仿真实验表明,该机制能有效完成协同任务分发与迁移调度,提高边缘计算协同效率,保障网络服务质量。