A personalized QoE-aware handover decision based on distributed reinforcement learning

Recent developments in heterogeneous mobile networks and growing demands for variety of real-time and multimedia applications have emphasized the necessity of more intelligent handover decisions. Addressing the context knowledge of mobile devices, users, applications, and networks is the subject of context-aware handoff decision as a recent effort to this aim. However, user perception has not been attended adequately in the area of context-aware handover decision making. Mobile users may have different judgments about the Quality of Service (QoS) depending on their environmental conditions, and personal and psychological characteristics. This reality has been exploited in this paper to introduce a personalized user-centric handoff decision method to decide about the time and target of handover based on User Perceived Quality (UPQ) feedbacks. The UPQ degradations are mainly for the sake of (1) exiting the coverage of the serving Point of Attachment (PoA) or (2) QoS degradation of serving access network. Using UPQ metric, the proposed method obviates the necessity of being aware about rapidly varying network QoS parameters and overcomes the complexity and overhead of gathering and managing some other context information. Moreover, considering the underlying network and geographical map, the proposed method is able to inherently exploit the trajectory information of mobile users for handover decision. UPQ degradation is not only due to the user behaviour, but also due to the behaviours of others users. As such, multi-agent reinforcement learning paradigm has been considered for target PoA selection. The employed decision algorithm is based on WoLF-PHC learning method where UPQ is used as a delayed reward for training. The proposed handoff decision has been implemented under IEEE 802.21 framework using NS2 network simulator. The results have shown better performance of the proposed method comparing to conventional methods assuming regular movement of mobile users.     

Vertical handoff decision in 4G wireless networks using multi attribute decision making approach

Multi-interface terminal in heterogeneous wireless networks will have network access from diverse access technologies. Multiple attribute for decision making including user preference will increase the complexity of handoff process. Various approaches have been proposed to solve the complexity problem of handoff decision. In this paper, multi attribute decision making algorithms Analytic Hierarchy Process (AHP) method, Simple Additive Weighting (SAW), Total Order Preference by Similarity to the Ideal Solution (TOPSIS), and Grey Relational Analysis (GRA) methods have been proposed for handoff decision in a WiMAX–WLAN environment to facilitate user with better quality of service. AHP has been used for calculation of weights of decision parameters. Numerical results show that SAW, TOPSIS and GRA provide almost similar performance. SAW is very simple to implement but probability of error is less in GRA because values of decision attribute are directly used for ranking of alternatives. TOPSIS is sensitive to the attribute with high score.     

Efficient handoff based on link quality prediction for video streaming in urban transport systems

The continuously increasing interest in developing efficient vehicle‐roadside communication networks to provide on‐board connectivity has recently brought to the definition of several solutions based on different wireless technologies. Among them, wireless local area network‐based solutions emerged as an attracting alternative to guarantee high‐quality connectivity enabling services, like video streaming, that require stringent quality of service guarantees. In this work, we propose a handoff procedure based on a forecasting model of the link quality for mobile routers operating in vehicle‐roadside wireless local area network‐based networks. First, a preliminary set of experiments is performed in a realistic environment to study the behavior of the wireless channel when mobility in urban environment is considered. Then, considering the hands‐on experience gained from the initial set of experiments, a novel handoff procedure is designed, which exploits a forecasting technique to predict link channel quality. The proposed procedure is then exploited in a cross‐layer manner to proactively reduce the number of transmitted layers during handoff in the case of real‐time video traffic based on H.264/SVC encoding. The proposal is assessed by means of simulation and compared with existing solutions. Results demonstrate that our proposal guarantees performance comparable with other algorithms. The advantage of predicting the handoff point is demonstrated by means of simulations employing a realistic video streaming traffic model, showing how the quality of experience perceived by end‐users can be improved through the adaptation of the traffic load. Copyright © 2016 John Wiley & Sons, Ltd.     

DiffServ resource allocation for fast handoff in wireless mobileInternet

The next-generation wireless networks are evolving toward a versatile IP-based network that can provide various real-time multimedia services to mobile users. Two major challenges in establishing such a wireless mobile Internet are support of fast handoff and provision of quality of service (QoS) over IP-based wireless access networks. In this article, a DiffServ resource allocation architecture is proposed for the evolving wireless mobile Internet. The registration-domain-based scheme supports fast handoff by significantly reducing mobility management signaling. The registration domain is integrated with the DiffServ mechanism and provisions QoS guarantee for each service class by domain-based admission control. Furthermore, an adaptive assured service is presented for the stream class of traffic, where resource allocation is adjusted according to the network condition in order to minimize handoff call dropping and new call blocking probabilities     

Mobile flow-aware networks for mobility and QoS support in the IP-based wireless networks

As the volume of mobile traffic consisting of video, voice, and data is rapidly expanding, a challenge remains with the mobile transport network, which must deliver data traffic to mobile devices without degrading the service quality. Since every Internet service holds its own service quality requirements, the flow-aware traffic management in fine granularity has been widely investigated to guarantee Quality of Service (QoS) in the IP networks. However, the mobile flow-aware management has not been sufficiently developed yet because of the inherent constraints of flow routing in the mobile networks regarding flow-aware mobility and QoS support. In this paper, we propose a flow-aware mobility and QoS support scheme called mobile flow-aware network (MFAN) for IP-based wireless mobile networks. The proposed scheme consists of dynamic handoff mechanisms based on QoS requirements per flow to reduce the processing overhead of the flow router while ensuring QoS guarantee to mobile flows. The performance analyses of the proposed scheme demonstrate that MFAN successfully supports the mobile flow traffic delivery while satisfying the QoS requirement of flows in the wireless mobile IP networks.     

Seamless vertical handoff using modified weed optimization algorithm for heterogeneous wireless networks

In the global scenario, a variety of wireless access networks are available. Different types of applications such as real time, nonreal time, and high bandwidth availability are used for heterogeneous wireless networks. Therefore, it is necessary for a service provider to make an appropriate connection support. For better performance, connections are to be exchanged among the different networks using seamless vertical handoff (VHO). The proposed algorithm shows the effect of optimization technique, which involves handoff decision process using vertical handoff triggering and selection of the network. The handoff triggering is initiated by using the received signal strength (RSS). In traditional method, handoff triggering is initiated by using RSS only. This method, modified weed optimization (M-WO) algorithm, reduces the unnecessary handoff by considering both RSS and velocity of the mobile node in handoff triggering. The parameters such as battery lifetime, handoff call dropping rate, load, dynamic weights adaptation and so on are to be considered individually or combined to make an effective network selection process. This paper highlights a novel effect ofM-WOalgorithm for decision making during the VHO. Our effort is to essentially optimize the system load, so that it reduces the handoff call dropping rate and the battery power consumption of the mobile node (MN). Weight of each QoS metrics is adjusted along with the networks changing conditions to trace the M-WO. Therefore, the novel VHO decision-making algorithm is superior to the existing SSF and OPTG methods. The simulation results show that the performance ofM-WOalgorithm is far better than SSF andOPTGmethods in terms of load, handoff call dropping rate and battery lifetime of MN.     

Performance analysis of path rerouting algorithms for handoffcontrol in mobile ATM networks

This paper studies the effects of user mobility and handoff path rerouting on the traffic distributions in a mobile network environment. In mobile ATM networks, extra traffic load may be added to network links due to user mobility and handoff path rerouting. This requires higher network link capacity and possible topology reengineering in order to support the same quality of service (QoS) for mobile services. To capture the dynamic variations in mobile ATM networks, we propose to use a flow model. The model represents the mobile-generated traffic as a set of stochastic flows over a set of origin-destination (OD) pairs. The user mobility is defined by transfer probabilities of the flows and the handoff path rerouting algorithm is modeled by a transformation between the routing functions for traffic flows. The analysis shows that user mobility may cause temporal variations as well as smoothing effects on the network traffic. Using the flow network model, typical handoff path rerouting algorithms are evaluated through both analytical and experimental approaches. The evaluation methodology can be used for either redesigning the network topology for a given path rerouting algorithm or selecting a path rerouting algorithm for a given network topology under a specific mobile service scenario     

Mobility management in next-generation wireless systems

This paper describes current and proposed protocols for mobility management for public land mobile network (PLMN)-based networks, mobile Internet protocol (IP) wireless asynchronous transfer mode (ATM) and satellite networks. The integration of these networks will be discussed in the context of the next evolutionary step of wireless communication networks. First, a review is provided of location management algorithms for personal communication systems (PCS) implemented over a PLMN network. The latest protocol changes for location registration and handoff are investigated for mobile IP followed by a discussion of proposed protocols for wireless ATM and satellite networks. Finally, an outline of open problems to be addressed by the next generation of wireless network service is discussed     

Vertical handoffs in fourth-generation multinetwork environments

Revolutionary drivers for 4G include a push toward universal wireless access and ubiquitous computing through seamless personal and terminal mobility. One of the major challenges for seamless mobility is the criterion of a vertical handoff protocol: a handoff protocol for users that move between different types of networks. Traditional operations for handoff detection policies, decision metrics, and radio link transfer are not able to adapt to dynamic handoff criteria or react to user inputs and changing network availabilities. Nor are they able to deliver context-aware services or ensure network interoperability. Thus, new techniques are needed to manage user mobility between different types of networks. This article presents a tutorial on the design and performance issues for vertical hand-off in an envisioned multinetwork fourth-generation environment. Various network architectures and technologies for 3G and beyond are described, including wireless LANs, cellular, satellite, and Mobile IP. Then the problem of vertical handoff is defined in the context of such a diverse network environment. Finally, research efforts to resolve the open problems are explored, including new techniques for dynamic handoff decision and detection algorithms and context-aware radio link transfer.     

Artificial Neural Network Based Vertical Handoff Algorithm for Reducing Handoff Latency

One of the most challenging topics for next generation wireless networks is vertical handoff concept since several wireless technologies are assumed to cooperate. Plenty of parameters related to user preferences, application requirements, and network conditions, such as; data rate, service cost, network latency, speed of mobile, battery level, interference ratio and etc. must be considered in vertical handoff process along with traditional RSSI information. In this study, a new artificial neural network based handoff decision algorithm is proposed in order to reduce the handoff latency of smart terminal deployed in aforementioned wireless heterogeneous infrastructures. The prominent parameters data rate, monetary cost and RSSI information are taken as inputs of the developed vertical handoff decision system. Performance results of the proposed system are also compared with those of classical Multiple Attribute Decision Making method Simple Additive Weighting, and of some other artificial intelligence based algorithms. According to the results obtained, the proposed neural network based vertical handoff decision algorithm is able to determine whether a handoff is necessary or not properly, and selects the best candidate access network considering the abovementioned parameters. The results also show that, the neural network based algorithm developed significantly reduces the handoff latency while the number of handoffs, which is another vital performance metric, is still reasonable.     

A framework of handoffs in wireless overlay networks based on mobile IPv6

Although there are various wireless access network technologies with different characteristics and performance level have been developed, no single network that can satisfy the anytime, anywhere, and any service wireless access needs of mobile users. A truly seamless mobile environment can only be realized by considering vertical and horizontal handoffs together. With the advantages of Mobile IPv6, a more comprehensive and integrated framework of heterogeneous networks can be developed. In this paper, we discuss the issues related to handoffs including horizontal and vertical handoffs. We present a scheme for integrating wireless local area network and wide area access networks, and propose a micromobility management method called HiMIPv6+. We also propose a QoS-based (quality-of-service-based) vertical handoff scheme and algorithm that consider wireless network transport capacity and user service requirement. Our prototype evaluations and the simulations show that our framework performs as expected.     

An efficient vertical handoff scheme for microcellular and macrocellular interworking

The next generation wireless network environments increasingly become integrated to support anywhere, anytime connectivity for various applications like multimedia, full‐motion video and high data rates with appropriate quality of service (QoS). With these emerging needs, interworking of microcellular and macrocellular networks has been accompanied by service providers. However, these networks have different technologies, which make efficient vertical handoff a challenging issue. In this study, an efficient vertical handoff scheme (EVHS) for interworking between microcellular and macrocellular networks is proposed and analyzed. The handoff decision criteria of the proposed scheme include crucial features like user mobility, network conditions, pricing issues, and user preferences in addition to the received signal strength (RSS). EVHS ensures the selection of the most appropriate network in terms of cost and acceptable QoS according to users' preferences. The results show that EVHS scheme outperforms other proposed schemes in the literature in terms of incompletion probabilities, grade of service (GoS) and cost without causing degradation in system utilization. Besides, although EVHS scheme is mainly intended for user satisfaction, the results show that it does not cause a significant degradation in the revenue of the service provider. Copyright © 2009 John Wiley & Sons, Ltd.     

基于动态信道预约的自适应QoS切换算法

未来无线网络将为固定和移动用户提供多媒体通信和计算业务．为移动用户提供无线多媒体业务的一个最关键的挑战是保证端到端连接的业务质量．通过重复使用无线频谱的微蜂窝或微微蜂窝结构是一个有前途的改善移动多媒体网络容量的方式．但切换次数随着蜂窝大小的降低而增加．移动多媒体网络的一个至关重要的问题是需要可以满足各种QoS需要且有更高资源利用率的有效切换方式．该文提出了一种称为基于动态信道预约的自适应QoS切换算法,并与其它切换方式进行了性能比较．     

Wireless ATM networks: technology status and future directions

The concept of “wireless ATM” (WATM), first proposed in 1992, is now being actively considered as a potential framework for new-generation wireless communication networks capable of supporting integrated, quality-of service (QoS) based multimedia services. In this review paper, we outline the technological rationale for wireless ATM, present a system-level architecture, and discuss key design issues for both mobile ATM switching infrastructure and radio access subsystems. The WATM radio access layer issues covered in this paper include: spectrum allocation; spectrum etiquette; modem technology; and medium access/data link control (MAC/DLC) protocols. Mobile ATM aspects such as ATM signaling extensions for handoff control, location management, and mobile QoS control are discussed. A summary of current wireless/mobile ATM technology development and standardization status is given, including an outline of our WATMnet prototype. The paper concludes with a discussion of future directions for wireless ATM technology such as Internet protocol (IP) integration and mobile multimedia terminals/applications     

Mobility management in current and future communications networks

This article describes current and proposed protocols for mobility management for public land mobile networks (PLMNs), Mobile IP, wireless ATM, and satellite networks. The integration of these networks is discussed in the context of the next evolutionary step of wireless communications networks. First, a review is provided of location management algorithms for PCS implemented over a PLMN. The latest protocol changes for location registration and handoff are investigated for Mobile IP, followed by a discussion of proposed protocols for wireless ATM and satellite networks. Finally, an outline of open problems to be addressed by the next generation of wireless network service is discussed     

异构无线网络的自适应垂直切换判决算法

在未来的异构环境中,网络间的垂直切换将对QoS保证产生重要影响。针对移动终端在异构网络间切换不理想的问题,提出了一种自适应的垂直切换判决算法。采用基于用户多应用的代价函数对接入网络进行评估与选择,综合考虑移动终端当前的电池电量,判断当前业务是否需要进行网络切换,使移动终端能自适应地进行切换判决。仿真结果表明,该算法可以有效地延长移动终端的工作时间,减少乒乓效应,提高系统的切换性能,改善业务的QoS。     

分层多跳无线网中结合负载均衡的切换管理

该文主要研究分层多跳无线网络中的切换管理,提出一种新的用户切换管理算法和移动基站路由切换策略.在网络动态变化时,用户切换管理算法可以减少用户的切换次数,使用户负载分布均匀.移动基站路由切换策略则尽可能地从基站本地找出替代路由,可以在较小的开销下达到快速和无缝切换的目的.     

异构无线网络垂直切换技术综述

垂直切换是多网融合的基础,是实现异构网络互通、支持不同接入方式无缝衔接的核心技术,目前正在受到业界的重点关注,并成为学术界研究的热点问题。随着无线移动通信技术向接入多元化、网络一体化和应用综合化的方向发展,各种蜂窝移动接入、宽带无线接入和固定接入将共同接入基于IP的统一核心网络,通过网络间的垂直切换,支持用户的移动性和移动过程中业务的连续性。首先给出了垂直切换的定义和基本概念,介绍了垂直切换的分类和基本流程,随后详细论述垂直切换的切换判决和切换执行2个环节。针对切换判决,总结了现有判决算法,重点评述各代表算法工作原理并剖析论其特点和存在的不足。针对切换执行,详述了现有垂直切换执行机制的工作原理和适用场景,并分析其优缺点。最后,对未来垂直切换技术的研究方向进行了展望。     

Software-defined radio basics [book review]

The article reviews the book, 'Software Defined Radio: Architectures, Systems and Functions' by Markus Dillinger, Kambiz Madani, and Nancy Alonistioti, published by John Wiley & Sons, 2003. The book thoroughly discusses various aspects of SDR technologies, particularly Europe's extensive Information Society Technologies research programs. The first six chapters give background information on wireless and SDR concepts. Markus Dillinger, Kambiz Madani, and Nancy Alonistioti address service handoff with quality-of-service considerations for heterogeneous wireless networks. They also discuss requirements for networks that can support device reconfiguration, such as mode detection, monitoring, and filtering; handoff decision making; and software downloads. Handoffs can be disruptive; when an SDR device changes modes, the channel and service quality also change. Furthermore, in the Universal Mobile Telecommunications System, mode negotiation is underdeveloped and handoff management is restricted to the base station. Chapter 7 explores open APIs for flexible service provisioning and reconfiguration management. The next few chapters describe communication profiles for reconfiguration systems and radio resource management and present a framework for charging and billing for reconfigurable service. Chapter 11, which covers spectrum-sharing methods, including additional spectrum pool sharing. The reviewer considers that the book's broad scope, clear writing, and effective organization make it an invaluable reference for researchers and graduate students, as well as wireless manufacturers and operators.