基于Q学习的异构无线网络动态切换策略

提出了一种基于Q学习的动态切换策略,用于最大化用户体验(QoE).基于Q学习的动态切换策略选择最佳网络,不仅利用当前网络状态还利用了未来网络状态和用户终端状态.不同于其他动态规划算法,该算法不需要获取无线网络环境的信息,而是通过利用用户终端过去经验来学习最优策略.仿真结果显示,该动态切换策略能以较少网络间切换次数来接近甲骨文优化算法性能,从而使用户体验得到更优质的网络音频服务.     

改善用户体验的垂直切换算法

针对由超密集异构无线网络的超高动态性而引起掉话率不断增长的问题,并考虑到以往基于模糊逻辑相关垂直切换算法的较大时间开销,该文提出一种改善用户体验的垂直切换算法。首先利用5G核心访问和移动管理功能发现终端附近的所有候选网络,同时,利用自组织网络技术的环境感知能力,随时监测网络的运行状况,主动维护网络之间的邻居关系表。然后,引入动态模糊神经网络(DFNN)算法来执行切换判决,将获取到的网络参数数据作为该系统的输入,动态生成对垂直切换有效的规则库,经学习之后,计算得到输出判决值,从而为终端选择最佳接入网络。最后,仿真结果表明,该算法能够明显改善垂直切换过程中的掉话情况,降低切换失败概率。同时,与其他同类算法的时间消耗相比,该算法能够维持在一个较低的水平。     

基于强化学习的异构网络垂直切换方法

网络切换技术不仅可以保证用户的网络连接,同时能够以较强的信号传输网络数据。网络切换技术的性能对网络服务质量(quality of service, QoS)的影响至关重要。然而,现有的切换算法多数存在严重的乒乓效应,这不仅造成网络资源的严重浪费,还会损害用户的QoS。为此,提出了一种基于强化学习的异构网络垂直切换方案,主要从触发切换、网络选择及判决切换等方面进行优化。在触发切换时将垂直切换考虑成必要切换和择优切换,通过Q-Learning（QL）算法在选择网络时优化垂直切换;然后以QoS为条件,在判决切换时加入驻留定时器,从多角度减少用户切换次数,降低乒乓效应对异构网络垂直切换的影响。仿真结果表明,基于强化学习的异构网络垂直切换方法可以在保证QoS的条件下有效减少用户切换网络的次数,短时间内频繁切换的情况也有所改善,降低了乒乓效应的影响。     

一种基于移动趋势量化的多属性垂直切换判决算法

由于对终端移动趋势的不明确,基站容易盲目发起切换,并导致较高的切换失败率。该文在LTE-WiMAX网络构成的异构无线网络环境下对现有的垂直切换算法进行了优化。该优化算法考虑了终端移动趋势,利用趋势量化参数来推断终端最终的目标区域,解决已有判决算法中存在的不必要切换过多的问题,提高切换成功率。在衰落信道下的计算机仿真结果表明,该优化算法可以减小切换中的切换失败率,从而提高网络的切换性能。     

考虑负载均衡和用户体验的垂直切换算法

在超密集异构无线网络中,针对城区交通高峰期,大规模车载终端短时间聚集性移动引起的网络拥塞问题,该文提出一种考虑负载均衡和用户体验(LBUE)的垂直切换算法。首先,引入网络环境感知模型预测网络未来的拥塞程度,并提出一个融合自组织网络的网络架构,缓解网络拥塞。其次,定义业务适应度和负收益因子,并提出一种基于秩和比(RSR)的自适应切换判决算法,为用户筛选出当前环境下满意度最高的目标网络。实验结果表明,该算法能够有效降低终端接入网络的阻塞率和掉话率,实现网络间负载均衡并提升用户体验。     

一种多属性决策的异构网络选择算法

针对异构网络融合环境下的网络选择不能仅依靠物理信号强度的特点,利用多属性决策理论提出了一种异构网络选择算法。该算法考虑业务要求、用户喜好以及网络差异,通过层次分析法和熵值法确定网络属性的权重,并由此计算可得网络性能,选出最优网络。仿真结果表明,此算法可以准确选择接入网络,并当用户在网络边缘做兵乓运动时有效减小切换次数,降低丢包率。     

基于模糊层次—熵权法的自适应垂直切换算法

针对当前异构网络中,采用多决策属性的垂直切换算法难以动态调整网络属性的权重值,从而无法满足用户服务质量(QoS)的需求问题,文章以接入最优的异构无线网络和保障用户QoS为目标,提出基于模糊层次—熵权法的自适应垂直切换算法.首先,根据用户对网络属性的不同要求,采用主观模糊层次赋权与客观熵权法结合的方式构建网络属性优化模型...     

超密集网络中基于MEC的动态任务卸载方案

超密集网络(Ultra-dense Network,UDN)中集成移动边缘计算(Mobile Edge Computing,MEC),是5G中为用户提供计算资源的可靠方式,在多种因素影响下进行MEC任务卸载决策一直都是一个研究热点。目前已存在大量任务卸载相关的方案,但是这些方案中很少将重心放在用户在不同条件下的能耗需求差异上,无法有效提升用户体验质量(Quality of Experience,QoE)。在动态MEC系统中提出了一个考虑用户能耗需求的多用户任务卸载问题,通过最大化满意度的方式提升用户QoE,并将现有的深度强化学习算法进行了改进,使其更加适合求解所提优化问题。仿真结果表明,所提算法较现有算法在算法收敛性以及稳定性上具有一定提升。     

面向5G超密集异构网络的模糊逻辑切换算法

针对基站之间距离近、网络数量庞大的超密集网络中切换过程存在干扰以及频繁切换问题，提出了一种基于预判决的模糊逻辑切换算法。算法在计算用户接收信号的信干噪比基础上，预筛选出干扰较小的网络，计算用户在筛选出的候选网络中的停留时间，当停留时间大于门限值时对候选网络使用基于模糊逻辑的逼近理想解排序算法。通过模糊逻辑优化网络属性参数，进而使用逼近理想解排序算法对候选网络进行排序。排序过程中，使用修正后的贴近度计算方式使计算结果更加精确。仿真实验证明，该算法在超密集异构网络切换中可以有效降低切换次数，减少网络阻塞概率，有效提升用户服务质量。     

LTE-Advanced系统中的移动顽健性优化技术研究

网络自优化技术目前成为移动通信网络性能研究的热点.随着移动通信技术和业务的飞速发展,移动顽健性日益成为用户体验关注的重点,尤其是移动蜂窝通信网络中的切换失败、用户掉话、通信质量差等一系列问题.为解决此类切换带来的用户体验和系统移动顽健性下降问题,针对一种面向切换事件和切换场景的移动顽健性优化算法(MRO算法),以用户掉话率作为性能评价标准,分别在同构和异构网络下,综合考虑切换事件和不同切换失败场景(过早切换、过晚切换、乒乓切换)的特点优化调整切换参数,并采用系统级仿真进行了性能比较.仿真结果表明,加入MRO算法后,同构场景的掉话率从10.9％下降到6.2％,异构场景的掉话率从11.3％下降到6.3％,整体性能得到大幅提升.     

毫米波微小区网络中基于公平准则的分布式用户关联算法

由于定向线性视距(Line-of-Sight,LOS)传输和对障碍物的敏感,使得毫米波微小区网络中的用户关联问题更为复杂。提出一种毫米波微小区网络中基于公平准则的用户关联算法,首先建模毫米波信道的不稳定性和用户切换成本,然后将基于公平准则的用户关联算法建模并证明为一个凸问题,利用拉格朗日对偶理论对原问题进行求解。分析与仿真结果表明:(1)当小区切换成本较低时,用户终端(User Equipment, UE)仅关联至单个微基站(Small Base Station, SBS)上为宜;(2)当小区切换成本较高时,UE同时关联至多个微基站为宜;(3)与其它算法相比,文中所提方法吞吐量增益显著。     

异构无线网络中基于模糊逻辑的分级垂直切换算法

在异构无线网络中,针对综合考虑网络端和用户端参数的垂直切换算法,参数权重难以确定,同时基于模糊逻辑的垂直切换算法存在复杂度高的问题,该文提出一种基于模糊逻辑的分级垂直切换算法。首先,将接收信号强度(RSS)、带宽、时延输入到1级模糊逻辑系统,结合规则自适应匹配,推理出QoS模糊值,并通过QoS模糊值对网络进行初步筛选得到候选网络集;然后通过触发机制触发2级模糊逻辑系统,并将候选网络的QoS模糊值、网络负载率、用户接入费用输入2级模糊逻辑系统,同时结合规则自适应匹配,得到输出判决值,从而选择最佳接入网络。最后,实验结果表明,该算法能保证网络性能的同时,降低系统的时间开销。     

Modular handover algorithm for 5G HetNets with comprehensive load index

Most existing handover decision system (HDS) designs are monolithic, resulting in high computational cost and unbalance of overall network. A novel modular handover algorithm with a comprehensive load index for the 5th generation (5G) heterogeneous networks (HetNets) is proposed. In this paper, the handover parameters, serving as the basis for handover, are classified into network's quality of service (QoS) module, user preference (UP) module and degree of satisfaction (DS) module according to the new modular HDS design. To optimize switching process, the comprehensive network load index is deduced by using triangle module fusion operator. With respect to the existing handover algorithm, the simulation results indicate that the proposed algorithm can reduce the handover frequency and maintain user satisfaction at a higher level. Meanwhile, due to its block calculation, it can bring about 1.4 s execution time improvement.     

Quality of experience and quality of service-aware handover for video transmission in heterogeneous networks

Heterogeneous networks offer a wide range of multimedia services, such as entertainment, advertising, and video conferences. In this multimedia scenario, users can access video content via heterogeneous wireless networks, such as LTE macro and small cells. Users also expect to receive real-time videos with Quality of Experience (QoE) support, which is a challenging task due to the great diversity of radio base stations in such heterogeneous environments. In this article, we introduce a Quality of Service (QoS-)/QoE- and Radio-aware (SER) handover management algorithm for heterogeneous networks to provide video dissemination with QoS/QoE support. SER algorithm considers the analytic hierarchy process (AHP) to adjust the degree of importance of each criterion in order to select the appropriate radio base station that the mobile node must connect, allowing efficient handover decision making for video transmission with high user experience. Simulation results show that the SER algorithm delivered videos with significant improvement on QoE than existing handover algorithms.     

Quality of experience evaluation of HTTP video streaming based on user interactive behaviors

User interactive behaviors play a dual role during the hypertext transfer protocol (HTTP) video service: reflection and influence. However, they are seldom taken into account in practices. To this end, this paper puts forward the user interactive behaviors, as subjective factors of quality of experience (QoE) from viewer level, to structure a comprehensive multilayer evaluation model based on classic network quality of service (QoS) and application QoS. First, dual roles of user behaviors are studied and the characteristics are extracted where the user experience is correlated with user interactive behaviors. Furthermore, we categorize QoE factors into three dimensions and build the metric system. Then we perform the subjective tests and investigate the relationships among network path quality, user behaviors, and QoE. Ultimately, we employ the back propagation neural network (BPNN) to validate our analysis and model. Through the simulation experiment of mathematical and BPNN, the dual effects of user interaction behaviors on the reflection and influence of QoE in the video stream are analyzed, and the QoE metric system and evaluation model are established.     

一种基于QoS的QoE到SLA映射方法

该文提出一种算法IQoE2QoS(Improved QoE to QoS),采用模糊理论的方法计算QoE到QoS的映射。该算法有3重目标:从大量的经验数据中通过计算互信息量方式总结被统计指标之间的关联程度。在大量经验数据的基础上通过多指标模糊判定理论将用户感知映射到应用层用户QoS参数。考虑了用户的QoE和QoS的双向映射,并且阐述了得到的QoE如何自然映射到SLA(Service Level Agreement)。通过仿真表明,IQoE2QoS算法对用户体验的分类准确度是线性回归算法的2到3倍。     

HTTP自适应流媒体直播系统中的用户体验质量优化

分析HTTP自适应流媒体直播系统中对终端用户体验质量(QoE)产生影响的各类因素及其相互之间的作用关系,对基于服务器端、网络传输以及客户端的QoE优化策略进行总结。认为HTTP自适应流媒体直播系统的QoE优化重点在于降低延时,提出结合网络层和应用层影响因素来降低时延并提升用户QoE的建议。     

A preset threshold based cross-tier handover algorithm for uplink co-channel interference mitigation in two-tier femtocell networks

This paper considers the co-channel interference mitigation problem and proposes a preset threshold based cross-tier handover algorithm for uplink co-channel interference mitigation in two-tier femtocell networks. The proposed cross-tier handover algorithm introduces a preset threshold cross-tier handover policy, which takes into account both the time-to-stay (TTS) of a macrocell user equipment (MUE)/femtocell user equipment (FUE) in a femtocell/the macrocell, and the received signal to interference plus noise ratio (SINR) at a femtocell access point (FAP)/the macrocell base station (MBS) in making a cross-tier handover decision for an MUE/FUE. A cross-tier handover decision is made by comparing the TTS of an MUE/FUE in a femtocells/the macrocell and the SINR at a FAP/the MBS with a preset TTS threshold and different SINR thresholds. The objective of the preset threshold based cross-tier handover algorithm is to increase the received SINR at the MBS/FAPs and thus improve the network performance. The performance of the proposed cross-tier handover algorithm with the minimum power transmission and the optimal power transmission is analyzed, respectively. Numerical results show that the proposed preset threshold based cross-tier handover algorithm can significantly improve the network performance in terms of the outage probability, user sum rate, and network capacity.     

IPTV视频质量评价介绍

IPTV作为三网融合的重要内容,其发展备受关注,提供具有良好的用户体验质量(Quality of Experience,QoE)服务是其与传统电视业务相竞争的关键。所以,对IPTV基于QoE的视频质量评价越来越重要,对IPTV的QoE视频质量评价方法进行了介绍,重点讨论了针对编码和网络传输损伤的视频质量客观评价方法。     

Q2ABR: QoE‐aware adaptive video bit rate solution

In this paper, we propose a new adaptive bit rate (ABR) streaming method. This method is based on estimating and monitoring users' video streaming experience, their quality of experience (QoE). This ensures a good user QoE and optimises bandwidth utilisation by monitoring video buffer fill rate to ensure minimal data traffic. First, we achieve a QoE evaluation model based on network bandwidth, video segment representation, and dropped video frame rate parameters. Second, following our QoE evaluation model, we formulate an ABR method using the reinforcement learning (RL) paradigm to select video representations and using a breakpoint detection mechanism to monitor end‐user QoE variation. The proposed ABR method is called “QoE‐aware adaptive bit rate (Q2ABR)” and is composed of three individual modules, one for QoE estimation using machine learning methods, one for QoE variation monitoring using the breakpoint detection mechanism, and one for video representation selection using reinforcement learning. The design objective of Q2ABR is to ensure the overall QoE of these users while maintaining a minimum variation in the standard deviation of the users' QoE values. Third, the performance of the Q2ABR method is evaluated and compared with several existing ABR approaches in the literature using real traces that we collect on different transport scenarios (such as bus and train, among others). Since this method considers the user's perception of video quality as a regulator for optimising the overall video distribution network, good results are ensured in terms of the user's experience and buffer fill rate.