Optimized scalable cache management for video streaming system

An important research issue in video streaming is how to efficiently utilize the network resources to provide clients instant access to multiple video objects. Caching strategy and transmission scheme are the two essential points inside the video streaming framework. Recent research efforts on them are not sufficient due to their inflexible support for scalable encoded video streams and heterogeneous requests from clients. In this paper, we propose an optimized caching strategy (OCS) and a scalable transmission scheme (STS) for scalable coded video streaming. By exploring the characteristics of video streaming workload and system design objectives, OCS and STS work efficiently to minimize both network bandwidth cost and user access latency. Firstly, we analyze the caching problem for the proxy-assisted video streaming system and derive a maneuverable caching scenario. Secondly, we develop an efficient transmission scheme for scalable coded videos. Thirdly, we formulate a multi-objective optimization model with closed-form expressions to obtain the optimized caching strategy. Finally, with designed algorithms, an excellent compromise between two competing objectives (minimizing the bandwidth cost and the access latency) is achieved. We start our evaluation by studying the optimized caching strategy for a single video object. Then we apply the strategy to multiple video objects and illustrate the tradeoff between the optimization objectives. Our evaluation results show that compared with other caching strategies, the proposed optimized scalable caching strategy can achieve a significant reduction in bandwidth cost with even a small proxy cache size. Meanwhile, the best performance (in terms of bandwidth cost) is obtained together with the proposed scalable batch-patching transmission scheme.

An end-to-end robust approach for scalable video over the internet

With the growth of the Internet and abundant network resources, video streaming is becoming one of the increasingly important Internet applications. However, the current IP-based network provides only a single class best effort service. Video packet can be regarded as a packet loss by the video decoder either due to network congestion or due to exceeding the maximum delay threshold. It remains an open challenging task as to how to cope with the packet loss in the video streaming over the Int…     

IEEE 802.11e网络中传输可分级视频流的调度方案

在保证可分级视频流延时要求的情况下,为了有效提高其在无线网络中传输的带宽利用率,提出了一种新的调度方案。该方案利用可分级视频流的分解特性以及不同的流采用不同的调度周期来提高带宽利用率。数值结果表明该方案非常有效,特别是当物理层传输速率较大的时候,其有效性更加明显。     

A novel hybrid 3D video service algorithm based on scalable video coding (SVC) technology

A scalable video coding (SVC) server can simultaneously provide a single bitstream with a fixed maximum service layer for different kinds of devices having different memory capacity, network bandwidth, and CPU performance requirements. An efficient hybrid 3D video service scheme is proposed without violation of the SVC standard technology for multiple transmission paths. A dynamic local disparity vector estimation algorithm is used to reflect the motion shift component between stereo views in the inter-layer prediction stage of the SVC encoder. To improve the coding efficiency, an adaptive search scheme based on distortion rates (DRs) between corresponding and reference macroblocks is used. Based on experimental results, up to 1.41 dB of quality improvement using JSVM 9.19 reference software is verified.     

大数据量实时视频流传输拥塞控制研究

大数据量实时视频流传输系统有广泛的应用前景。大数据量、高带宽要求的视频流传输中存在许多问题。网络的负载均衡、视频的回放质量都将严重影响整个网络的安全以及传输系统的应用。通过对丢包率进行卡尔曼过滤(Kalman Filter)分析预测网络负载状况、结合接收缓冲区大小设置来平滑发送速率,在分析TCP友好拥塞控制的基础上,提出了一种基于RTCP反馈的TCP友好(TCP-Friendly)对该机制的TCP友好性、视频的回放质量进行了实验和结果分析。     

Relay-assisted hierarchical adaptation scheme for multi-user scalable video delivery to heterogeneous mobile devices

In multi-user video (MUV) delivery scenarios,the available resources of receiver devices,such as processing capability,link packet error rate (PER),and bandwidth,are usually different.We propose a relay-assisted hierarchical adaptation (RHA) scheme to maximize the total perceptual quality of all users when transmitting video streams coded via scalable video coding (SVC).First,MUV bitstreams are adaptively extracted under the constraints of network bandwidth and individual decoding capacity.Next,the relay links are introduced as substitutes of possible bad direct links for packets retransmissions.Approximately equal opportunity of transmission is allocated to each stream while the packets inside a stream are scheduled according to their priorities.The priorities are determined by the links states and packets loss distortions.Simulation results show that our RHA scheme has significant performance improvements compared with other schemes.     

A DASH-based HEVC multi-view video streaming system

Recent advancement in cameras and image processing technology has generated a paradigm shift from traditional 2D and 3D video to multi-view video (MVV) technology, while at the same time improving video quality and compression through standards such as high efficiency video coding (HEVC). In multi-view, cameras are placed in predetermined positions to capture the video from various views. Delivering such views with high quality over the Internet is a challenging prospect, as MVV traffic is several times larger than traditional video, since it consists of multiple video sequences, each captured from a different angle, requiring more bandwidth than single-view video to transmit MVV. In addition, the Internet is known to be prone to packet loss, delay, and bandwidth variation, which adversely affect MVV transmission. Another challenge is that end users’ devices have different capabilities in terms of computing power, display, and access link capacity, requiring MVV to be adapted to each user’s context. In this paper, we propose an HEVC multi-view system using Dynamic Adaptive Streaming over HTTP to overcome the above-mentioned challenges. Our system uses an adaptive mechanism to adjust the video bit rate to the variations of bandwidth in best effort networks. We also propose a novel scalable way for the multi-view video and depth content for 3D video in terms of the number of transmitted views. Our objective measurements show that our method of transmitting MVV content can maximize the perceptual quality of virtual views after the rendering and hence increase the user’s quality of experience.     

嵌入式多通道无线视频传输的码率自适应算法

无线视频传输和视频压缩技术是当前众多物联网（IoT）应用和嵌入式系统的基础和核心。而在多通道传输时无线网络状态的不断变化,会导致视频丢帧和延时抖动问题。虽然自适应算法能够在一定程度上解决在PC或服务器平台下的视频传输问题,但在嵌入式平台和无线网络下仍不能满足实时性和服务质量（QoS）要求。为此,基于DM368芯片设计了一从视频采集、压缩、WiFi传输、控制单元接收到上位机显示的完整平台。同时充分考虑了嵌入式平台的特点,提出一种结合信号质量、网络带宽、缓存状态和拥塞控制的码率自适应算法。该算法利用高斯函数统计网络带宽,使用分段反比例函数调整缓存状态,利用加权移动法对码率进行平滑,并使用极值抑制法进行码率均衡。该算法实现了码率的平滑调整,并被应用于所提平台来实现控制单元对多个WiFi相机的管理、多通道传输和负载均衡。以QoS为评价指标进行实验验证,结果表明：该算法在设计的嵌入式平台上性能良好,平滑性和缓存稳定性都有很大提升,多通道状态下的公平性和带宽利用率也有显著提高。在单相机信号质量动态变化或多相机竞争带宽等多种情况下,相对于MDI（McGinely Dynamic Indicator）算法,该算法的平滑性提升了16%~59%;相对于BBA（Buffer-Based Algorithm）,该算法的缓存抖动降低了15%~72%,时延抖动降低了12%~76%。     

基于预测机制的云媒体网络自适应视频流选择算法

研究移动网络中,如何进一步提高云媒体服务带宽利用率的问题,提出一种基于预测机制的云媒体网络自适应视频流选择算法。该算法包含可用带宽预测模型和视频流决策模型。在带宽预测模型中,根据带宽评估结果把当前的网络状态划分为三个模式,每个模式对应不同的带宽预测方法,并且不同的模式能够相互转化。在视频流决策模型中,利用预测的可用带宽,结合可伸缩视频编码技术为用户自适应的调整视频质量。根据实验,在不同网络环境下,该方法能够有效的利用带宽,并提高媒体服务质量。     

Seamless switching of scalable video bitstreams for efficient streaming

Efficient adaptation to channel bandwidth is broadly required for effective streaming video over the Internet. To address this requirement, a novel seamless switching scheme among scalable video bitstreams is proposed in this paper. It can significantly improve the performance of video streaming over a broad range of bit rates by fully taking advantage of both the high coding efficiency of nonscalable bitstreams and the flexibility of scalable bitstreams, where small channel bandwidth fluctuations are accommodated by the scalability of a single scalable bitstream, whereas large channel bandwidth fluctuations are tolerated by flexible switching between different scalable bitstreams. Two main techniques for switching between video bitstreams are proposed. Firstly, a novel coding scheme is proposed to enable drift-free switching at any frame from the current scalable bitstream to one operated at lower rates without sending any overhead bits. Secondly, a switching-frame coding scheme is proposed to greatly reduce the number of extra bits needed for switching from the current scalable bitstream to one operated at higher rates. Compared with existing approaches, such as switching between nonscalable bitstreams and streaming with a single scalable bitstream, our experimental results clearly show that the proposed scheme brings higher efficiency and more flexibility in video streaming.     

基于视点预测的全景视频码率自适应策略

为解决全景视频传输中存在的视频卡顿多、用户体验质量（quality of experience,QoE）低等问题,研究当前主流的视点自适应传输方案,提出一种基于视点预测的码率自适应策略（VPBAS）。首先,构建了一种基于长短期记忆网络和全卷积网络的视点预测模型,模型将视点数据和视频显著性信息进行特征融合,实现不同模态数据的相互补充和修正,提高视点预测的准确率;然后,客户端采用随机森林算法预测当前的可用带宽,并根据视点预测结果和可用带宽信息为视频分块选择码率。最后,客户端把选择的码率信息定期发送给服务器,服务器根据反馈的信息向客户端推送最佳码率的全景视频流,这种交互过程在视频播放期间不断地重复,直至客户端观看完毕。实验结果表明,与现有传输方案相比,VPBAS能有效提高带宽受限情况下的视频观看体验。     

Fuzzy-based rate control for real-time MPEG video

We propose a fuzzy logic-based control scheme for real-time motion picture expert group (MPEG) video to avoid long delay or excessive loss at the user-network interface (UNI) in an asynchronous transfer mode (ATM) network. The system consists of a shaper whose role is to smooth the MPEG output traffic to reduce the burstiness of the video stream. The input and output rates of the shaper buffer are controlled by two fuzzy logic-based controllers. To avoid a long delay at the shaper, the first controller aims to tune the output rate of the shaper in the video frame time scale based on the number of available transmission credits at the UNI and the occupancy of the shaper's buffer. Based on the average occupancy of the shaper's buffer and its variance, the second controller tunes the input rate to the shaper over a much larger time scale by applying a closed-loop MPEG encoding scheme. With this approach, the traffic enters the network at an almost constant bit rate (with a very small variation) allowing simple network management functions such as admission control and bandwidth allocation, while guaranteeing a relatively constant video quality since the encoding rate is changed only in critical periods when the shaper buffer “threatens” to overflow. The performance of the proposed scheme is evaluated through numerical tests on real video sequences     

一种基于CCD原始数据的网络视频压缩方案

研究分析了网络视频系统的基本原理和视频压缩方法,着重介绍了CCD成像原理和色彩还原的基本技术和方法,论述了JPEG压缩算法对彩色和灰度图像压缩不同,最后,提出了一种新型的基于CCD原始数据的网络视频压缩方案。并通过仿真将之与通常压缩方法进行比较,在传送同样质量的图像时,带宽减小1/3。     

Scalable video transmission for the Internet

Information systems and distributed applications for the Internet show a growing demand for real-time audiovisual services. Support for those services within the Internet protocol layer will be widely available in the near future. Nevertheless, the heterogeneous structure of the Internet remains to be a great obstacle for establishing real-time video services. Scalable video codecs, generating bit-streams decodable at different rates, have been proposed to address the heterogeneity problem. In this article we present a scalable codec based on a spatio-temporal resolution pyramid combined with lattice vector quantization for efficient compression. With this approach additional lower bit-rate layers can be transmitted at the same overall bit-rate as needed by an H.263 single-layer transmission. The complexity of the codec is sufficiently low to allow software-only implementations of Internet video services. This is demonstrated on an Internet video server application.     

Content-aware optimization on rate-distortion and network traffic for scalable video multicast networks

This paper aims to optimize the content-aware prioritization of scalable video multicast, which is coupled with multipath streaming and network coding based routing. It constructs multiple layer distribution meshes for the scalable video stream to minimize the total video distortion at all the receivers, determines the base layer meshes with minimum costs to maintain application-layer QoS and the layer synchronization of SVC streaming, and improves the network throughput by encouraging path-overlapping transmissions and thus allowing bandwidth sharing among different receivers for the same video layer by utilizing network coding. The targeted problem is formulated into a minimization programming in which the quality variation between layers, the transmission cost of the base layer, as well as the efficient resource utilization are jointly considered. By decomposition and dual approach, the global convex problem is solved by a two-level decentralized iterative algorithm. The implementation of the distributed algorithm is discussed with regard to the communication overhead, and the convergence performance is validated by numerical experiments. Packet-level simulations demonstrate that the proposed algorithm could approximately achieve the maximum flow rates determined by Max-Flow Min-Cut Theorem and benefit the overall received video quality.     

端到端MPEG-4 FGS视频TCP友好的平滑传输

着重研究了Internet上MPEG-4 FGS(fine grained scalable)视频流的自适应平滑传输,其主要目的在于,在网络带宽变化的情况下,提供稳定的视频回放质量.提出了一种新的基于TFRC(TCP-friendly rate control)的MPEG-4 FGS端到端视频流传输系统框架,在此框架的基础上,首先假设完整的可用带宽变化已知,并且提出了一种离线的自适应平滑算法.此后,给出一种基于改进的ARAR(autoregressive autoregressive)预测技术的在线自适应平滑算法.最后,以NS-2为实验平台进行了模拟实验.模拟实验表明,提出的离线和在线自适应平滑算法可以充分利用可用网络带宽,并且能够在可用网络带宽持续波动的情况下保证接收方的回放尽可能地平稳,从而达到获得最佳视觉效果的目的.     

Blind quality scalable video compression algorithm for low bit-rate coding

Multimedia Tools and Applications - An efficient way of using Embedded Zero-trees of Wavelet (EZW) architecture for video compression, termed as “Two Threshold EZW”, has been introduced...     

Scalable video object coding &; QoS control for next generation space internet

The next generation space internet （NGSI） is based on all-IP-based mobile network that merges land-based network, sea-based network, sky-based network, spacebased network, deep space-based network together using existing assess network technologies. There are high signal propagation delays, high error rate, bandwidth variation and time-variety in NGSh In order to adapt to various space communication environment constraints and bandwidth variation, we propose a reduced dimension scalable video coding scheme based on CCSDS IDCS algorithm and quality of service （QoS） control method by cross layer design （CLD）. The experimental result shows that this new method has better performance than that of existing algorithms, and can be adaptive to the bandwidth variation dynamically.     

Enhancing aggregate QoS for video streaming

The IETF's Differentiated Services architecture is designed to provide different types or levels of service for Internet traffic. One of its key features is that traffic flows are aggregated so that routers in the core network only need to distinguish a relatively small number of aggregate flows, even if those flows consist of hundreds or thousands of individual flows. However, network-level QoS differentiation may not satisfy the requirements of many QoS-sensitive applications such as live video streaming, where end-to-end delay and reliability must be guaranteed.

This paper investigates application-level service differentiation for MPEG video streaming in a Diff-Serv-aware MPLS network infrastructure, along with routing support at the network layer. Based on the fact that MPEG video has become one of the most popular formats for Internet (wired and wireless) users, our approach enhances aggregate QoS for video streaming by employing existing application-level knowledge of the MPEG video structure; therefore it requires neither a new video compression algorithm nor additional bandwidth. Several MPEG video dispersion models are proposed and analyzed. Simulation results show that two such strategies are superior to the other tested. In addition, a new routing scheme is proposed to support searching the ‘best’ paths for efficient multi-path video streaming. Through extensive simulations, we demonstrate that our approaches improve the aggregate QoS of MPEG video streams, as well as overall network efficiency.