SSIM-based error-resilient cross-layer optimization for wireless video streaming

The traditional Sum of Squared Error (SSE)-based cross-layer optimization has been shown to be an effective way to improve the quality of service for wireless video streaming. However, recent research works show that the SSE-based optimization metric does not always provide the video distortion measurement that matches well with the video quality degradation observed by the human vision system. Taking advantage of the Structural SIMilarity (SSIM) metric in measuring the video perceptual quality, a SSIM-based error-resilient cross-layer optimization scheme is proposed to improve the perceptual quality for the real-time wireless video streaming in this paper. Besides the video data rate adjustment and the link adaption including the Modulation and Coding Scheme (MCS) selection, the error-resilient Rate-Distortion Optimization (RDO) for each encoding unit is introduced into the cross-layer optimization process to ensure that the video data are transmitted efficiently and reliably over the time-varying wireless channel. In addition, to ensure that cross-layer optimization scheme is more practical, a low-complexity optimal parameter selection algorithm that exploits the MCS-SNR relationship and the Rate-Quantization (R-Q) model is proposed. Experimental results show that significant performance improvements in terms of the perceptual video quality and the computational complexity are achieved for the proposed cross-layer optimization scheme.     

End-to-end optimized TCP-friendly rate control for real-time video streaming over wireless multi-hop networks

Rate control is an important issue in video streaming applications. The most popular rate control scheme over wired networks is TCP-Friendly Rate Control (TFRC), which is designed to provide optimal transport service for unicast multimedia delivery based on the TCP Reno’s throughput equation. It assumes perfect link quality, treating network congestion as the only reason for packet losses. Therefore, when used in wireless environment, it suffers significant performance degradation because of packet losses arising from time-varying link quality. Most current research focuses on enhancing the TFRC protocol itself, ignoring the tightly coupled relation between the transport layer and other network layers. In this paper, we propose a new approach to address this problem, integrating TFRC with the application layer and the physical layer to form a holistic design for real-time video streaming over wireless multi-hop networks. The proposed approach can achieve the best user-perceived video quality by jointly optimizing system parameters residing in different network layers, including real-time video coding parameters at the application layer, packet sending rate at the transport layer, and modulation and coding scheme at the physical layer. The problem is formulated and solved as to find the optimal combination of parameters to minimize the end-to-end expected video distortion constrained by a given video playback delay, or to minimize the video playback delay constrained by a given end-to-end video distortion. Experimental results have validated 2–4 dB PSNR performance gain of the proposed approach in wireless multi-hop networks by using H.264/AVC and NS-2.     

Quality-driven cross-layer optimized video delivery over LTE

3GPP Long Term Evolution is one of the major steps in mobile communication to enhance the user experience for next-generation mobile broadband networks. In LTE, orthogonal frequency- division multiple access is adopted in the downlink of its E-UTRA air interface. Although cross-layer techniques have been widely adopted in literature for dynamic resource allocation to maximize data rate in OFDMA wireless networks, application-oriented quality of service for video delivery, such as delay constraint and video distortion, have been largely ignored. However, for wireless video delivery in LTE, especially delay-bounded real-time video streaming, higher data rate could lead to higher packet loss rate, thus degrading the user-perceived video quality. In this article we present a new QoS-aware LTE OFDMA scheduling algorithm for wireless real-time video delivery over the downlink of LTE cellular networks to achieve the best user-perceived video quality under the given application delay constraint. In the proposed approach, system throughput, application QoS constraints, and scheduling fairness are jointly integrated into a cross-layer design framework to dynamically perform radio resource allocation for multiple users, and to effectively choose the optimal system parameters such as modulation and coding scheme and video encoding parameters to adapt to the varying channel quality of each resource block. Experimental results have shown significant performance enhancement of the proposed system.     

Combining the rate adaptation and quality adaptation schemes for wireless video streaming

Video streaming service over wireless networks is a challenging task because of the changes in the wireless channel conditions that can occur due to interference, fading, and station mobility. Moreover, the IEEE 802.11 WLAN standard does not contain any specifications for the rate adaptation scheme which are useful for improving the wireless link utilization. To provide efficient wireless video streaming service, the rate adaptation scheme should be applied at the low layer and the quality adaptation scheme should be considered at the high layer. To meet this requirement of wireless video streaming, we propose a new cross-layer design for video streaming over wireless networks. This design includes the rate adaptation scheme in the data link and physical layers and the quality adaptation scheme in the application layer. The rate adaptation scheme adjusts the data transmission rate based on the measured RSSI at the sender-side and informs the quality adaptation scheme about the rate limits. Then the quality adaptation scheme utilizes this rate limits to adjust the quality of the video stream. Through performance evaluations, we prove that our cross-layer design improves the wireless link utilization and the quality of the video stream simultaneously.     

3D visual experience oriented cross-layer optimized scalable texture plus depth based 3D video streaming over wireless networks

3D video streaming over the mobile Internet generally incurs the inferior 3D visual experience due to the time-varying characteristics of wireless channel. The conventional video streaming optimization methods generally neglect the harmony among different networking protocol layers. This paper proposes a cross-layer optimized texture plus depth based scalable 3D video streaming method to improve the expected 3D visual experience of the user by systematically considering the application layer texture-video/depth/FEC bit-rate allocation, MAC layer multi-channel allocation, and physical layer modulation and channel coding scheme (MCS) selection. In the cross-layer optimization, a networking-related 3D visual experience model which fuses the overlapped retinal view visual quality and depth sensation with mimicking human vision system is established to predict the 3D visual experience under the specific parameter configurations of different protocol layers. The efficiency and effectiveness of the proposed cross-layer optimized 3D video streaming method has been validated by subjective and objective experimental results.     

A unified framework for distributed video rate allocation over wireless networks

When multiple video streams share a wireless network, careful rate allocation is needed to prevent congestion, as well as to balance the video qualities among the competing streams. In this paper, we present a unified optimization framework for video rate allocation over wireless networks. Our framework applies to both unicast and multicast sessions, and accommodates both scalable and non-scalable streams. The optimization objective is to minimize the total distortion of all video streams without incurring excessive network utilization. Our system model explicitly accounts for heterogeneity in wireless link capacities, traffic contention among neighboring links, as well as different video rate-distortion (RD) characteristics. The proposed distributed media-aware rate allocation scheme leverages cross-layer information exchange between the MAC and application layers to achieve fast convergence at the optimal allocation.We evaluate performance of the proposed scheme for streaming of high-definition (HD) and standard-definition (SD) video sequences over 802.11-based wireless networks, both in unicast and multicast scenarios. The scheme consistently outperforms conventional TCP-Friendly Rate Control (TFRC) in terms of overall video quality, and achieves more balanced qualities among the streams.     

Cross-Layer Optimized Video Streaming Over Wireless Multihop Mesh Networks

The proliferation of wireless multihop communication infrastructures in office or residential environments depends on their ability to support a variety of emerging applications requiring real-time video transmission between stations located across the network. We propose an integrated cross-layer optimization algorithm aimed at maximizing the decoded video quality of delay-constrained streaming in a multihop wireless mesh network that supports quality-of-service. The key principle of our algorithm lays in the synergistic optimization of different control parameters at each node of the multihop network, across the protocol layers-application, network, medium access control, and physical layers, as well as end-to-end, across the various nodes. To drive this optimization, we assume an overlay network infrastructure, which is able to convey information on the conditions of each link. Various scenarios that perform the integrated optimization using different levels ("horizons") of information about the network status are examined. The differences between several optimization scenarios in terms of decoded video quality and required streaming complexity are quantified. Our results demonstrate the merits and the need for cross-layer optimization in order to provide an efficient solution for real-time video transmission using existing protocols and infrastructures. In addition, they provide important insights for future protocol and system design targeted at enhanced video streaming support across wireless mesh networks     

Downlink media streaming with wireless fountain coding in wireline‐cum‐WiFi networks

This paper addresses the problem of streaming packetized media data in a combined wireline/802.11 network. Since the wireless channel is normally the bottleneck for media streaming in such a network, we propose that wireless fountain coding (WFC) be used over the wireless downlink in order to efficiently utilize the wireless bandwidth and exploit the broadcast nature of the channel. Forward error correction (FEC) is also used to combat errors at the application‐layer. We analytically obtain the moment generating function (MGF) for the wireless link‐layer delay incurred by WFC. With the MGF, the expected value of this wireless link‐layer delay is found and used by the access point (AP), who has no knowledge of the buffer contents of wireless receivers, to make a coding‐based decision. We then derive the end‐to‐end packet loss/late probability based on the MGF. We develop an integrated ns‐3/EvalVid simulator to evaluate our proposed system and compare it with the traditional 802.11e scheme which is without WFC capability but equipped with application‐ and link‐layer retransmission mechanisms. Through extensive simulations of video streaming, we show that streaming with WFC is able to support more concurrent video flows compared to the traditional scheme. When the deadlines imposed on video packets are relatively stringent, streaming with WFC also shows superior performance in terms of packet loss/late probability, video distortion, and video frame delay, over the traditional scheme. Copyright © 2011 John Wiley & Sons, Ltd.     

视频失真优化的分布式视频点播服务系统及性能分析

本文提出一种用于分布式视频点播服务系统的速率分配算法和实现框架。在考虑负载均衡与满足服务器带宽限制的前提下,速率分配能将以失真为度量的全局视频质量最优化。确定各服务结点的输出码率被建模成一个最优化问题：优化目标是最小化多个视频总失真,限制条件为最低可接受视频质量、服务器带宽限制以及发送速率对客户端TCP流量的友好性。根据优化算法的计算结果,视频节目使用可变码率编码,由多个视频分发服务器同时向客户端传输;同时服务器检测与客户端之间端到端链路的时变特性和估计网络拥塞情况,使优化速率分配结果适应网络状态的变化。本方案应用跨层设计的思想,将应用层视频质量建模为网络层参数的函数,当网络状态波动时,动态调整编码码率和发送速率以适应带宽变化,提前避免链路拥塞,降低接收端解码器丢包率,从而使总体视频质量得到提升。     

SSIM-based error-resilient rate-distortion optimization of H.264/AVC video coding for wireless streaming

The SSIM-based rate-distortion optimization (RDO) has been verified to be an effective tool for H.264/AVC to promote the perceptual video coding performance. However, the current SSIM-based RDO is not efficient for improving the perceptual quality of the video streaming application over the error-prone network, because it does not consider the transmission induced distortion in the encoding process. In this paper, a SSIM-based error-resilient RDO scheme for H.264/AVC is proposed to improve the wireless video streaming performance. Firstly, with the help of the SSE-based RDO, we present a low-complexity Lagrange multiplier decision method for the SSIM-based RDO video coding in the error-free environment. Then, the SSIM-based decoding distortion of the user end is estimated at the encoder and is correspondingly introduced into the RDO to involve the transmission induced distortion into the encoding process. Further, the Lagrange multiplier is theoretically derived to optimize the encoding mode selection in the error-resilient RDO process. Experimental results show that the proposed SSIM-based error-resilient RDO can obtain superior perceptual video quality (more structural information) to the traditional SSE-based error-resilient RDO for wireless video streaming at the same bit rate condition.     

A Resource Allocation Framework for Scalable Video Broadcast in Cellular Networks

Video streaming is one of the most important applications that will make use of the high data rates offered by 4G networks. The current video transport techniques are already very advanced, and the more immediate problems lie in the joint optimization of video coding, AL-FEC, and PHY rate selection with the goal of enhancing the user perceived quality. In this work we provide an analysis of video broadcast streaming services for different combinations of layered coding and AL-FEC, using a realistic LTE PHY layer. Our simulation results show that the scalable content adaptation given by Scalable Video Coding (SVC) and the scheduling flexibility offered by the 3G-LTE MAC-layer provide a good match for enhanced video broadcast services for next generation cellular networks. Our proposed solution is compared to baseline algorithms and broadcast systems based on H.264/AVC streaming solutions. We emphasize the system quality improvement brought by our solution and discuss implications for a wide-scale practical deployment.     

A Scalable Information Security Technique: Joint Authentication-Coding Mechanism for Multimedia over Heterogeneous Wireless Networks

There have been increasing concerns about the security issues of wireless transmission of multimedia in recent years. Wireless networks, by their natures, are more vulnerable to external intrusions than wired ones. Therefore, many applications demand authenticating the integrity of multimedia content delivered wirelessly. In this work, we propose a framework for jointly authenticating and coding multimedia to be transmitted over heterogeneous wireless networks. We firstly provide a novel graph-based authentication scheme which can not only construct the authentication graph flexibly but also trade-off well among some practical requirements such as overhead, robustness and delay. And then, a rate-distortion optimized joint source-channel coding (JSCC) approach for error-resilient scalable encoded video is presented, in which the video is encoded into multiple independent streams and each stream is assigned forward error correction (FEC) codes to avoid error propagation. Furthermore, we consider integrating authentication with the specific JSCC scheme to achieve a satisfactory authentication results and end-to-end reconstruction quality by optimally applying the appropriate authentication and coding rate. Simulation results show the effectiveness of the proposed authentication-coding scheme for multimedia over wireless networks.     

A Cross-Layer Adaptive Modulation and Coding Scheme for Energy Efficient Software Defined Radio

In this paper, a simple and novel cross-layer adaptive modulation and coding (AMC) scheme, which increases the energy efficiency of the wireless communication system is proposed. Traditionally, AMC has been used to improve MAC-layer performance in terms of coded bit error rate, packet error rate, and throughput. The modulation and coding scheme is switched according to signal-to-noise ratio thresholds at the PHY layer. We extend the approach, proposing a framework for energy-efficient cross-layer AMC that captures the impact of both MAC layer and PHY layer parameters on the AMC switching criteria. Cross-layer designs are naturally suited to software defined radio applications. Not only are they readily implemented in software, but also they are integral to the radio components. They can optimize performance of the radio either for a given configuration or adaptively. Through examples of WLAN physical layer and Frequency Domain Equalized systems, we demonstrate our AMC scheme and verify its effectiveness by simulation.     

End-to-end TCP-friendly streaming protocol and bit allocation for scalable video over wireless Internet

With the convergence of wired-line Internet and mobile wireless networks, as well as the tremendous demand on video applications in mobile wireless Internet, it is essential to an design effective video streaming protocol and resource allocation scheme for video delivery over wireless Internet. Taking both network conditions in the Internet and wireless networks into account, in this paper, we first propose an end-to-end transmission control protocol (TCP)-friendly multimedia streaming protocol for wireless Internet, namely WMSTFP, where only the last hop is wireless. WMSTFP can effectively differentiate erroneous packet losses from congestive losses and filter out the abnormal round-trip time values caused by the highly varying wireless environment. As a result, WMSTFP can achieve higher throughput in wireless Internet and can perform rate adjustment in a smooth and TCP-friendly manner. Based upon WMSTFP, we then propose a novel loss pattern differentiated bit allocation scheme, while applying unequal loss protection for scalable video streaming over wireless Internet. Specifically, a rate-distortion-based bit allocation scheme which considers both the wired and the wireless network status is proposed to minimize the expected end-to-end distortion. The global optimal solution for the bit allocation scheme is obtained by a local search algorithm taking the characteristics of the progressive fine granularity scalable video into account. Analytical and simulation results demonstrate the effectiveness of our proposed schemes.     

Application-driven cross-layer optimization for video streaming over wireless networks

Mobile multimedia applications require networks that optimally allocate resources and adapt to dynamically changing environments. Cross-layer design (CLD) is a new paradigm that addresses this challenge by optimizing communication network architectures across traditional layer boundaries. In this article we discuss the relevant technical challenges of CLD and focus on application-driven CLD for video streaming over wireless networks. We propose a cross-layer optimization strategy that jointly optimizes the application layer, data link layer, and physical layer of the protocol stack using an application-oriented objective function in order to maximize user satisfaction. In our experiments we demonstrate the performance gain achievable with this approach. We also explore the trade-off between performance gain and additional computation and communication cost introduced by cross-layer optimization. Finally, we outline future research challenges in CLD.     

Cross-layer optimization for 3-D video transmission over cooperative relay systems

The rate budget constraint and the available instantaneous signal-to-noise ratio of the best relay selection in cooperative systems can dramatically impact the system performance and complexity of video applications, since they determine the video distortion. By taking into account these constrained factors, we first outline the signal model and formulate the system optimization problem. Next, we propose a new approach to cross-layer optimization for 3-D video transmission over cooperative relay systems. We propose procedures for estimation of the end-to-end instantaneous signal-to-noise ratio using an estimate of the available instantaneous signal-to-noise ratios between the source–destination, and source–relay–destination before starting to send the video signal to the best relay and destination. A novel approach using Lagrange multipliers is developed to solve the optimum bit allocation problem. Based on the rate budget constraint and the estimated the end-to-end instantaneous signal-to-noise ratio, the proposed joint source–channel coding (JSCC) algorithm simultaneously assigns source code rates for the application layer, the number of high and low priority packets for the network layer, and channel code rates for the physical layer based on criteria that maximize the quality of video, whilst minimizing the complexity of the system. Finally, we investigate the impact of the estimated the end-to-end instantaneous signal-to-noise ratio on the video system performance and complexity. Experimental results show that the proposed JSCC algorithm outperforms existing algorithms in terms of peak signal-to-noise ratio. Moreover, the proposed JSCC algorithm is found to be computationally more efficient since it can minimize the overall video distortion in a few iterations.     

Resource allocation for downlink multiuser video transmission over wireless lossy networks

Demand for multimedia services, such as video streaming over wireless networks, has grown dramatically in recent years. The downlink transmission of multiple video sequences to multiple users over a shared resource-limited wireless channel, however, is a daunting task. Among the many challenges in this area are the time-varying channel conditions, limited available resources, such as bandwidth and power, and the different transmission requirements of different video content. This work takes into account the time-varying nature of the wireless channels, as well as the importance of individual video packets, to develop a cross-layer resource allocation and packet scheduling scheme for multiuser video streaming over lossy wireless packet access networks. Assuming that accurate channel feedback is not available at the scheduler, random channel losses combined with complex error concealment at the receiver make it impossible for the scheduler to determine the actual distortion of the sequence at the receiver. Therefore, the objective of the optimization is to minimize the expected distortion of the received sequence, where the expectation is calculated at the scheduler with respect to the packet loss probability in the channel. The expected distortion is used to order the packets in the transmission queue of each user, and then gradients of the expected distortion are used to efficiently allocate resources across users. Simulations show that the proposed scheme performs significantly better than a conventional content-independent scheme for video transmission.     

QoS guarantee and provisioning for realtime digital video over mobile ad hoc cdma networks with cross-layer design

In this article we investigate the trade-offs and the constraints for multimedia over mobile ad hoc CDMA networks, and propose a cross-layer distributed power control and scheduling protocol to resolve those trade-offs and constraints in order to provide high-quality video over wireless ad hoc CDMA networks. In particular, a distributed power control and scheduling protocol is proposed to control the incurred delay of video streaming over multihop wireless ad hoc networks, as well as the multiple access interference (MAI). We also investigate the impacts of Doppler spread and noisy channel estimates upon the end-to-end video quality, and provide a relatively robust system which employs a combination of power control and coding/interleaving to combat the effects of Doppler spread by exploiting the increased time diversity when the Doppler spread becomes large. Thus, more robust end-to-end video quality can be achieved over a wide range of channel conditions     

RD-optimized interactive streaming of multiview video with multiple encodings

This paper presents a rate-distortion (RD) optimized interactive streaming method for multiview video pre-compressed by H.264 Joint Multiview Video Model (JMVM). In the proposed method, multiple encodings are first used to facilitate the flexible server–client interaction. Second, a RD-optimized scheduling strategy is provided to guarantee the optimal view-dependent delivery of multiview video. In the RD-optimized scheduling strategy, a distortion model is proposed to estimate the expected end-to-end distortion by accounting for both coding and packet-loss-induced distortions, as well as rendering-induced distortion. With the end-to-end distortion model, the server can select the optimal encoding combination for transmission. Experimental results demonstrate that the proposed method can achieve a significant end-to-end RD performance improvement over the selective streaming methods with simulcast coding or scalable multiview coding. In addition, it has better error-resilience performance to combat with packet-losses over the Internet protocol (IP) networks.