Combining the rate adaptation and quality adaptation schemes for wireless video streaming

Video streaming service over wireless networks is a challenging task because of the changes in the wireless channel conditions that can occur due to interference, fading, and station mobility. Moreover, the IEEE 802.11 WLAN standard does not contain any specifications for the rate adaptation scheme which are useful for improving the wireless link utilization. To provide efficient wireless video streaming service, the rate adaptation scheme should be applied at the low layer and the quality adaptation scheme should be considered at the high layer. To meet this requirement of wireless video streaming, we propose a new cross-layer design for video streaming over wireless networks. This design includes the rate adaptation scheme in the data link and physical layers and the quality adaptation scheme in the application layer. The rate adaptation scheme adjusts the data transmission rate based on the measured RSSI at the sender-side and informs the quality adaptation scheme about the rate limits. Then the quality adaptation scheme utilizes this rate limits to adjust the quality of the video stream. Through performance evaluations, we prove that our cross-layer design improves the wireless link utilization and the quality of the video stream simultaneously.     

Combined power and rate adaptation for wireless cellular systems

We extend the throughput optimization technique of Qiu and Chawla (1999) for adaptive modulation, to combine power and rate adaptation in wireless cellular systems. We develop new combined power and rate control algorithms for wireless multimedia systems, in which the transmitted powers and rates of different media users are adapted based on the signal-to-interference power ratio. Using simulations, we show that with appropriately chosen power and rate limits, our proposed combined power and rate control algorithms can achieve a higher throughput when compared to previously proposed algorithms with power control only.     

Joint source-channel coding and power adaptation for energy efficient wireless video communications

We consider efficiently transmitting video over a hybrid wireless/wire-line network by optimally allocating resources across multiple protocol layers. Specifically, we present a framework of joint source-channel coding and power adaptation, where error resilient source coding, channel coding, and transmission power adaptation are jointly designed to optimize video quality given constraints on the total transmission energy and delay for each video frame. In particular, we consider the combination of two types of channel coding—inter-packet coding (at the transport layer) to provide protection against packet dropping in the wire-line network and intra-packet coding (at the link layer) to provide protection against bit errors in the wireless link. In both cases, we allow the coding rate to be adaptive to provide unequal error protection at both the packet and frame level. In addition to both types of channel coding, we also compensate for channel errors by adapting the transmission power used to send each packet. An efficient algorithm based on Lagrangian relaxation and the method of alternating variables is proposed to solve the resulting optimization problem. Simulation results are shown to illustrate the advantages of joint optimization across multiple layers.     

Fairness-oriented multi-stream rate adaptation using scalable video coding

In the delivery of video services like video on-demand, IP-TV, sport broadcasting, as well as real-time streaming, the end-user expectation is to receive the best feasible quality independently of the particular video complexity, even in the presence of packet losses. In this scenario, rate adaptation is required to optimize the overall quality, whereas fairness is an important issue that has to be addressed. In this paper we propose a multi-stream rate adaptation framework with reference to the scalable video coding (SVC) extension of the H.264/AVC standard with medium grain scalability (MGS). We first define a general discrete multi-objective problem with the aim to maximize the sum of assigned rates, while minimizing the differences among the expected distortions, under a total bit-rate constraint. A single-objective problem formulation is then derived by applying a continuous relaxation. Finally, a simplified continuous semi-analytical model that accurately estimates the rate–distortion relationship for both error-free channel and packet-erasure channel is also proposed, which allows us to derive an optimal and low-complexity procedure to solve the relaxed problem. Unequal erasure protection (UXP) is also considered and designed to suitably shape the rate–distortion relationship for different values of RTP packet-loss rate. The numerical results show the goodness of our framework in terms of error gap between the relaxed and its related discrete solution, and the significant performance improvement achieved with respect to an equal-rate adaptation scheme.     

A unified framework for distributed video rate allocation over wireless networks

When multiple video streams share a wireless network, careful rate allocation is needed to prevent congestion, as well as to balance the video qualities among the competing streams. In this paper, we present a unified optimization framework for video rate allocation over wireless networks. Our framework applies to both unicast and multicast sessions, and accommodates both scalable and non-scalable streams. The optimization objective is to minimize the total distortion of all video streams without incurring excessive network utilization. Our system model explicitly accounts for heterogeneity in wireless link capacities, traffic contention among neighboring links, as well as different video rate-distortion (RD) characteristics. The proposed distributed media-aware rate allocation scheme leverages cross-layer information exchange between the MAC and application layers to achieve fast convergence at the optimal allocation.We evaluate performance of the proposed scheme for streaming of high-definition (HD) and standard-definition (SD) video sequences over 802.11-based wireless networks, both in unicast and multicast scenarios. The scheme consistently outperforms conventional TCP-Friendly Rate Control (TFRC) in terms of overall video quality, and achieves more balanced qualities among the streams.     

Adaptive source rate control for real‐time wireless video transmission

Hybrid ARQ schemes can yield much better throughput and reliability than static FEC schemes for the transmission of data over time-varying wireless channels. However these schemes result in extra delay. They adapt to the varying channel conditions by retransmitting erroneous packets, this causes variable effective data rates for current PCS networks because the channel bandwidth is constant. Hybrid ARQ schemes are currently being proposed as the error control schemes for real-time video transmission. An important issue is how to ensure low delay while taking advantage of the high throughput and reliability that these schemes provide for. In this paper we propose an adaptive source rate control (ASRC) scheme which can work together with the hybrid ARQ error control schemes to achieve efficient transmission of real-time video with low delay and high reliability. The ASRC scheme adjusts the source rate based on the channel conditions, the transport buffer occupancy and the delay constraints. It achieves good video quality by dynamically changing both the number of the forced update (intracoded) macroblocks and the quantization scale used in a frame. The number of the forced update macroblocks used in a frame is first adjusted according to the allocated source rate. This reduces the fluctuation of the quantization scale with the change in the channel conditions during encoding so that the uniformity of the video quality is improved. The simulation results show that the proposed ASRC scheme performs very well for both slow fading and fast fading channels. This revised version was published online in July 2006 with corrections to the Cover Date.     

An improved equation based rate adaptation scheme for video streaming over UMTS

Streaming video has experienced phenomenal growth owing to the extensive research in video transmission over wireless networks. This paper describes an improved equation based rate adaptation (EBRA) scheme for video streaming over universal mobile telecommunications system (UMTS). In our method, transmission rate is determined as a function of packet size (s), round trip time (rtt), loss event rate (p) and two novel control parameters for congestion window adjustment (α and β). Our mechanism is compatible with unpredictable wireless channel conditions and provides smooth and flexible sending rate and slowly responsible congestion control by dynamic modification of mentioned parameters. We have simulated this method in UMTS and our results indicate that EBRA in addition to network stability increases throughput with low variations.     

Quality-of-service driven power and rate adaptation for multichannel communications over wireless links

We propose a quality-of-service (QoS) driven power and rate adaptation scheme for multichannel communications systems over wireless links. In particular, we use multichannel communications to model the conceptual architectures for either diversity or multiplexing systems, which play a fundamental role in physical-layer evolutions of mobile wireless networks. By integrating information theory with the concept of effective capacity, our proposed scheme aims at maximizing the multichannel-systems throughput subject to a given delay-QoS constraint. Under the framework of convex optimization, we develop the optimal adaptation algorithms. Our analyses show that when the QoS constraint becomes loose, the optimal power-control policy converges to the well-known water-filling scheme, where the Shannon (or ergodic) capacity can be achieved. On the other hand, when the QoS constraint gets stringent, the optimal policy converges to the scheme operating at a constant-rate (i.e., the zero-outage capacity), which, by using only a limited number of subchannels, approaches the Shannon capacity. This observation implies that the optimal effective capacity function decreases from the ergodic capacity to the zero-outage capacity as the QoS constraint becomes more stringent. Furthermore, unlike the single-channel communications, which have to trade off the throughput for QoS provisioning, the multichannel communications can achieve both high throughput and stringent QoS at the same.     

An integrated routing and rate adaptation framework for multi-rate multi-hop wireless networks

In this paper, we propose a new integrated framework for joint routing and rate adaptation in multi-rate multi-hop wireless networks. Unlike many previous efforts, our framework considers several factors that affect end-to-end performance. Among these factors, the framework takes into account the effect of the relative positions of the links on a path when choosing the rates of operation and the importance of avoiding congested areas. The key element of our framework is a new comprehensive path metric that we call ETM (for expected transmission cost in multi-rate wireless networks). We analytically derive the ETM metric. We show that the ETM metric can be used to determine the best end-to-end path with a greedy routing approach. We also show that the metric can be used to dynamically select the best transmission rate for each link on the path via a dynamic programming approach. We implement the ETM-framework on an indoor wireless mesh network and compare its performance with that of frameworks based on the popular ETT and the recently proposed ETOP metrics. Our experiments demonstrate that the ETM-framework can yield throughput improvements of up to 253 and 368 % as compared with the ETT and ETOP frameworks.     

End-to-end optimized TCP-friendly rate control for real-time video streaming over wireless multi-hop networks

Rate control is an important issue in video streaming applications. The most popular rate control scheme over wired networks is TCP-Friendly Rate Control (TFRC), which is designed to provide optimal transport service for unicast multimedia delivery based on the TCP Reno’s throughput equation. It assumes perfect link quality, treating network congestion as the only reason for packet losses. Therefore, when used in wireless environment, it suffers significant performance degradation because of packet losses arising from time-varying link quality. Most current research focuses on enhancing the TFRC protocol itself, ignoring the tightly coupled relation between the transport layer and other network layers. In this paper, we propose a new approach to address this problem, integrating TFRC with the application layer and the physical layer to form a holistic design for real-time video streaming over wireless multi-hop networks. The proposed approach can achieve the best user-perceived video quality by jointly optimizing system parameters residing in different network layers, including real-time video coding parameters at the application layer, packet sending rate at the transport layer, and modulation and coding scheme at the physical layer. The problem is formulated and solved as to find the optimal combination of parameters to minimize the end-to-end expected video distortion constrained by a given video playback delay, or to minimize the video playback delay constrained by a given end-to-end video distortion. Experimental results have validated 2–4 dB PSNR performance gain of the proposed approach in wireless multi-hop networks by using H.264/AVC and NS-2.     

Joint power control and rate adaptation in wireless sensor networks

Wireless sensor networks (WSNs) are energy-constrained, as a result, energy allocation and data transmission on sensor nodes are always considered together. However, current approaches ignore the multiple-hop nature of sensor networks, which results in the lack of modeling energy consumption in data relaying process. In this paper, we illustrate the importance of this issue and formulate the data sensing and transmission in WSNs as a network utility maximization (NUM) problem. A price-based distributed algorithm is proposed to solve this NUM problem, and it can stimulate the cooperation of power control and rate adaptation among the nodes along the data relaying path. Considering the time-varying wireless environment in WSNs, the stability of the proposed algorithm is studied by convergence analysis under stochastic perturbations. Numerical results show that the proposed algorithm converges to the optimal energy allocation and data transmission.     

Adaptive rate controlled,robust video communication over packet wireless networks

Video transmission over wireless packet networks is gaining importance due to the concept of universal personal communication. Further, it is considered an important step towards wireless multimedia. The challenge however is to achieve good video quality over mobile channels, where typically the channel conditions vary due to signal fading. Hence this paper investigates adaptive rate controlled video transmission for robust video communication under packet wireless environment. A combination of mobile and an ATM backbone network is assumed in this work. An error resilient design for the video coder, as proposed in Rajugopal et al. (1996) is employed here. This video coder comprises wavelet transform (WT), multi-resolution motion estimation (MRME) and a robust design for zero tree quantization. Two configurations, one employing MRME and the other using 1D-WT for temporal analysis, are considered for the video coder. Adaptive dynamic rate control is required to adapt the video communication to the channel conditions. It provides more channel protection when the channel is severe and improves the source rate and hence the performance when the conditions are favorable. An algorithm for dynamic rate control under varying channel conditions is proposed in this paper. It is evaluated under narrowband and broadband channel conditions. From the results, it is concluded that the dynamic rate control is very effective in optimizing the quality under varying mobile channel conditions. It was observed that the dynamic rate control provides at least an acceptable video quality under severe channel conditions and a good video quality when the channel conditions are favorable. This revised version was published online in July 2006 with corrections to the Cover Date.     

Rate control for streaming video over wireless

Rate control is an important issue in video streaming applications for both wired and wireless networks. A widely accepted rate control method in wired networks is TCP-friendly rate control (TFRC) (Floyd, 2000). It is equation-based rate control in which the TCP-friendly rate is determined as a function of packet loss rate, round-trip time, and packet size. TFRC assumes that packet loss in wired networks is primarily due to congestion, and as such is not applicable to wireless networks in which the main cause of packet loss is at the physical layer. In this article we review existing approaches to solve this problem. Then we propose multiple TFRC connections as an end-to-end rate control solution for wireless video streaming. We show that this approach not only avoids modifications to the network infrastructure or network protocol, but also results in full utilization of the wireless channel. NS-2 simulations, actual experiments over a 1/spl times/RTT CDMA wireless data network, and video streaming simulations using traces from the actual experiments are carried out to characterize the performance and show the efficiency of our proposed approach.     

Error resilience video transcoding for wireless communications

Video communication through wireless channels is still a challenging problem due to the limitations in bandwidth and the presence of channel errors. Since many video sources are originally coded at a high rate and without considering the different channel conditions that may be encountered later, a means to repurpose this content for delivery over a dynamic wireless channel is needed. Transcoding is typically used to reduce the rate and change the format of the originally encoded video source to match network conditions and terminal capabilities. Given the existence of channel errors that can easily corrupt video quality, there is also the need to make the bitstream more resilient to transmission errors. In this article we provide an overview of the error resilience tools found in today's video coding standards and describe a variety of techniques that may be used to achieve error-resilient video transcoding.     

Error-resilient transcoding for video over wireless channels

We describe a method to maintain quality for video transported over wireless channels. The method is built on three fundamental blocks. First, we use a transcoder that injects spatial and temporal resilience into an encoded bitstream. The amount of resilience is tailored to the content of the video and the prevailing error conditions, as characterized by bit error rate. Second, we derive analytical models that characterize how corruption propagates in a video that is compressed using motion-compensated encoding and subjected to bit errors. Third, we use rate distortion theory to compute the optimal allocation of bit rate among spatial resilience, temporal resilience, and source rate. Furthermore, we use the analytical models to generate the resilience rate distortion functions that are used to compute the optimal resilience. The transcoder then injects this optimal resilience into the bitstream. Simulation results show that using a transcoder to optimally adjust the resilience improves video quality in the presence of errors while maintaining the same input bit rate     

Dynamic rate adaptation based on multidimensional multicode DS-CDMA in cellular wireless networks

Dynamic rate adaptation for uplink data transmission in a cellular multidimensional multicode (MDMC) direct-sequence code-division multiple-access packet data network is modeled and analyzed. An analytical framework is developed to evaluate the performances of radio link level dynamic rate adaptation schemes under multipath fading and log-normal shadowing. The radio link level throughput under optimal dynamic rate adaptation (having exponential computational complexity) and different heuristic-based suboptimal rate adaptation schemes can be assessed under the presented analytical framework. The performance of MDMC signaling is compared with that of the single-code variable spreading factor (VSF) signaling. To this end, based on an equilibrium point analysis of the system in steady-state, a base station-assisted and mobile-controlled dynamic rate adaptation scheme is presented.     

Optimal quality adaptation for scalable encoded video

The dynamic behavior of the Internet's transmission resources makes it difficult to provide perceptually good quality streaming video. Scalable video encoding techniques have been proposed to deal with this problem. However, an encoded video generally exhibits significant data rate variability to provide consistent visual quality. We are, therefore, faced with the problem of accommodating the mismatch between the available bandwidth variability and the encoded video variability. We investigate quality adaptation algorithms for scalable encoded variable bit-rate video over the Internet. Our goal is to develop a quality adaptation scheme that maximizes perceptual video quality by minimizing quality variation, while at the same time increasing the usage of available bandwidth. We propose an optimal adaptation algorithm and a real-time adaptation algorithm based on whether the network conditions are known a priori. Experimental results show that the real-time adaptation as well as the optimal adaptation algorithm provide consistent video quality when used over both TCP-friendly rate control (TFRC) and transmission control protocol (TCP).     

Layered quality adaptation for Internet video streaming

Streaming audio and video applications are becoming increasingly popular on the Internet, and the lack of effective congestion control in such applications is now a cause for significant concern. The problem is one of adapting the compression without requiring video servers to reencode the data, and fitting the resulting stream into the rapidly varying available bandwidth. At the same time, rapid fluctuations in quality will be disturbing to the users and should be avoided. We present a mechanism for using layered video in the context of unicast congestion control. This quality adaptation mechanism adds and drops layers of the video stream to perform long-term coarse-grain adaptation, while using a TCP-friendly congestion control mechanism to react to congestion on very short timescales. The mismatches between the two timescales are absorbed using buffering at the receiver. We present an efficient scheme for the distribution of available bandwidth among the active layers. Our scheme allows the server to trade short-term improvement for long-term smoothing of quality. We discuss the issues involved in implementing and tuning such a mechanism, and present our simulation results