Optimized video streaming over 802.11 by cross-layer signaling

Seamless video streaming over wireless links imposes strong demands on video codecs and the underlying network. It is not sufficient that only the video codec or only the radio adapts to changes in the wireless link quality; efforts should be applied in both layers, and - if possible - synchronized. Also, the disturbing effect of possible background traffic over the same shared medium has to be taken into account. In this article we present a communication architecture for video streaming over 802.11 that is capable of adapting to changes in the link quality and sharing of the wireless channel in various use scenarios. Experimental results show that substantial improvements in the quality of the video can be obtained by applying link adaptation and cross-layer signaling techniques.     

Combining the rate adaptation and quality adaptation schemes for wireless video streaming

Video streaming service over wireless networks is a challenging task because of the changes in the wireless channel conditions that can occur due to interference, fading, and station mobility. Moreover, the IEEE 802.11 WLAN standard does not contain any specifications for the rate adaptation scheme which are useful for improving the wireless link utilization. To provide efficient wireless video streaming service, the rate adaptation scheme should be applied at the low layer and the quality adaptation scheme should be considered at the high layer. To meet this requirement of wireless video streaming, we propose a new cross-layer design for video streaming over wireless networks. This design includes the rate adaptation scheme in the data link and physical layers and the quality adaptation scheme in the application layer. The rate adaptation scheme adjusts the data transmission rate based on the measured RSSI at the sender-side and informs the quality adaptation scheme about the rate limits. Then the quality adaptation scheme utilizes this rate limits to adjust the quality of the video stream. Through performance evaluations, we prove that our cross-layer design improves the wireless link utilization and the quality of the video stream simultaneously.     

Per-packet rate adaptation for wireless video

Streaming video over error-prone wireless channels is a challenge as the dynamic network conditions and slow adaptation to channel degradations may affect the quality of the streamed video. Unequal error protection (UEP) can potentially address this issue by considering the importance of each video packet and its impact on the quality of reconstructed video. This paper proposes a cross-layer UEP solution for wireless video streaming over IEEE 802.11 networks. Video packets are prioritized based on the relative importance of the video packet. UEP is achieved by adapting the link layer parameters on a per-packet basis, using inherent forward error correction and adaptive modulation capabilities of the 802.11n network. Experimental results revealed that the proposed solution achieves comparable performance to the state-of-the-art methods at a lower complexity.     

Cross-Layer Optimized Video Streaming Over Wireless Multihop Mesh Networks

The proliferation of wireless multihop communication infrastructures in office or residential environments depends on their ability to support a variety of emerging applications requiring real-time video transmission between stations located across the network. We propose an integrated cross-layer optimization algorithm aimed at maximizing the decoded video quality of delay-constrained streaming in a multihop wireless mesh network that supports quality-of-service. The key principle of our algorithm lays in the synergistic optimization of different control parameters at each node of the multihop network, across the protocol layers-application, network, medium access control, and physical layers, as well as end-to-end, across the various nodes. To drive this optimization, we assume an overlay network infrastructure, which is able to convey information on the conditions of each link. Various scenarios that perform the integrated optimization using different levels ("horizons") of information about the network status are examined. The differences between several optimization scenarios in terms of decoded video quality and required streaming complexity are quantified. Our results demonstrate the merits and the need for cross-layer optimization in order to provide an efficient solution for real-time video transmission using existing protocols and infrastructures. In addition, they provide important insights for future protocol and system design targeted at enhanced video streaming support across wireless mesh networks     

A unified framework for distributed video rate allocation over wireless networks

When multiple video streams share a wireless network, careful rate allocation is needed to prevent congestion, as well as to balance the video qualities among the competing streams. In this paper, we present a unified optimization framework for video rate allocation over wireless networks. Our framework applies to both unicast and multicast sessions, and accommodates both scalable and non-scalable streams. The optimization objective is to minimize the total distortion of all video streams without incurring excessive network utilization. Our system model explicitly accounts for heterogeneity in wireless link capacities, traffic contention among neighboring links, as well as different video rate-distortion (RD) characteristics. The proposed distributed media-aware rate allocation scheme leverages cross-layer information exchange between the MAC and application layers to achieve fast convergence at the optimal allocation.We evaluate performance of the proposed scheme for streaming of high-definition (HD) and standard-definition (SD) video sequences over 802.11-based wireless networks, both in unicast and multicast scenarios. The scheme consistently outperforms conventional TCP-Friendly Rate Control (TFRC) in terms of overall video quality, and achieves more balanced qualities among the streams.     

3D visual experience oriented cross-layer optimized scalable texture plus depth based 3D video streaming over wireless networks

3D video streaming over the mobile Internet generally incurs the inferior 3D visual experience due to the time-varying characteristics of wireless channel. The conventional video streaming optimization methods generally neglect the harmony among different networking protocol layers. This paper proposes a cross-layer optimized texture plus depth based scalable 3D video streaming method to improve the expected 3D visual experience of the user by systematically considering the application layer texture-video/depth/FEC bit-rate allocation, MAC layer multi-channel allocation, and physical layer modulation and channel coding scheme (MCS) selection. In the cross-layer optimization, a networking-related 3D visual experience model which fuses the overlapped retinal view visual quality and depth sensation with mimicking human vision system is established to predict the 3D visual experience under the specific parameter configurations of different protocol layers. The efficiency and effectiveness of the proposed cross-layer optimized 3D video streaming method has been validated by subjective and objective experimental results.     

End-to-end optimized TCP-friendly rate control for real-time video streaming over wireless multi-hop networks

Rate control is an important issue in video streaming applications. The most popular rate control scheme over wired networks is TCP-Friendly Rate Control (TFRC), which is designed to provide optimal transport service for unicast multimedia delivery based on the TCP Reno’s throughput equation. It assumes perfect link quality, treating network congestion as the only reason for packet losses. Therefore, when used in wireless environment, it suffers significant performance degradation because of packet losses arising from time-varying link quality. Most current research focuses on enhancing the TFRC protocol itself, ignoring the tightly coupled relation between the transport layer and other network layers. In this paper, we propose a new approach to address this problem, integrating TFRC with the application layer and the physical layer to form a holistic design for real-time video streaming over wireless multi-hop networks. The proposed approach can achieve the best user-perceived video quality by jointly optimizing system parameters residing in different network layers, including real-time video coding parameters at the application layer, packet sending rate at the transport layer, and modulation and coding scheme at the physical layer. The problem is formulated and solved as to find the optimal combination of parameters to minimize the end-to-end expected video distortion constrained by a given video playback delay, or to minimize the video playback delay constrained by a given end-to-end video distortion. Experimental results have validated 2–4 dB PSNR performance gain of the proposed approach in wireless multi-hop networks by using H.264/AVC and NS-2.     

SSIM-based error-resilient cross-layer optimization for wireless video streaming

The traditional Sum of Squared Error (SSE)-based cross-layer optimization has been shown to be an effective way to improve the quality of service for wireless video streaming. However, recent research works show that the SSE-based optimization metric does not always provide the video distortion measurement that matches well with the video quality degradation observed by the human vision system. Taking advantage of the Structural SIMilarity (SSIM) metric in measuring the video perceptual quality, a SSIM-based error-resilient cross-layer optimization scheme is proposed to improve the perceptual quality for the real-time wireless video streaming in this paper. Besides the video data rate adjustment and the link adaption including the Modulation and Coding Scheme (MCS) selection, the error-resilient Rate-Distortion Optimization (RDO) for each encoding unit is introduced into the cross-layer optimization process to ensure that the video data are transmitted efficiently and reliably over the time-varying wireless channel. In addition, to ensure that cross-layer optimization scheme is more practical, a low-complexity optimal parameter selection algorithm that exploits the MCS-SNR relationship and the Rate-Quantization (R-Q) model is proposed. Experimental results show that significant performance improvements in terms of the perceptual video quality and the computational complexity are achieved for the proposed cross-layer optimization scheme.     

Cross-layer optimized authentication and error control for wireless 3D medical video streaming over LTE

3D video for tele-medicine applications is gradually gaining momentum since the 3D technology can provide precise location information. However, the weak link for 3D video streaming is the necessary wireless link of the communication system. Neglecting the wireless impairments can severely degrade the performance of 3D video streaming that communicates complex critical medical data. In this paper, we propose systematic methodology for ensuring high performance of the 3D medical video streaming system. First, we present a recursive end-to-end distortion estimation approach for MVC (multiview video coding)-based 3D video streaming over error-prone networks by considering the 3D inter-view prediction. Then, based on the previous model, we develop a cross-layer optimization scheme that considers the LTE wireless physical layer (PHY). In this optimization, the authentication requirements of 3D medical video are also taken into account. The proposed cross-layer optimization approach jointly controls and manages the authentication, video coding quantization of 3D video, and the modulation and channel coding scheme (MCS) of the LTE wireless PHY to minimize the end-to-end video distortion. Experimental results show that the proposed approach can provide superior 3D medical video streaming performance in terms of peak signal-to-noise ratio (PSNR) when compared to state-of-the-art approaches that include joint source-channel optimized streaming with multi-path hash-chaining based-authentication, and also conventional video streaming with single path hash-chaining-based authentication.     

H.264/AVC video for wireless transmission

H.264/AVC will be an essential component in emerging wireless video applications thanks to its excellent compression efficiency and network-friendly design. However, a video coding standard itself is only one component within the application and transmission environment. Its effectiveness strongly depends on the selection of appropriate modes and parameters at the encoder, at the decoder, as well as in the network. In this paper we introduce the features of the H.264/AVC coding standard that make it suitable for wireless video applications, including features for error resilience, bit rate adaptation, integration into packet networks, interoperability, and buffering considerations. Modern wireless networks provide many different means to adapt quality of service, such as forward error correction methods on different layers and end-to-end or link layer retransmission protocols. The applicability of all these encoding and network features depends on application constraints, such as the maximum tolerable delay, the possibility of online encoding, and the availability of feedback and cross-layer information. We discuss the use of different coding and transport related features for different applications, namely video telephony, video conferencing, video streaming, download-and-play, and video broadcasting. Guidelines for the selection of appropriate video coding tools, video encoder and decoder settings, as well as transport and network parameters are provided and justified. References to relevant research publications and standardization contributions are given.     

Distortion-Driven Video Streaming over Multihop Wireless Networks with Path Diversity

Multihop networks provide a flexible infrastructure that is based on a mixture of existing access points and stations interconnected via wireless links. These networks present some unique challenges for video streaming applications due to the inherent infrastructure unreliability. In this paper, we address the problem of robust video streaming in multihop networks by relying on delay- constrained and distortion-aware scheduling, path diversity, and retransmission of important video packets over multiple links to maximize the received video quality at the destination node. To provide an analytical study of this streaming problem, we focus on an elementary multihop network topology that enables path diversity, which we term "elementary cell." Our analysis is considering several cross-layer parameters at the physical and medium access control (MAC) layers, as well as application-layer parameters such as the expected distortion reduction of each video packet and the packet scheduling via an overlay network infrastructure. In addition, we study the optimal deployment of path diversity in order to cope with link failures. The analysis is validated in each case by simulation results with the elementary cell topology, as well as with a larger multihop network topology. Based on the derived results, we are able to establish the benefits of using path diversity in video streaming over multihop networks, as well as to identify the cases where path diversity does not lead to performance improvements.     

Cross-Layer Radio Resource Allocation for Multicarrier Air Interfaces in Multicell Multiuser Environments

Packet scheduling over shared channels is one of the most attractive issues for researchers dealing with radio resource allocation in wireless networks as modern systems' different traffic types, with different application requirements, need to coexist over the air interface. Recently, attention has been attracted to multicarrier techniques and the application of cross-layer approaches to the design of wireless systems. In this paper, a radio access network using a multicarrier air interface is considered in a multicell multiuser context. We propose a new cross-layer scheduling algorithm that manages channel, physical layer, and application-related information; we compare its performance with a previously published cross-layer strategy and with simpler well-known channel-aware or channel-unaware techniques and then discuss its optimization. We investigate the performance in terms of perceived user quality and fairness in the presence of mixed realistic traffic composed of H.264 video streaming with tight bounds on the delay jitter and file transfer protocol (FTP) data. To support video traffic, application-suited buffer-management techniques are also considered in conjunction with scheduling, and link adaptation is implemented at the physical layer to better exploit channel fluctuations. The role of scheduling and resource-allocation functionalities are discussed. It is shown that the cross-layer strategy proposed guarantees the same performance obtained by the previously published algorithm while reducing complexity. Moreover, under heavily loaded conditions, the cross-layer scheduling strategy provides a significant gain with respect to simple channel-aware or channel-unaware techniques.     

Application-driven cross-layer optimization for video streaming over wireless networks

Mobile multimedia applications require networks that optimally allocate resources and adapt to dynamically changing environments. Cross-layer design (CLD) is a new paradigm that addresses this challenge by optimizing communication network architectures across traditional layer boundaries. In this article we discuss the relevant technical challenges of CLD and focus on application-driven CLD for video streaming over wireless networks. We propose a cross-layer optimization strategy that jointly optimizes the application layer, data link layer, and physical layer of the protocol stack using an application-oriented objective function in order to maximize user satisfaction. In our experiments we demonstrate the performance gain achievable with this approach. We also explore the trade-off between performance gain and additional computation and communication cost introduced by cross-layer optimization. Finally, we outline future research challenges in CLD.     

Design and Evaluation of Multichannel Multirate Wireless Networks

In a multirate wireless network, low data rate nodes consume proportionately more channel resources than high data rate nodes, resulting in low overall network performance. The use of multiple non-overlapping frequency channels in multirate wireless networks can overcome the performance degradation by having nodes communicate on different channels based on their data rates. However, no effort has been invested to utilize the multiple channels for a multirate wireless network. In this paper, we introduce the Data Rate Adaptive Channel Assignment (DR-CA) algorithm for a multichannel multirate single-hop wireless network to provide higher network throughput and network efficiency. The main idea is to assign links having same or comparable data rates on the same channel to minimize the wastage of channel resources due to interference between high data links and low data rate links. We also design a new Intermediary Multichannel Layer (IML) which resides between network layer and link layer, at which we implement the DR-CA algorithm. The IML design requires no modifications to the underlying MAC layer and upper layers of the network stack. To evaluate the proposed algorithm we define new performance metrics—channel efficiency and network efficiency for a multichannel multirate wireless network. Using OPNET simulations, we show that the multichannel enhancement using our proposed algorithm provides significant performance improvement in terms of network throughput, channel efficiency, and network efficiency over existing approaches in multirate wireless networks. Under heavy load condition, the network efficiency using DR-CA algorithm reaches 90% of the maximum limit. To the best of our knowledge, this is the first work to utilize the benefits of multiple channels in the multirate wireless network environment.     

An adaptive cross-layer mapping algorithm for MPEG-4 video transmission over IEEE 802.11e WLAN

This paper proposes an adaptive cross-layer mapping algorithm to improve the transmission quality of MPEG-4 video stream over an IEEE 802.11e wireless network. Instead of classifying video data to a specific access category in an 802.11e network, we propose an algorithm that dynamically maps MPEG-4 video packets to appropriate access categories according to both the significance of the video data and the network traffic load. Our proposed cross-layer architecture passes information about the significance of video packets from the application layer to the media access control layer. The queue length of a specific access category is used to deduce the network traffic load. We conducted a performance evaluation of our proposed cross-layer approach under both light and heavily loaded network conditions. Our simulation results demonstrate: (a) superior performance of our proposed approach (under both light and heavy loads) over 802.11e (Enhanced Distributed Channel Access (EDCA) and static mapping schemes, (b) not only guarantees prioritized transmission of essential video data but also provides efficient queue length utilization.     

Adaptive cross-layer protection strategies for robust scalable video transmission over 802.11 WLANs

Robust streaming of video over 802.11 wireless local area networks poses many challenges, including coping with bandwidth variations, data losses, and heterogeneity of the receivers. Currently, each network layer (including physical layer, media access control (MAC), transport, and application layers) provides a separate solution to these challenges by providing its own optimized adaptation and protection mechanisms. However, this layered strategy does not always result in an optimal overall performance for the transmission of video. Moreover, certain protection strategies can be implemented simultaneously in several layers and, hence, the optimal choices from the application and complexity perspective need to be identified. In this paper, we evaluate different error control and adaptation mechanisms available in the different layers for robust transmission of video, namely MAC retransmission strategy, application-layer forward error correction, bandwidth-adaptive compression using scalable coding, and adaptive packetization strategies. Subsequently, we propose a novel adaptive cross-layer protection strategy for enhancing the robustness and efficiency of scalable video transmission by performing tradeoffs between throughput, reliability, and delay depending on the channel conditions and application requirements. The results obtained using the proposed adaptive cross-layer protection strategies show a significantly improved visual performance for the transmitted video over a variety of channel conditions.     

Cross-layer design of ad hoc networks for real-time video streaming

Cross-layer design breaks away from traditional network design where each layer of the protocol stack operates independently. We explore the potential synergies of exchanging information between different layers to support real-time video streaming. In this new approach information is exchanged between different layers of the protocol stack, and end-to-end performance is optimized by adapting to this information at each protocol layer. We discuss key parameters used in the cross-layer information exchange along with the associated cross-layer adaptation. Substantial performance gains through this cross-layer design are demonstrated for video streaming.     

Downlink media streaming with wireless fountain coding in wireline‐cum‐WiFi networks

This paper addresses the problem of streaming packetized media data in a combined wireline/802.11 network. Since the wireless channel is normally the bottleneck for media streaming in such a network, we propose that wireless fountain coding (WFC) be used over the wireless downlink in order to efficiently utilize the wireless bandwidth and exploit the broadcast nature of the channel. Forward error correction (FEC) is also used to combat errors at the application‐layer. We analytically obtain the moment generating function (MGF) for the wireless link‐layer delay incurred by WFC. With the MGF, the expected value of this wireless link‐layer delay is found and used by the access point (AP), who has no knowledge of the buffer contents of wireless receivers, to make a coding‐based decision. We then derive the end‐to‐end packet loss/late probability based on the MGF. We develop an integrated ns‐3/EvalVid simulator to evaluate our proposed system and compare it with the traditional 802.11e scheme which is without WFC capability but equipped with application‐ and link‐layer retransmission mechanisms. Through extensive simulations of video streaming, we show that streaming with WFC is able to support more concurrent video flows compared to the traditional scheme. When the deadlines imposed on video packets are relatively stringent, streaming with WFC also shows superior performance in terms of packet loss/late probability, video distortion, and video frame delay, over the traditional scheme. Copyright © 2011 John Wiley & Sons, Ltd.     

A cross-layer framework for multi-layer-video multicast with QoS requirements in multirate wireless networks

We propose a cross-layer framework for efficient multi-layer-video multicast with rate adaptation and quality-of-service (QoS) requirements in multirate wireless networks. We employ time division multiple access at the physical layer to transmit different video layers' data. The multicast sender then dynamically regulates the transmission rate and time-slot allocation based on the channel state information (CSI) and loss QoS requirements imposed by upper protocol layers. Under our proposed cross-layer framework, we first design a rate adaptation algorithm to fulfill the diverse loss QoS requirements for all video layers while achieving high multicast throughput. We then develop a time-slot allocation scheme which synchronizes data transmission across different video layers. Also conducted are simulation results to validate and evaluate our designed adaptive multicasting schemes under the proposed cross-layer framework.     

A cross-layer approach for real-time multimedia streaming on wireless peer-to-peer ad hoc network

Peer-to-peer (P2P) live streaming over mobile ad hoc network (MANET) is a state-of-the-art technique for wireless multimedia applications, such as entertainments and disaster recovery. The peers share the live streaming over MANET via multi-hop wireless link, so an efficient data delivery scheme must be required. However, the high churn rate and the frequent mobility baffle the P2P membership management and overlay maintenance. The unreliable wireless connection of MANET leads to the difficulties of large-scale and real-time streaming distribution, and a lack of overlay proximity leads to the inefficient streaming delivery. We present a cross-layer design for P2P over MANET to manage and maintain the overlay, and select efficient routing path to multicast media streams. Our proposed scheme (COME-P2P) integrates both P2P DHT-based lookup and IPv6 routing header to improve the delivery efficiency. Through the cross-layer design, the low layer detects mobility for informing high layer to refine the finger table, and high layer maintains the efficient multicast path for informing low layer to refine the routing table. How to keep stable routing paths for live streaming via IPv6 routing is the main contribution of this paper. The overlay proximity can shorten routing propagation delay, and the hop-by-hop routing can avoid the traffic bottleneck. Through the mathematical analysis and simulation results, COME-P2P can be demonstrated to achieve high smoothness and reduce signaling overhead for live streaming.