Video Streaming with Network Coding

Recent years have witnessed an explosive growth in multimedia streaming applications over the Internet. Notably, Content Delivery Networks (CDN) and Peer-to-Peer (P2P) networks have emerged as two effective paradigms for delivering multimedia contents over the Internet. One salient feature shared between these two networks is the inherent support for path diversity streaming where a receiver receives multiple streams simultaneously on different network paths as a result of having multiple senders. In this paper, we propose a network coding framework for efficient video streaming in CDNs and P2P networks in which, multiple servers/peers are employed to simultaneously stream a video to a single receiver. We show that network coding techniques can (a) eliminate the need for tight synchronization between the senders, (b) be integrated easily with TCP, and (c) reduce server’s storage in CDN settings. Importantly, we propose the Hierarchical Network Coding (HNC) technique to be used with scalable video bit stream to combat bandwidth fluctuation on the Internet. Simulations demonstrate that under certain scenarios, our proposed network coding techniques can result in bandwidth saving up to 60% over the traditional schemes.     

GAZELLE: An Enhanced Random Network Coding Based Framework for Efficient P2P Live Video Streaming Over Hybrid WMNs

Wireless Personal Communications - Although Peer-to-Peer live video streaming over wireless mesh networks (WMNs) is considered a promising technology, some important challenges such as...     

无线视频流编码与传输技术初探

针对无线信道的特性和多种无线终端并存的现实，探讨了在时变无线网络中向多种客户终端传送视频流的关键技术，介绍了分级视频编码和逐级加密技术的综合运用，并给出了一种新的无线视频流传输方案。     

非扩展性与可扩展性视频编码流式技术

介绍面向存储的非扩展性视频编码和面向传输的可扩展性视频编码及其网络传输技术，以及它们在网络上应用时各自存在的优点和缺点。     

非扩展性与可扩展性视频编码流式技术

介绍面向存储的非扩展性视频编码和面向传输的可扩展性视频编码及其网络传输技术 ,以及它们在网络上应用时各自存在的优点和缺点     

多视点视频编码的码率控制优化算法

Rate control is one of the key factors influencing the multi view video transmission. However, there is not a rate control algorithm in the existing Joint Multi view Video Coding Model. In this paper, an efficient rate control algorithm and a bit allocation strategy for multi view video coding are proposed. In order to obtain the consistent view quality, a bit allocation model based on the Lagrange optimum algorithm is firstly proposed. Secondly, considering the encoding statistical characteristics of different view types, a view weighting factor is introduced, and it will help improve the precision of bit allocation among views. Compared with the fixed QP control strategy, experiment results show that the proposed algorithm can efficiently control the bit rate and obtain more consistent views, with video visual quality improved.     

基于中继的OFDMA网络中可扩展编码视频流传输的权衡优化(英文)

To achieve an optimal trade-off between video quality and energy efficiency in the uplink streaming of multi-user Scalable Video Coding (SVC) videos in relay-based Orthogonal Frequency Division Multiple Access (OFDMA) cellular networks, a cross-layer design framework that jointly selects the Transmission Policy (TP) for SVC video frames, assigns OFDMA subcarriers, and allocates power for each subcarrier is proposed. We apply the dual decomposition method to the problem, and obtain a TP selection subproblem for each SVC video adaptation and a resource allocation subproblem of Joint Subcarrier, Relay and Power Allocation (JSRPA). A second level of dual decomposition is used to divide the JSRPA problem into independent subcarrier subproblems. The proposed Crosslayer Trade-off Optimization (CTO) algorithm is sub-distributed with significantly low complexity. A performance evaluation with typical SVC video traces demonstrates that the proposed algorithm is able to converge and efficiently achieve the optimal trade-off between the video quality and energy consumption at the MSs for uplink SVC streaming.     

Efficient Coding Unit and Prediction Unit Decision Algorithm for Multiview Video Coding

To aim at higher coding efficiency for multiview video coding, the multiview video with a modified high efficiency video coding (MV-HEVC) codec is proposed to encode the dependent views. However, the c...     

基于张量表示的域适配的迁移学习中特征表示方法

本文提出一种新的基于张量表示的域适配迁移学习中的特征表示方法,即融合联合域对齐和适配正则化的基于张量表示的迁移学习特征表示方法.当源域和目标域差异很大时,仅将源域对齐潜在共享空间,会造成数据扭曲过大.为缓解此问题,本文方法提出联合域对齐,即源域和目标域同时对齐共享子空间.并且本文方法将适配正则化引入张量表示空间求解.本文适配正则化包括动态分布对齐和图适配,以缩小域间分布差异和保留样本间流行一致性.最后融合联合域对齐,动态分布对齐和图适配,通过联合优化求解获得共享子空间表示.几个公共的跨域数据集上的大量实验结果表明了本文方法优于其它主流的迁移学习方法,验证了本文方法的有效性.     

A Novel Framework for Wireless Digital Communication Signals via a Tensor Perspective

Wireless Personal Communications - In this paper, we introduce a novel signal characteristic, which is ubiquitous in the vast majority of communication signals. That is, a modulated signal is of an...     

Interactive 3-D Video Representation and Coding Technologies

Interactivity in the sense of being able to explore and navigate audio-visual scenes by freely choosing viewpoint and viewing direction, is an important key feature of new and emerging audio-visual media. This paper gives an overview of suitable technology for such applications, with a focus on international standards, which are beneficial for consumers, service providers, and manufacturers. We first give a general classification and overview of interactive scene representation formats as commonly used in computer graphics literature. Then, we describe popular standard formats for interactive three-dimensional (3-D) scene representation and creation of virtual environments, the virtual reality modeling language (VRML), and the MPEG-4 BInary Format for Scenes (BIFS) with some examples. Recent extensions to MPEG-4 BIFS, the Animation Framework eXtension (AFX), providing advanced computer graphics tools, are explained and illustrated. New technologies mainly targeted at reconstruction, modeling, and representation of dynamic real world scenes are further studied. The user shall be able to navigate photorealistic scenes within certain restrictions, which can be roughly defined as 3-D video. Omnidirectional video is an extension of the planar two-dimensional (2-D) image plane to a spherical or cylindrical image plane. Any 2-D view in any direction can be rendered from this overall recording to give the user the impression of looking around. In interactive stereo two views, one for each eye, are synthesized to provide the user with an adequate depth cue of the observed scene. Head motion parallax viewing can be supported in a certain operating range if sufficient depth or disparity data are delivered with the video data. In free viewpoint video, a dynamic scene is captured by a number of cameras. The input data are transformed into a special data representation that enables interactive navigation through the dynamic scene environment.     

一种空间域Wyner-Ziv视频编码系统的性能改进算法

分布式视频编码是建立在Slepian-Wolf和Wyner-Ziv信息编码理论基础上的全新视频编码框架,具有编码复杂度低,编码效率较高,抗误码性能好的特点.本文首先简单介绍了一种典型的分布式视频编码实现方案——空间域Wyner-Ziv视频编码,随后提出一种空间域Wyner-Ziv视频编码系统的性能改进算法,该算法在不增加编码复杂度的基础上,在解码端利用双向运动估计预测获取更高质量的边信息,同时采用基于Huber-Markov随机场约束的联合迭代解码算法重建图像.实验结果表明,在相同的输出码流情况下,本文改进算法在解码端重建图像的峰值信噪比与空间域Wyner-Ziv视频编码算法相比平均提高2dB,并且主观效果有所改善.     

基于联合信源信道编码的视频流传输

介绍了目前在多媒体通信系统中提出的一个新思想一联合信源／信道编码方法，以及基于该方法的视频流传输技术。分析介绍了联合信源／信道编码方法的分类和不同于以往传统通信系统设计方法的特点及优越性。并且针对多媒体传输应用中的视频流传输方法，分类比较了几种典型的系统结构，描述了其优缺点。     

Efficient HTTP-based streaming using Scalable Video Coding

HTTP-based video streaming has been gaining popularity within the recent years. There are multiple benefits of relying on HTTP/TCP connections, such as the usage of the widely deployed network caches to relieve video servers from sending the same content to a high number of users and the avoidance of traversal issues with firewalls and NATs typical for RTP/UDP-based solutions. Therefore, many service providers resort to adopt HTTP streaming as the basis for their services. In this paper, the benefits of using the Scalable Video Coding (SVC) for a HTTP streaming service are shown, and the SVC based approach is compared to the AVC based approach. We show that network resources are more efficiently used and how the benefits of the traditional techniques can even be heightened by adopting the Scalable Video Coding (SVC) as the video codec for adaptive low delay streaming over HTTP. For the latter small playout-buffers are considered hence allowing low media access latency in the delivery chain and it is shown that adaptation is more effectively performed with the SVC based approach.     

A Novel End-to-End Architecture for H.264 Video Streaming over the Internet

In this paper we propose a novel end-to-end architecture for H.264 unicast video streaming over the Internet. The proposed video streaming architecture is based primarily on a new transport layer protocol, the stream control transmission protocol (SCTP). We show that the network-friendly specification of H.264, and the novel technical characteristics of SCTP, when coupled together are able to provide a highly adaptive and flexible system for unicast video streaming. More specifically, we develop algorithms that handle at the transport layer the following functions concerning video packet transmission: retransmission policy, packet prioritization, implicit receiver feedback. We combine the above algorithms with an R-D optimization strategy at the encoder, that provides more options when adapting to bandwidth variations. This combined optimization strategy leads to more options concerning the streaming parameters. Finally, with simulation results we prove that our system is capable of maintaining good perceptual quality and TCP-friendliness under various loss conditions. An early version of this paper appeared in CCNC 2004.     

针对移动视频流介于UMTS和WiMAX网络间的切换方案

下一代移动网络(NGMN)倾向于融合多个无线接入技术(RATs)来为用户提供无处不在的访问服务。而作为一个无处不在系统,能够有一个解决方案来支持日益流行的视频应用程序也是至关重要的。由于移动视频应用程序的高带宽要求和对延迟敏感的特点,如何让移动视频应用程序在不同的RATs之间进行无缝切换并保证服务质量(QoS)是我们面临的一个挑战。为了加快实现在异构网络中提供无缝视频流服务,通过运用IEEE 802.21规定的媒体独立信息服务的服务器提出了一种移动端发起-网络端控制的移动网络切换方案。仿真结果表明,该方案在丢包率、延迟和峰值信噪比等方面提高了性能。     

Overview of the MPEG Reconfigurable Video Coding Framework

Video coding technology in the last 20 years has evolved producing a variety of different and complex algorithms and coding standards. So far the specification of such standards, and of the algorithms that build them, has been done case by case providing monolithic textual and reference software specifications in different forms and programming languages. However, very little attention has been given to provide a specification formalism that explicitly presents common components between standards, and the incremental modifications of such monolithic standards. The MPEG Reconfigurable Video Coding (RVC) framework is a new ISO standard currently under its final stage of standardization, aiming at providing video codec specifications at the level of library components instead of monolithic algorithms. The new concept is to be able to specify a decoder of an existing standard or a completely new configuration that may better satisfy application-specific constraints by selecting standard components from a library of standard coding algorithms. The possibility of dynamic configuration and reconfiguration of codecs also requires new methodologies and new tools for describing the new bitstream syntaxes and the parsers of such new codecs. The RVC framework is based on the usage of a new actor/ dataflow oriented language called CAL for the specification of the standard library and instantiation of the RVC decoder model. This language has been specifically designed for modeling complex signal processing systems. CAL dataflow models expose the intrinsic concurrency of the algorithms by employing the notions of actor programming and dataflow. The paper gives an overview of the concepts and technologies building the standard RVC framework and the non standard tools supporting the RVC model from the instantiation and simulation of the CAL model to software and/or hardware code synthesis.     

A Novel R-D Optimized MB-level Rate Control Scheme for Real-Time Video Coding

Rate control has a critical influence on the video encoder design, and MB-level rate control is more flexible to control the spatial coding performance. However, most existing MB-level rate control methods are not designed for hardware implementation, and are too complex for practical use in real-time video coding. In this paper, a simple and effective MB-level rate control scheme is proposed that uses historical rate information to directly assign a QP value to a class of MBs. This paper will also introduce a method to realize the idea and make the pipeline data dependency applicable in circuit design. Experiments show that the proposed classification-based MB-level rate control algorithm can achieve a coding gain up to 0.6 dB and an averaging gain of 0.18 dB.     

一种基于变换域Wyner-Ziv视频编码的有效重建算法

为了减少分布式视频编码系统解码后重建值与真实值之间误差,提出了基于变换域Wyner-Ziv视频编码最小均方误差(MMSE)重建的一种新的有效重建算法。该算法充分利用视频帧间相关性,对MMSE重建算法积分区间做出调整,当边信处于解码值对应量化区间之内时,在量化区间内利用MMSE重建;当边信息处于解码值对应量化区间之外时,对量化区间做出调整,在改进后的区间利用MMSE重建。实验结果表明,与最佳重建最小均方误差重建算法相比,该算法可以有效提高解码视频的平均PSNR。     

Efficient Stereoscopic Video Coding Using Joint Disparity-Motion Estimation

The goal of this paper is to determine dense disparity and motion fields jointly and efficiently, given a sequence of stereoscopic images. At each time instant, the motion field of left sequences is estimated by using the current disparity field, the next disparity field, and the motion field of right sequences. The improved concepts for the proposed joint estimation are based on an edge-preserving regularization, an ambiguous vector region detection, and a median filtering for block-based vector generation. The reported approach is verified by processing a set of stereo sequences. Results are given with real stereoscopic data.