Proxy-assisted periodic broadcast for video streaming with multiple servers

Large scale video streaming over the Internet requires a large amount of resources such as server I/O bandwidth and network bandwidth. A number of video delivery techniques can be used to lower these requirements. Periodic broadcast by a central server combined with proxy caching offers a significant reduction of the aggregate network and server I/O bandwidth usage. However, the resources available to a single server are still limited. In this paper we propose a system with multiple geographically distributed servers. The problem of multiple servers for periodic broadcast is quite different from the problem of object location for multiple web servers. Multiple servers offer increased amount of resources and service availability and may potentially allow a further reduction of network bandwidth usage. On the other hand, the benefit of periodic broadcast mostly comes from high demand videos. With multiple servers holding a video, the demand of the video at each server is reduced. Therefore, it is a challenge to use multiple servers efficiently. We first analyze the dependence of the resource requirements on the number and locations of the servers. Based on the character of the function describing such a dependence, we formulate and solve the problem of video location and delivery, in a way that minimizes resource usage. We explore a trade-off between network and I/O bandwidth requirements. We evaluate our proposed solutions through a number of tests.

基于Web的远程视频监控系统的设计

本文给出了一种采用B/S模式的嵌入式视频监控系统,能够实现web方式的远程监控。通过构建嵌入式流媒体服务器实现视频的处理和传输;然后搭建嵌入式Web服务器,实现基于Web方式的远程视频监控。本设计有很强的实时性,交互性较好,方便管理和控制。     

Quality adaptive end-to-end packet scheduling to avoid playout interruptions in Internet video streaming systems

In Internet multimedia streaming, the quality of the delivered media can be adapted to the Quality of Service provided by the underlying network, thanks to encoding algorithms. These allow a fine grained enhancement of a low quality base layer at streaming time. The main objective that should be satisfied in such systems is to avoid the starvation of the decoding process and consequent playout interruptions. In this work, we tackle the problem using a control theoretic approach. In particular, we design and implement the novel end-to-end Quality Adaptive Scheduler for properly distributing the network available bandwidth among base and enhancement layers. The developed solution can be adopted in many contexts given that it has been designed without assumptions on the delivered media nor on the protocol stack. Anyway, to test its effectiveness, we have casted it in a H.264/AVC SVC based video streaming architecture for unicast Internet applications. The performance of the scheduler has been experimentally evaluated in both a controlled testbed and several “wild” Internet scenarios, including also UMTS and satellite radio links. Results have clearly demonstrated that our Quality Adaptive Scheduler is able to significantly improve the performance of the video streaming system in all operative conditions.     

Practical design of a proxy agent to facilitate adaptive video streaming service across wired/wireless networks

Thanks to the growing of the wireless networks, the video streaming application becomes a ubiquitous joyful service. In a wireless communication network environment, the service traffic spans across the wired and wireless domains. In this article, we propose a practical design of a proxy agent - SPONGE (Stream Pooler Over a Network Graded Environment) sitting between the wireless User Equipments (UEs) and the video streaming server to facilitate the adaptive video streaming service across wired/wireless networks. To make the wireless streaming service more efficient, an input video session would be encoded as multiple qualities of video streams so that UEs with a similar receiving condition can share streams with the same service quality via SPONGE. SPONGE can alleviate the direct load on the original stream broadcasting server. Meanwhile, it can make each UE get an adaptive streaming service according to the network conditions of the UE by a reduced network condition feedback latency. Our theoretical analysis and simulation results show that SPONGE can help wireless streaming users get a smooth and better playback quality by a quick and accurate reaction to the network condition.     

OCS: An effective caching scheme for video streaming on overlay networks

Video streaming is vital for many important applications such as distance learning, digital video libraries, and movie-on-demand. Since video streaming requires significant server and networking resources, caching has been used to reduce the demand on these resources. In this paper, we propose a novel collaboration scheme for video caching on overlay networks, called Overlay Caching Scheme (OCS), to further minimize service delays and loads placed on an overlay network for video streaming applications. OCS is not a centralized nor a hierarchical collaborative scheme. Despite its design simplicity, OCS effectively uses an aggregate storage space and capability of distributed overlay nodes to cache popular videos and serve nearby clients. Moreover, OCS is light-weight and adaptive to clients’ locations and request patterns. We also investigate other video caching techniques for overlay networks including both collaborative and non-collaborative ones. Compared with these techniques on topologies inspired from actual networks, OCS offers extremely low average service delays and approximately half the server load. OCS also offers smaller network load in most cases in our study.

新颖的实时视频流传输模式

视频传输需要消耗大量的带宽和占用服务器的大量计算资源,为了解决同时传输的视频流数目受到限制的问题,提出了一种新颖的视频流传输框架,多个网络视频服务器组成一个组来共同为多个视频流用户提供服务.在此框架下,研究了一个新的问题——最大化视频流,目标是最大化同时传输的视频流数量.设计了一个启发式的高效算法,与传统的几种视频流传输模式相比,该方法可以支持更多的视频流.     

Optimized scalable cache management for video streaming system

An important research issue in video streaming is how to efficiently utilize the network resources to provide clients instant access to multiple video objects. Caching strategy and transmission scheme are the two essential points inside the video streaming framework. Recent research efforts on them are not sufficient due to their inflexible support for scalable encoded video streams and heterogeneous requests from clients. In this paper, we propose an optimized caching strategy (OCS) and a scalable transmission scheme (STS) for scalable coded video streaming. By exploring the characteristics of video streaming workload and system design objectives, OCS and STS work efficiently to minimize both network bandwidth cost and user access latency. Firstly, we analyze the caching problem for the proxy-assisted video streaming system and derive a maneuverable caching scenario. Secondly, we develop an efficient transmission scheme for scalable coded videos. Thirdly, we formulate a multi-objective optimization model with closed-form expressions to obtain the optimized caching strategy. Finally, with designed algorithms, an excellent compromise between two competing objectives (minimizing the bandwidth cost and the access latency) is achieved. We start our evaluation by studying the optimized caching strategy for a single video object. Then we apply the strategy to multiple video objects and illustrate the tradeoff between the optimization objectives. Our evaluation results show that compared with other caching strategies, the proposed optimized scalable caching strategy can achieve a significant reduction in bandwidth cost with even a small proxy cache size. Meanwhile, the best performance (in terms of bandwidth cost) is obtained together with the proposed scalable batch-patching transmission scheme.

An experimental analysis of digital video library servers

Much work on video servers has concentrated on movies on demand, in which a relatively small number of titles are viewed and users are given basic VCR-style controls. This paper concentrates on analyzing video server performance for non-linear access applications. In particular, we study two non-linear video applications: video libraries, in which users select from a large collection of videos and may be interested in viewing only a small part of the title; and video walk-throughs, in which users can move through an image-mapped representation of a space. We present a characterization of the workloads of these applications. Our simulation studies show that video server architectures developed for movies on demand can be adapted to video library usage, though caching is less effective and the server can support a smaller user population for non-linear video applications. We also show that video walk-throughs require extremely large amounts of RAM buffering to provide adequate performance for even a small number of users.     

一种新的直播服务器实现框架

提出了一种新颖的直播服务器构架,在服务器中采用轮询式处理模式,并以RTP、RTSP和UDP协议为基础构造协议栈。在此基础上从两个方面考虑提高直播服务器的性能：在服务器中应用简单的平滑策略以平滑数据的发送过程,增加直播服务器的并发数;以音频数据的发送时间为基准进行媒体数据的发送,以增加服务器对视频流帧率波动的适应性。所提出的直播服务器实现框架和提高服务器性能的措施对于开发直播服务器的实践活动具有参考意义。     

Predictive buffer control in delivering remotely stored video using proxy servers

We study the problem of using proxy servers to stream video stored at a geographically separate location. The separation of the server and the storage introduces a non-negligible delay in retrieving video frames in real time. We assume an additive-increase/multiplicative-decrease transport protocol to support the streaming process and develop an effective scheme to achieve consistent, high streaming quality. The heart of the scheme is the control of buffer occupancy at the proxy server. We model the buffer as a bilinear dynamical system disturbed by a point process with stochastic state-dependent intensity. We first develop a buffer controller that does not exploit this model. Then, using the buffer model, we construct a second controller based on an optimal-control analysis for the case without retrieval delay. Extending these two controllers, we subsequently synthesize two controllers based on prediction of future system states using the model, taking into account both the delay and the state-dependent disturbance intensity. Our empirical study illustrates the effectiveness of the streaming scheme. We further find that the controllers exploiting the buffer model demonstrate performance significantly superior to that of the model-free controller in overcoming the adverse impact of the retrieval delay. We also conduct limited experiments to study the impact of variable retrieval delays.     

视频流自适应传输技术研究

对当前视频流技术所采取的各种压缩算法及标准、传输协议、拥塞控制等技术进行了总结与分析,在此基础上对IP网络上的视频流自适应传输技术进行了研究,建立了实现该技术的框架。此技术框架综合了实时的视频自适应编码技术和有效的带宽自适应传输技术。实验结果表明,在对视频流的实时性要求高的应用上具有较突出的优势。     

Parallel video streaming optimizing network throughput

In the Internet, video streaming services, in which users can enjoy videos at home, are becoming popular. Video streaming with high definition TV (HDTV) or ultra high definition video (UHDV) quality will be also provided and widely demanded in the future. However, the transmission bit-rate of high-quality video streaming is quite large, so generated traffic flows will cause link congestion. In the Internet, routes that packets take are determined using static link weights, so the network productivity, i.e., the maximum achievable throughout by the network, is determined by the capacity of a bottleneck link with the maximum utilization, although utilizations of many links remain low level. Therefore, when providing streaming services of rich content, i.e., videos with HDTV or UHDV quality, it is important to flatten the link utilization, i.e., reduce the maximum link utilization. We propose that ISPs use multiple servers to deliver rich content to balance the link utilization and propose server allocation and server selection methods for parallel delivery. We evaluate the effect of parallel delivery using 23 actual commercial ISP networks.     

A systematic rate controller for MPEG-4 FGS video streaming

This paper proposes a systematic rate controller (SRC) for content-aware streaming of MPEG-4 FGS video over the Internet. An active layer dropping technique is proposed to provide both coarse-grain and fine-granularity scalability of smooth quality adaptation to bandwidth fluctuations and bit-rate variations of streamed video over a general time-scale. The smooth quality adaptation is realized through the mode and state transition of a state machine that implements the SRC. The SRC effectively uses available bandwidth and client buffer by forward-shifting the FGS video stream. It provides protection to video segments with important content by introducing a content-aware priority-based layer model for the MPEG-4 FGS video stream. RID="*" ID="*" The work reported in this paper was performed when this author was working at Microsoft Research Asia as a research intern.     

Adaptive interface selection over cloud-based split-layer video streaming via multi-wireless networks

As mobile devices such as tablet PCs and smartphones proliferate, the online video consumption over a wireless network has been accelerated. From this phenomenon, there are several challenges to provide the video streaming service more efficiently and stably in the heterogeneous mobile environment. In order to guarantee the QoS of real-time HD video services, the steady and reliable wireless mesh is necessary. Furthermore, the video service providers have to maintain the QoS by provisioning streaming servers to respond the clients’ request of different video resolution. In this paper, we propose a reliable cloud-based video delivery scheme with the split-layer SVC encoding and real-time adaptive multi-interface selection over LTE and WiFi links. A split-layer video streaming can effectively scale to manage the required channels on each layer of various client connections. Moreover, split-layer SVC model brings streaming service providers a remarkable opportunity to stream video over multiple interfaces (e.g. WiFi, LTE, etc.) with a separate controlling based on their network status. Through the adaptive interface selection, the proposed system aims to ensure the maximizing video quality which the bandwidth of LTE/WiFi accommodates. In addition, the system offers cost-effective streaming to mobile clients by saving the LTE data consumption. In our system, an adaptive interface selection is developed with two different algorithms, such as INSTANT and EWMA methods. We implemented a prototype of mobile client based on iOS particularly by using iPhone5S. Moreover, we also employ the split-layer SVC encodes in streaming server-side as the add-on module to SVC reference encoding tool in a virtualized environment of KVM hypervisor. We evaluated the proposed system in an emulated and a real-world heterogeneous wireless network environments. The results show that the proposed system not only achieves to guarantee the highest quality of video frames via WiFi and LTE simultaneous connection, but also efficiently saves LTE bandwidth consumption for cost-effectiveness to client-side. Our proposed method provides the highest video quality without deadline misses, while it consumes 50.6% LTE bandwidth of ‘LTE-only’ method and 72.8% of the conventional (non-split) SVC streaming over a real-world mobile environment.     

A live video streaming system for intuitive human-system interaction

In this paper, we propose an intuitive live video streaming system based on virtual reality technologies among people who are far apart. This system is a kind of server-client system, and can provide remote users with virtual 3D audiovisual fields in real time via a very-high-speed network. The server captures audio and video data from its clients, compiles them into a 3D audiovisual scene at a virtual conference, and broadcasts it to the clients. At the present stage, our system captures 2 videos and creates one 3D video at a time. Our system can play 3D audiovisual contents on Windows XP systems as well as on CAVE systems. Currently, our system can play the 3D video contents at about 2.36 fps under a LAN environment. This work was presented in part at the 12th International Symposium on Artificial Life and Robotics, Oita, Japan, January 25–27, 2007     

流媒体视频存储服务器设计与研究

详细分析了在视频监控系统中流媒体视频存储服务器的作用和功能,针对传统的流媒体定时长存储方式的不足提出了固定空间存储的新策略.该存储策略将总空间初始化为多个固定大小的数据文件,每个数据文件中存储的流媒体时长可能是不相同的.针对新存储策略下出现的1秒尾巴,事件尾巴等新问题,提出了解决方案.固定空间存储策略虽然增加了索引的复杂度,但是有效避免了磁盘碎片的产生,对于改善流媒体视频存储服务器性能具有重要作用.     

Peer to peer video streaming in Bluetooth overlays

As Bluetooth is available in most personal and portable terminals (eg, cellular phone, PDA, videocamera, laptop, etc) Peer-to-peer video streaming through Bluetooth networks is now a reality. Camera equipped Bluetooth phones capture video and broadcast it to other Bluetooth devices and to the infrastructure. Tra ditionally, large scale Bluetooth networks were designed using scatternet concepts. However, many Bluetooth devices do not support Scatternet connections and, even if they support it, they provide only very limited features suitable mostly for static environments. In high mobility situations, a traditional Scatternet design is not useful because of frequent disconnections and reconnections. To overcome these problems, we propose overlaid Bluetooth Piconets (OBP) and simplified overlaid Bluetooth Piconets (SOBP) that interconnect Piconets forming virtual Scatternets. In OBP, every Piconet dynamically reconfigures to collect metadata from neighboring Piconets. If metadata shows the existence of useful data to transfer, an inter-Piconet connection is made to carry out the transfer. SOBP can be used instead of OBP once neighbor Piconets have already discovered each other. In this paper, we compare via analysis and simulation the throughput and efficiency of OBP, SOBP and Scatternet for video applications. We demonstrate the feasibility of video over OBP and SOBP for a representative application.

Loss tolerant video streaming authentication in heterogeneous wireless networks

Multicast video streaming in heterogeneous networks undergoes to very different physical constraints, in fact, such networks are characterized by different QoS parameters, involving one or more transcoding process between the sender and the receivers. Video streaming authentication algorithms must be robust to transcoding processes and must guarantee the copyright of the video owner/producer. We propose a real-time video streaming authentication algorithm that can guarantee the copyright of the video owner and that we prove to be robust to packet loss and transcoding processes.     

无线上行视频流的跨层容错传输方法

如何通过资源受限的移动通信终端提升无线上行视频流的抗误性能是亟待解决的重要问题。通过不同通信层次的联合调度,提出了一种跨层容错传输方案。移动通信终端的网络层代理首先利用容错包调度为视频流的延时约束帧集合提供重要性分类,随后该终端的链路层代理利用无线链路单元的优先级调度实现选择性重传。在调度延时与传输带宽限制下,跨层容错传输能够将突发错误转移到延时约束帧集合的低优先级视频数据中,从而在突发易错传输环境中实现了无线链路单元粒度的渐进式传输和平稳退化。     

Android实时流媒体监控的关键技术研究

以视频监控系统在物联网中的应用为背景,介绍了如何在Android平台上进行实时的视频监控系统的开发。在对Android操作系统进行深入分析的基础之上。提出了一个基于Android的流媒体监控方案,此方案通过移植X264开源库,实现了Android视频的H．264编码,并通过双缓冲文件搭建流媒体服务器对实时视频流进行发布。通过对系统的测试,指出了值得改进的方向,为今后的研究工作提供参考。