实现BT数据流控制的集中管理和节点分组算法

在BitTorrent(简称BT)系统,节点利用"上行"带宽[1]来互传文件,然而这种系统中的节点之间连接所产生的数据流却消耗掉大量的主干网带宽,因此提出集中管理和节点分组(CMAPC)策略全局管理这种数据流.通过网络距离的测量,将所有节点与自己临近的节点分在一组,同组节点建立连接.实验结果显示:在不影响BT的其它性能的情况下,CMAPC能较高比例地将数据流限制在本子网中.所以得出结论:把数据流限制在本子网内来减小主干网的负载是一种较好的技术途径.     

Evaluation of a comprehensive P2P video-on-demand streaming system

Video-on-demand (VoD) streaming has recently become a popular service on the Internet, with several companies offering videos to a global audience. However, traditional client/server based VoD streaming systems can be very bandwidth intensive and expensive to maintain, especially for high quality video content. To improve the scalability these systems, the use of peer-to-peer (P2P) networking has been proposed, but despite the efficiency of applications such as BitTorrent for downloading of large files, it is not simple to use P2P techniques for streaming. Problems such as firewalls and freeloaders reduce the efficiency of both types of P2P systems, but for real-time services such as streaming, the result can be reduced playback quality. Other issues include the traffic load imposed on ISPs by P2P networks, which can motivate ISPs to interfere with the P2P traffic. Finally, protecting against malicious modification of content can increase overhead, response times, and startup delays.We consider these issues to be fundamental to the problem of P2P based VoD, but despite the large amount of research that has been done in this field, these issues have largely been ignored. To address this, we present an evaluation of the Streaming P2P Protocol (SPP) architecture. By studying the problem as a whole we have found a simple and comprehensive solution that addresses all the four issues listed above. To show that the system is not only scalable, but also that it can be implemented efficiently, we have used both simulations and experiments on PlanetLab for evaluation. The results show that the combination of cache nodes and use of end-user resources found in the SPP architecture can give a low load on servers and ISPs, even when firewalls are taken into consideration. Furthermore, we observed low startup delays and few playback errors during the PlanetLab experiments. The scalable and low-cost distribution of content possible with the SPP architecture should be suitable for both large-scale commercial distributors and users of community networks with limited resources.     

Optimizing BitTorrent-like peer-to-peer systems in the presence of network address translation devices

BitTorrent nowadays is one of the most important peer-to-peer (P2P) file-sharing applications on the Internet, and it has also inspired many other P2P applications such as live or on-demand video streaming services. On the other hand, Network Address Translation (NAT) has become pervasive in almost all networking scenarios, from residential Internet access to enterprise networks. Despite the effort of NAT traversal, it is still very likely that P2P applications cannot receive incoming connection requests properly if they are behind NAT. To quantify the performance impact of NAT on BitTorrent-like P2P systems, we have created and validated a detailed but tractable mathematical model. We have also proposed and briefly examined a simple but effective strategy to mitigate the negative impact on NAT peers. In this paper, we further extend our model to cover the proposed biased optimistic unchoke strategy, and optimize the system performance in terms of both average peer download time and system finish time. We also create a new, faster Java-based BitTorrent simulator, which is used to validate the extended model and show the optimality of the proposed strategy and its boundary conditions.     

Locality-Awareness in BitTorrent-Like P2P Applications

This paper presents the measurement study of locality-aware P2P solutions over real-world Internet autonomous systems (AS) topology. By using the accesses of nodes of PlanetLab testbed, we create a detailed AS-level map including the end-to-end path of all nodes, as well as the relationship of all involved ASes. Based on this map, we evaluate the performance of a set of locality-aware P2P solutions, including an optimal solution guaranteeing the minimum AS hop count, as well as modified BitTorrent system with locality-awareness built into its neighbor selection, peer choking/unchoking, and piece selection processes. Our findings suggest that locality-awareness can help existing P2P solution to significantly decrease load on Internet, and achieve shorter downloading time. By comparing the performance of different kinds of locality-aware and traditional BitTorrent systems, we also point out the necessity to tradeoff between the goals of optimizing AS-related performance and achieving fairness among peers such as intra-AS traffic and peer burden fairness.      

IP组播在BitTorrent中的应用研究

针对BitTorrent(BT)应用会占用大量网络带宽的问题,通过改进BT协议,提出一种应用IP层组播技术优化传输的MBitTorrent(MBT)协议。该协议引入基于区域和优先级的Peer阻塞策略,适用于组播域分离的网络环境。仿真结果表明,与BT协议相比,MBT显著降低了网络流量,提升了整体下载性能。     

PULSE: An Adaptive, Incentive-Based, Unstructured P2P Live Streaming System

Large-scale live media streaming is a challenge for traditional server-based approaches. To appropriately support big audiences, broadcasters must be able to allocate huge bandwidth and computational resources. The costs involved with such an infrastructure exclude all but the established content producers from exploiting the Internet as a distribution medium. Publishers of not-yet-popular content, unless they manage to properly predict their maximum audience size, will likely fail to dimension correctly their broadcast infrastructure. Peer-to-peer systems for live streaming allow the users to support content distribution by contributing their unused resources: this increases the scalability of the content distribution while reducing at the same time the economical burden on the streaming provider. This paper presents and evaluates PULSE, an unstructured mesh-based peer-to-peer system designed to support live streaming to large audiences under the arbitrary resource availability as is typically the case for the Internet. PULSE is a highly dynamic system: it constantly optimizes its mesh of data connections using a feedback-driven peer selection strategy that is based on pairwise incentives. We evaluate the behavior of PULSE under realistic scenarios via simulation and emulation, and present the advantages of our approach, namely a best-effort response to system-wide resource scarcity, high resilience to node churn, and good hop-count properties of the average data distribution paths.     

Measurement,modeling and enhancement of BitTorrent-based VoD system

BitTorrent is one of the most popular Peer-to-Peer (P2P) applications for file sharing over the Internet. Video files take up a large proportion of space among the BitTorrent shared files. Recently, BitTorrent has attracted researchers’ interests, as an alternative method of providing video on demand (VoD) service. In this paper, we concentrate on enabling BitTorrent to support VoD service in existing swarms while maintaining the download efficiency of file-sharing users. We first examine the content properties of the BitTorrent system to explore the demands and challenges of VoD service in BitTorrent swarms. The efficiency of BitTorrent for various piece selection policies is then compared through measurement on PlanetLab. We also use an optimization mathematical model to analyze the hybrid BitTorrent system in which downloading peers and streaming peers coexist. Both measurement results and model analysis indicate the problem of system efficiency decline in the BitTorrent-based VoD systems, in comparison with the original BitTorrent file-sharing system. Our proposed approach, unlike existing strategies that are limited to changing the piece selection policy to allow BitTorrent to support streaming services, modifies both piece and peer selection policies to provide a “streaming while downloading” service in the BitTorrent system with downloading peers. For the peer selection policy, a CAP (Closest-Ahead Peers) method is applied to make better use of the peers’ upload bandwidths. For the piece selection policy, a sliding window-based hybrid method that combines the rarest-first policy with the sequential policy is proposed. To demonstrate the performance of our proposed approach, an evaluation is made using various metrics on PlanetLab. The results show that our proposed method has higher throughput and better streaming continuity than the sequential policy and BiToS.     

Towards efficient data distribution on computational desktop grids with BitTorrent

Datacentric applications are still a challenging issue for large-scale distributed computing systems. The emergence of new protocols and software for collaborative content distribution over the Internet offers a new opportunity for efficient and fast delivery of a high volume of data. This paper presents an evaluation of the BitTorrent protocol for computational desktop grids. We first present a prototype of a generic subsystem dedicated to data management and designed to serve as a building block for any desktop grid system. Based on this prototype we conduct experiments to evaluate the potential of BitTorrent compared to a classical approach based on FTP data server. The preliminary results obtained with a 65-node cluster measure the basic characteristics of BitTorrent in terms of latency and bandwidth and evaluate the scalability of BitTorrent for the delivery of large input files. Moreover, we show that BitTorrent has a considerable latency overhead compared to FTP but clearly outperforms FTP when distributing large files or files to a high number of nodes. Tests on a synthetic application show that BitTorrent significantly increases the communication/computation ratio of the applications eligible to run on a desktop grid system.     

P2P as a CDN: A new service model for file sharing

Traditional content distribution networks (CDNs), such as Akamai, replicate content at thousands of servers worldwide in an attempt to bring it closer to end users. Recent years have, however, brought a surge of peer-to-peer (p2p) systems that have demonstrated the ability both to help traditional CDN operations and to effectively disseminate content as independent applications. Unfortunately, this p2p surge has created significant problems to network operators by generating large volumes of inter-AS traffic. In this paper, we demonstrate that stepping back and applying traditional CDN design principles to p2p systems can help solve these emerging problems. In particular, focusing on the BitTorrent swarming protocol, we show that our new service model can, in the common case, reduce inter-AS traffic by 45–75%. Moreover, in scenarios when ISPs are shaping inter-AS traffic, it speeds up download times by 60% for the most popular torrents.Our approach bases on disproving the common wisdom that the current peer altruism in p2p systems (BitTorrent in particular) is insufficient. We thus abandon the common approach of deploying novel incentives for cooperation, and focus on designing methods to effectively utilize existing system resources. We show that controlled regional-based content replication, common for the traditional CDN design, can effectively achieve this goal. We implement our system and demonstrate that it effectively scales. Moreover, it is incrementally deployable and brings significant benefits in partial deployment scenarios. ISPs and network regions in which the system gets deployed can resolve their inter-AS traffic problems instantly and autonomously, i.e., without any inter-ISP collaboration and without requiring that the system gets deployed in the entire Internet.     

结构化多点协作 P2 P系统研究 *

Chord是一种典型的分布式结构化的 P2P系统 ,具有严格的结构 ,无须服务器就可以很方便地找到需要的节点和数据 ;但是该系统中 ,一个文件只有一个备份 ,容易造成文件丢失 ,而且文件传输速度很慢。为此 ,在 Chord算法的基础上进行了改进 ,设计了结构化多点协作 P2P系统。该系统兼备 BitTorrent和 Chord的优点 ,既可以无须服务器方便地找到需要的节点和数据 ,又可以进行多点协作下载 ,从而保证了下载速度。它很好地解决了以上问题 ,大大提高了系统的执行效率。     

Multicast protocols for scalable on-demand download

Previous scalable protocols for downloading large, popular files from a single server include batching and cyclic multicast. With batching, clients wait to begin receiving a requested file until the beginning of its next multicast transmission, which collectively serves all of the waiting clients that have accumulated up to that point. With cyclic multicast, the file data is cyclically transmitted on a multicast channel. Clients can begin listening to the channel at an arbitrary point in time, and continue listening until all of the file data has been received.This paper first develops lower bounds on the average and maximum client delay for completely downloading a file, as functions of the average server bandwidth used to serve requests for that file, for systems with homogeneous clients. The results show that neither cyclic multicast nor batching consistently yields performance close to optimal. New hybrid download protocols are proposed that achieve within 15% of the optimal maximum delay and 20% of the optimal average delay in homogeneous systems.For heterogeneous systems in which clients have widely varying achievable reception rates, an additional design question concerns the use of high rate transmissions, which can decrease delay for clients that can receive at such rates, in addition to low rate transmissions that can be received by all clients. A new scalable download protocol for such systems is proposed, and its performance is compared to that of alternative protocols as well as to new lower bounds on maximum client delay. The new protocol achieves within 25% of the optimal maximum client delay in all scenarios considered.     

Service quality in P2P streaming systems

Relying on end users to contribute bandwidth to the system peer-to-peer (P2P) overlays provide a cheap and scalable way to distribute live video content in the Internet. However, being inherently dynamic due to peers joining and leaving the system at arbitrary time and running over the best-effort Internet, successful commercial usage of these systems may suffer from unstable media quality provided to end users. In this survey, we consider problems related to providing quality of media delivery in P2P streaming systems. We show that in spite of numerous systems available today no one incorporates mechanisms capable to maintain a certain level of quality of delivered media. We identify reasons behind that and discuss possible solutions to this problem.     

Receiver-driven bandwidth sharing for TCP and its application to video streaming

Applications using Transmission Control Protocol (TCP), such as web-browsers, ftp, and various peer-to-peer (P2P) programs, dominate most of the Internet traffic today. In many cases, users have bandwidth-limited last mile connections to the Internet which act as network bottlenecks. Users generally run multiple concurrent networking applications that compete for the scarce bandwidth resource. Standard TCP shares bottleneck link capacity according to connection round-trip time (RTT), and consequently may result in a bandwidth partition which does not necessarily coincide with the user's desires. In this work, we present a receiver-based bandwidth sharing system (BWSS) for allocating the capacity of last-hop access links according to user preferences. Our system does not require modifications to the TCP protocol, network infrastructure or sending hosts, making it easy to deploy. By breaking fairness between flows on the access link, the BWSS can limit the throughput fluctuations of high-priority applications. We utilize the BWSS to perform efficient video streaming over TCP to receivers with bandwidth-limited last mile connections. We demonstrate the effectiveness of our proposed system through Internet experiments.     

一种适用于嵌入式系统的P2P下载模型*

提出了一种基于BitTorrent协议的嵌入式BT下载模型。该模型对BitTorrent思想进行了深化和应用,针对于快速BT网络,在嵌入式系统应用中进行了改进,有效提高了下载速度,甚至可以在嵌入式系统上快速下载多媒体视频文件进行播放。     

Measurement study on P2P streaming systems

Originally used as the default infrastructure for efficient file sharing, peer-to-peer (P2P) architecture achieved great successes. Now, the P2P model has been adopted for many other distributed applications, such as instant message and phone services, Internet gaming, and large-scale scientific computing. In recent years, P2P streaming systems experienced tremendous growth and became one of the largest bandwidth consumers on the Internet. Compared to standard file sharing systems, the streaming services show unique characteristics with more stringent time constraints and require much higher network bandwidth. It is extremely important to evaluate and analyze existing applications, and investigate the merits and weaknesses in these systems for future development. In this paper, we conduct a comprehensive measurement study on two of the most popular P2P streaming systems, namely, PPLive and PPStream. They are very popular P2P streaming applications, and serving millions of registered users with hundreds of live TV channels and millions of other video clips. In our measurement, we deploy our collectors in China, and both live TV and video-on-demand (VoD) channels are evaluated. We record run-time network traffic on the client side, compare and analyze the characteristics of these channels based on their popularity. For both categories, we perceive that, in general, the two measured P2P streaming systems provide satisfactory experience to the audiences for all channels regardless of popularity. However, the most of data are downloaded from the dedicated servers for unpopular channels. We also observe that live TV channels show better peer coordination than VoD channels. Beside the traffic, we have also collected cache replacement information for VoD channels, and these measurement results can help us understand the caching mechanism of P2P streaming systems. With the support of the cache, VoD channels perform better than their counterparts in the live TV category in terms of data transmission, workload distribution, and signal traffic overhead. Overall, our results reveal that although P2P streaming systems can usually provide excellent viewing experience for popular channels, there are still challenges to fully support unpopular channels. New designs and algorithms are in urgent need, especially for unpopular live TV channels.     

Performance analysis of BitTorrent-like systems with heterogeneous users

Among all peer-to-peer (P2P) systems, BitTorrent seems to be the most prevalent one. This success has drawn a great deal of research interest on the system. In particular, there have been many lines of research studying its scalability, performance, efficiency, and fairness. However, despite the large body of work, there has been no attempt mathematically to model, in a heterogeneous (and hence realistic) environment, what is perhaps the most important performance metric from an end user’s point of view: the average file download delay.

In this paper we propose a mathematical model that accurately predicts the average file download delay in a heterogeneous BitTorrent-like system. Our model is quite general, has been derived with minimal assumptions, and requires minimal system information. Then, we propose a flexible token-based scheme for BitTorrent-like systems that can be used to tradeoff between overall system performance and fairness to high bandwidth users, by properly setting its parameters. We extend our mathematical model to predict the average file download delays in the token- based system, and demonstrate how this model can be used to decide on the scheme’s parameters that achieve a target performance/fairness.     

P2P transfer of partial stream in multimedia multicast

In this paper, we propose a new multicast scheme that is based on the client-initiated-with-prefetching (CIWP) and peer-to-peer (P2P) transfer of a partial multimedia stream. In the CIWP scheme, when a new client joins an ongoing multicast channel, the server has to create an extra unicast channel to retransmit the partial stream that has already been transmitted. However, the unicast channel consumes some of the I/O bandwidth of the server, as well as some of the network resources between the server and the client's Internet Service Provider (ISP). To solve this problem, we propose the use of the P2P transfer algorithm to deliver the partial stream from a client that has already joined the ongoing multicast session to the newcomer. This P2P transfer between clients is limited to clients belonging to the same ISP. To further improve the performance, a threshold is used to control the P2P transfer. We performed analytical studies to show that the proposed multicast scheme can reduce the consumption of the network resources of the server, by utilizing the client's disk space. We also performed various simulation studies to demonstrate the performance improvement in terms of the use of the server's bandwidth and the waiting time for the clients’ requests.     

融合P2P技术的云平台快速内容分发方法

云存储服务在内容分发过程中的数据传递协议通常采用超文本传输协议（HTTP）,当大量客户端在短时间内向云存储服务器发出下载同一文件的请求时,会造成云服务端带宽压力过大以及客户端下载过慢的问题。为有效解决该问题,提出了一种融合Peer-to-Peer （P2P）技术的云平台快速内容分发方法,在内容分发过程中构建动态的HTTP和P2P协议转换机制,实现快速内容分发。选取用户类型、服务质量、时间收益、带宽收益等四种协议转换度量指标,并基于OpenStack云平台实现了所提出的动态协议转换方法。实验结果表明,与仅使用HTTP或P2P协议的内容分发方式相比,动态协议转换方法能够保证客户端用户总是获得较短的内容下载时间,同时,当P2P客户端数量较大时能够有效节约服务提供商的带宽资源。     

BitTorrent packet traffic features over IPv6 and IPv4

At present, BitTorrent protocol packets constitute a large part of peer-to-peer application traffic on the Internet. Due to the increasing amount of BitTorrent traffic, it has become inevitable to take into account its effects on network management. Generally, studies on BitTorrent traffic measurement have involved analysis with packets transmitted via IPv4 protocol. However, with several facilities provided by IPv6 protocol, its traffic volume in operational networks is increasing day by day. New features of IPv6 enhance packet processing speeds over routers, switches and end systems. We consider that traffic features and packet traffic characteristics are likely to be affected with increasing amount of IPv6 protocol traffic. Therefore, it becomes significant to explore IPv6 packet traffic characteristics and application traffic features over IPv6. In this study, we investigate the IPv6 BitTorrent packet traffic characteristics in terms of autocorrelation, power spectral density and self similarity of packet size and packet interarrival time. We also perform distribution modeling for IPv4 and IPv6 BitTorrent packet traffic. With these models, efficient packet traffic traces are generated for network simulation studies. A detailed comparison is performed to determine differences between IPv4 and IPv6 BitTorrent packet traffic.     

基于P2P的海量地形漫游搜索模型*

随着用户的增加,在传统的C/S模式下,中心服务器面临着负载过大、性能下降等诸多问题。基于对等网结构,利用P2P技术解决大规模海量地形漫游中服务器带宽和性能瓶颈问题得到了快速发展,但由于网络节点的动态性,通过P2P进行瓦片数据共享时如何解决节点搜索问题成为关键。针对上述问题,提出了一种基于分组洪泛式的节点搜索模型GFLOODING,通过组内缓存映射、组外邻居组映射的洪泛模式查询服务节点;通过实验原型系统的比较测试表明,该算法满足大规模节点模式下的动态性要求,且查询效率高。