一种域分布式合作Web缓存系统

在分析Internet缓存协议（ICP）和基于集中管理的协作式Web缓存系统（CMCS）的基础上，提出了一种域分布合作Web缓存系统模型（DDCCS），该模型克服了ICP的缓存内容冗余问题和CMCS集中管理的不健壮问题，并能充分考虑各代理缓存器的处理能力和缓存能力，采用区间散化方法和加权区间片分配算法，使得各代理的负担更加均匀合理，在性能上较ICP和CMCS有较大的改进。     

一个基于集中管理的协作式Web缓存系统

共享不同代理的缓存Web文档是减少通信量和减轻网络瓶颈的重要方法。在分析原有Web缓存通信协议（ICP）的基础上,提出了一种新的协作Web缓存系统（CMCS）并作了分析比较。通过将HTTP请求均匀分散到系统各个代理,消除了代理之间庞大的通信开销以及由此带来的处理负担。在动态变化的网络环境下,有效地将各个代理组织起来,处理来自服务器的文档。另外也克服了以往每个代理里有大量冗余内容,造成各个代理内容趋向的情形。     

一种基于分散协作的Web缓存集群体系结构

Web对象缓存技术是一种减少Web访问通信量和访问延迟的重要手段，该文通过分析现有的各种Web缓存系统，提出了一种基于分散协作的Web缓存集群体系结构。该体系结构克服了集中式系统需要额外配备一台管理服务器的缺陷，消除了管理服务器瓶颈失效造成系统瘫痪的危险，减少由于管理服务器带来的延迟；同时消除了分散系统的缓存不命中情况下的多级转发的延迟和缓存内容重叠，提高了资源利用率和系统效率，具有良好的可扩展性和健壮性。     

基于标记的缓存协作分布式Web服务器系统

介绍了提高Web服务器性能的前沿技术--分布式Web服务器系统,讨论了现有各种方案的优缺点,在此基础上提出一种新的分布式Web服务器系统.该系统使用基于标记的缓存协作用户请求分发方法(tag based cache cooperative Web requests distribution,简称TB-CCRD),通过前端机把系统中各个Web服务器的缓存组织成一个大的虚拟缓存系统,提高系统的整体缓存命中率,缩短了请求的响应时间;通过分布式处理TCP连接转交来消除前端机的性能瓶颈;利用标记通告URL在缓存中的位置,避免了额外的系统内部通信.从而得到了一个可扩展的高性能分布式Web服务器系统.     

一种新的基于连续哈希函数的合作式Web缓存系统

提出了一种新的基于连续哈希函数的合作式缓存系统。针对传统合作式缓存系统中多级转发造成的高时延和多重哈希计算问题，设计了一种高效的Web对象定位和路由模式，保证任意Web请求只需计算一次哈希且至多经过一次转发就可到达目标节点。采用失效-触发的策略来解决路由表一致性维护的问题，减少了网络开销，提高了系统的可扩展性和可靠性。仿真实验表明，该系统性能优于基于互联网缓存协议和缓存阵列路由协议的系统。     

大规模分布式VoD中可扩展的影片缓存配置策略

提出了在VoD系统中减少综合性资源开销的一种灵活的分布式层次化影片缓存(Cache)配置策略。在采用单播传输情况下分析了标志着系统集成、服务器的流支持、存储及网络连接等的综合性资源开销。性能分析结果表明：用该策略构成的系统比传统的方案具有更小的开销，并且可以用较低的代价获得更多影片的服务。     

合作式Web缓存系统的性能分析

共享不同代理的缓存文件是减少Web通信量和减轻网络瓶颈的重要方法．在分析现有合作式缓存系统的基础上，提出一种基于混合管理的合作式Web缓存系统(HMCS）．HMCS采用重定向的方法将请求从未命中的代理转发给缓存了请求文件的代理．采用这种方法可以减少缓存文件的冗余度，从而提高了缓存系统的存储利用率，进而提高系统的命中率．性能分析和仿真结果表明HMCS系统性能要优于CRISP和ICPS系统．     

分布式缓存系统中一种优化缓存部署的图算法

数据缓存技术可以有效地减少网络拥塞,减轻服务器负载,加快信息访问速度.通过部署一组地域分布的缓存节点相互协作处理用户请求,可以进一步提高系统性能.在分布式缓存系统中,一个值得关注的问题是优化缓存的放置,使访问开销最小化.首先建立了一个理论模型来分析缓存副本放置对系统访问开销的影响.基于这个模型,缓存放置问题可以形式化地描述成一个最优化问题,提出了一种图算法来解决该问题.图算法使用修改的Dijkstra算法在访问代价图中寻找一条最短路径,该路径对应一种最优的缓存部署.理论上证明了图算法的正确性,并使用仿真实验对其性能进行评估.实验结果表明,图算法的性能优于大部分现有的分布式缓存机制.     

分布式缓存系统中一种优化缓存部署的图算法

数据缓存技术可以有效地减少网络拥塞,减轻服务器负载,加快信息访问速度.通过部署一组地域分布的缓存节点相互协作处理用户请求,可以进一步提高系统性能.在分布式缓存系统中,一个值得关注的问题是优化缓存的放置,使访问开销最小化.首先建立了一个理论模型来分析缓存副本放置对系统访问开销的影响.基于这个模型,缓存放置问题可以形式化地描述成一个最优化问题,提出了一种图算法来解决该问题.图算法使用修改的Dijkstra算法在访问代价图中寻找一条最短路径,该路径对应一种最优的缓存部署.理论上证明了图算法的正确性,并使用仿真实验对其性能进行评估.实验结果表明,图算法的性能优于大部分现有的分布式缓存机制.     

利用基于内容的缓存代理提高Web服务器性能

分布式Web服务器系统(DWSS)是提高网络服务性能的一种前沿方式.文中分析了当前几种在客户端、主机端提升Web服务性能的方法,提出了一种基于内容的缓存代理协作分布式Web服务器系统模型.该模型可以有效减少用户获得响应的时间,避免了服务器之间不必要的通信,提高了Web服务器整体的性能.     

Web网站缓存设计中Cache一致性问题的研究

从网站缓存实现机制入手，分析了Cache一致性对网站缓存效率的影响，重点讨论了一种通过服务器集群实现基于网站为单位的缓存设计，缓存不再针对具体的文件而是以整个网站为单位来进行查询和替换，更好地保证了Cache一致性原则在缓存设计中的体现。     

Extending Proxy Caching Capability: Issues and Performance

Proxy caching is an effective approach to reduce the response latency to client requests, web server load, and network traffic. Recently there has been a major shift in the usage of the Web. Emerging web applications require increasing amount of server-side processing. Current proxy protocols do not support caching and execution of web processing units. In this paper, we present a weblet environment, in which, processing units on web servers are implemented as weblets. These weblets can migrate from web servers to proxy servers to perform required computation and provide faster responses. Weblet engine is developed to provide the execution environment on proxy servers as well as web servers to facilitate uniform weblet execution. We have conducted thorough experimental studies to investigate the performance of the weblet approach. We modify the industrial standard e-commerce benchmark TPC-W to fit the weblet model and use its workload model for performance comparisons. The experimental results show that the weblet environment significantly improves system performance in terms of client response latency, web server throughput, and workload. Our prototype weblet system also demonstrates the feasibility of integrating weblet environment with current web/proxy infrastructure.     

Design a progressive video caching policy for video proxy servers

Proxy servers have been used to cache web objects to alleviate the load of the web servers and to reduce network congestion on the Internet. In this paper, a central video server is connected to a proxy server via wide area networks (WANs) and the proxy server can reach many clients via local area networks (LANs). We assume a video can be either entirely or partially cached in the proxy to reduce WAN bandwidth consumption. Since the storage space and the sustained disk I/O bandwidth are limited resources in the proxy, how to efficiently utilize these resources to maximize the WAN bandwidth reduction is an important issue. We design a progressive video caching policy in which each video can be cached at several levels corresponding to cached data sizes and required WAN bandwidths. For a video, the proxy server determines to cache a smaller amount of data at a lower level or to gradually accumulate more data to reach a higher level. The proposed progressive caching policy allows the proxy to adjust caching amount for each video based on its resource condition and the user access pattern. We investigate the scenarios in which the access pattern is priorly known or unknown and the effectiveness of the caching policy is evaluated.     

一种Tracker引导的缓存调度方法

为优化流媒体视频点播系统中客户端对数据的缓存调度,使整个系统的播放质量与资源利用率趋向最优,提出一种Tracker引导的缓存调度方法,Tracker收集缓存服务器的负载信息和网络中的数据请求信息,采用基于流行度的预测方法推测下一阶段网络中需要的副本数,以此为根据对客户端缓存建议请求予以响应.客户端以Tracker的建议和自身在邻域网络内感知到的副本数为依据,使用兼顾全局和局部利益的决策算法进行视频数据的缓存操作.模拟结果表明,Tracker引导的缓存调度方法能够有效的保证网络中客户端节点的播放质量,并在一定程度上降低缓存服务器的负担,使整个系统的缓存调度趋向最优.     

Web缓存服务器技术研究与应用

Web缓存服务器系统正在Internet及局域网上广泛地应用，对它所采用的技术做了较深入的讨论，指出利用Web Cache技术，可减少网络流量，节约资金，提高带宽利用率；同时在Cache服务器端进行内容分析过滤，可提高过滤质量和效率，有效防止有害信息的进一步传播。     

A neural network proxy cache replacement strategy and its implementation in the Squid proxy server

As the Internet has become a more central aspect for information technology, so have concerns with supplying enough bandwidth and serving web requests to end users in an appropriate time frame. Web caching was introduced in the 1990s to help decrease network traffic, lessen user perceived lag, and reduce loads on origin servers by storing copies of web objects on servers closer to end users as opposed to forwarding all requests to the origin servers. Since web caches have limited space, web caches must effectively decide which objects are worth caching or replacing for other objects. This problem is known as cache replacement. We used neural networks to solve this problem and proposed the Neural Network Proxy Cache Replacement (NNPCR) method. The goal of this research is to implement NNPCR in a real environment like Squid proxy server. In order to do so, we propose an improved strategy of NNPCR referred to as NNPCR-2. We show how the improved model can be trained with up to twelve times more data and gain a 5–10% increase in Correct Classification Ratio (CCR) than NNPCR. We implemented NNPCR-2 in Squid proxy server and compared it with four other cache replacement strategies. In this paper, we use 84 times more data than NNPCR was tested against and present exhaustive test results for NNPCR-2 with different trace files and neural network structures. Our results demonstrate that NNPCR-2 made important, balanced decisions in relation to the hit rate and byte hit rate; the two performance metrics most commonly used to measure the performance of web proxy caches.     

Exploiting Regularities in Web Traffic Patterns for Cache Replacement

Abstract. Caching web pages at proxies and in web servers' memories can greatly enhance performance. Proxy caching is known to reduce network load and both proxy and server caching can significantly decrease latency. Web caching problems have different properties than traditional operating systems caching, and cache replacement can benefit by recognizing and exploiting these differences. We address two aspects of the predictability of traffic patterns: the overall load experienced by large proxy and web servers, and the distinct access patterns of individual pages. We formalize the notion of ``cache load' under various replacement policies, including LRU and LFU, and demonstrate that the trace of a large proxy server exhibits regular load. Predictable load allows for improved design, analysis, and experimental evaluation of replacement policies. We provide a simple and (near) optimal replacement policy when each page request has an associated distribution function on the next request time of the page. Without the predictable load assumption, no such online policy is possible and it is known that even obtaining an offline optimum is hard. For experiments, predictable load enables comparing and evaluating cache replacement policies using partial traces , containing requests made to only a subset of the pages. Our results are based on considering a simpler caching model which we call the interval caching model . We relate traditional and interval caching policies under predictable load, and derive (near)-optimal replacement policies from their optimal interval caching counterparts.     

Web对象访问特征模拟器的设计与实现

Web缓存是一个提高Web性能非常有效的方法，它可以位于网络的不同位置：客户端，代理服务器端，服务器端。研究表明Web缓存命中率可以达到30％-50％。Web缓存在应用中最大的问题就是Web缓存管理，研究Web访问特征是有效进行Web缓存管理的基础。Web日志生成模拟器对于研究Web缓存系统有很大地帮助，目前有两种方法模拟生成Web访问日志：日志驱动方法，数学模拟方法。日志驱动方法利用对历史日志进行变换来模拟生成新的日志，数学模拟方法在充分研究Ⅵ协对象访问特征的基础上，通过建立数学模型来模拟生成Web日志。该文通过分析Web对象访问特征，采用数学模拟方法分别模拟了Web对象高频区及低频区流行度特征，Web对象大小重尾分布特征，Web访问的时间局部性特征；设计并实现了一个Web日志模拟生成器WEBSIM。该模拟器不仅可以模拟生成Web对象访问日志，而且具有较大的灵活性，为进一步研究Web缓存技术和预取技术提供依据。     

A locality aware cache diffusion system

Web caching is a widely deployed technique to reduce the load to web servers and to reduce the latency for web browsers. Peer-to-Peer (P2P) web caching has been a hot research topic in recent years as it can create scalable and robust designs for decentralized internet-scale applications. However, many P2P web caching systems suffer expensive overheads such as lookup and publish messages, and lack locality awareness. In this paper, we present the development of a locality aware cache diffusion system that makes use of routing table locality, aggregation, and soft state to overcome these limitations. The analysis and experiments show that our cache diffusion system reduces the amount of information processed by nodes, reduces the number of index messages sent by nodes, and improves the locality of cache pointers.