使用完成端口编写高性能服务器程序的研究

介绍了用完成端口编写高性能服务器程序。为了提高系统性能,采用完成端口和Windows Socket2.0结合可以开发出支持大量连接的网络服务程序,并结合实际应用阐述了在完成端口上处理数据的方法。     

基于IOCP机制的远程监控服务器设计与实现

利用一种在Windows平台上的I／O完成端口（IOCP）方法．解决在C／S模式下远程监控服务器针对大量并发客户连接请求的问题。用IOCP机制控制和管理多并发线程。实现高效的系统网络性能,并给出基于Windows Socket的远程监控服务器的网络传输设计和实现过程。     

基于完成端口模型的应用程序实现

介绍了Windows最复杂的内核对象IOCP(I/O Completion Port输入/输出完成端口)的基本原理。利用完成端口机制,应用程序能够为数百上千的用户服务。文章通过完成端口对象指定一定数量的线程,对重叠I/O请求进行管理,从而为已完成的重叠I/O请求提供服务。通过该模型编写的网络服务应用程序可以达到较好的性能。     

基于IOCP的服务器端应用程序

本文介绍了IOCP（I/O Completion Port 输入/输出完成端口）的基本原理,IOCP是一种能够合理利用与管理多线程的机制,可以帮助处理大量客户端请求的网络服务问题,是Windows系统平台上用于开发高性能的服务器端应用程序的最好的I/O模型。本文最后结合实践给出了一个基于IOCP开发服务器端应用程序的设计方案和其部分实现代码。     

基于IOCP机制的电力远程集抄系统通信模块研究

为实现基于GPRS的大规模电力远程集抄系统具有高效、稳定的网络通信服务,设计一种引入I/O完成端口IOCP(Input/Output completion port)机制的网络通信模块,并对通信模块开发中的客户端信息识别、系统资源管理、恶意客户连接、完成消息乱序等难点问题进行研究,提出自定义结构体、池原理、心跳机制等具体解决方法。最后对通信模块进行性能和压力测试,结果表明,该通信模块开销性低、数据吞吐量大,并支持大量并发连接,在实际项目中也取得了良好的效果。     

IOCP写服务程序时的关键问题研究

为了编写高效的网络服务程序,针对经典的多线程实现多客户端并发服务的不足,研究了当前最流行的IOCP(I/O completion port,输入输出完成端口)实现网络服务的方式.在解决了3个IOCP特有的复杂问题(信息定位问题、系统资源限制问题、报文预处理问题)之后,利用IOCP实现了高效的网络服务程序,完全克服了多线程实现多客户端并发服务的CPU使用量高、系统资源占用多、网络资源利用不充分,系统效率低等不足.实验结果表明,只要合理解决这3个问题,在编写网络服务程序过程中就能顺利地使用IOCP方式.与非IOCP实现网络服务程序方式的对比,系统效率有显著提高且网络资源得到更充分的利用.     

IOCP技术在数据库性能测试中的应用

针对数据库应用性能测试在少量测试终端上产生大量虚拟客户事务的需要,以及普通多线程技术的不足,提出了一种利用Windows输入/输出完成端口(I/O completion port, IOCP)技术产生并调度大量的虚拟客户事务的方法,该方法原本用于Windows NT操作系统下的服务端线程调度,并在网络游戏服务和大规模通信系统中得到广泛应用.主要讲述了基于IOCP技术构建的事务调度引擎的设计思想及在数据库应用性能测试中的应用,最后通过性能测试.实验表明,基于IOCP技术的线程池比其他多线程调度模型具有更好的性能,能够在有限的测试终端上为被测系统产生足够的压力.     

基于IOCP服务器模型设计与实现

完成端口是Windows系统平台上用于开发高性能服务器应用程序的最好I/O模型。介绍了10CP(输入/输出完成端口)的基本原理,并给出一个基于IOCP开发服务器端应用程序的设计方案及其部分实现代码。     

利用端口转发技术实现局域网穿透(下)

内网主机上的转发器要处理大量外网客户端的并发连接,因此需要有一种高效并行处理多连接的I/O机制。采用完成端口模型(IOCP)管理并发连接,为提高完成端口的执行性能,利用对象池技术提高完成端口模型对内存资源的利用效率,采用零字节投递处理重叠I/O的方法降低操作系统资源开销。而对于用户命令消息的传递,为不影响数据传输效率,在单独的线程中以完成例程模型进行管理。     

用完成端口管理Windows Sokcet

本文介绍了Windows套接字的I/O方法,以及如何利用完成端口管理套接字的I/O操作,进而开发高效的Windows网络通信程序。     

Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks

Applications running on leadership platforms are more and more bottlenecked by storage input/output (I/O). In an effort to combat the increasing disparity between I/O throughput and compute capability, we created Adaptable IO System (ADIOS) in 2005. Focusing on putting users first with a service oriented architecture, we combined cutting edge research into new I/O techniques with a design effort to create near optimal I/O methods. As a result, ADIOS provides the highest level of synchronous I/O performance for a number of mission critical applications at various Department of Energy Leadership Computing Facilities. Meanwhile ADIOS is leading the push for next generation techniques including staging and data processing pipelines. In this paper, we describe the startling observations we have made in the last half decade of I/O research and development, and elaborate the lessons we have learned along this journey. We also detail some of the challenges that remain as we look toward the coming Exascale era. Copyright © 2013 John Wiley & Sons, Ltd.     

关于I/O模拟的讨论

详细分析Windows的I/O机制,提出了分别在用户级、系统级、驱动级的I/O模拟操作,通过实际案例和源代码分享在I/O模拟上的得失,着重介绍鼠标与键盘的模拟。     

自主协助动态并行I/O调度策略研究

随着处理器速度和网络传输速度的快速提升，I／O成为限制计算机性能的一大瓶颈，并行I／O提供了解决这一问题的有效途径。在并行I／O的实现中，数据访问调度策略对系统的性能有着重要的影响。文章通过对集群计算中现有I／O数据访问调度策略的研究，针对调度器瓶颈问题，提出了自主协助动态I／O调度策略，实验结果表明了所提出策略的有效性。     

PLC程控配置方案探讨

随着主体设备可控性及控制元件可靠性的提高,火电厂辅助车间的控制系统自动化水平也越来越得到重视。重点对采用可编程序控制器（PLC）来实现火电厂辅助系统的程序控制配置方案进行了探讨。     

I/O performance of an RAID-10 style parallel file system

Without any additional cost, all the disks on the nodes of a cluster can be connected together through CEFT-PVFS, an RAID-10 style parallel file system, to provide a multi-GB/s parallel I/O performance.I/O response time is one of the most important measures of quality of service for a client. When multiple clients submit data-intensive jobs at the same time, the response time experienced by the user is an indicator of the power of the cluster. In this paper, a queuing model is used to analyze in detail the average response time when multiple clients access CEFT-PVFS. The results reveal that response time is with a function of several operational parameters. The results show that I/O response time decreases with the increases in I/O buffer hit rate for read requests, write buffer size for write requests and the number of server nodes in the parallel file system, while the higher the I/O requests arrival rate, the longer the I/O response time. On the other hand, the collective power of a large cluster supported by CEFT-PVFS is shown to be able to sustain a steady and stable I/O response time for a relatively large range of the request arrival rate.     

Reference implementation of scalable I/O low-level API on Intel Paragon

The Scalable I/O(SIO)Initiative‘s Low-Level Application Programming Interface(SIO LLAP)provides file system implementers with a simple low-Level interface to support high-level parallel /O interfaces efficiently and effectively.This paper describes a reference implementation and the evaluation of the SIO LLAPI on the Intel Paragon multicomputer.The implementation provides the file system structure and striping algorithm compatible with the Parallel File System(PFS)of Intel Paragon ,and runs either inside the kernel or as a user level library.The scatter-gather addressing read/write,asynchronous I/O,client caching and prefetching mechanism,file access hint mechanism,collective I/O and highly efficient file copy have been implemented.The preliminary experience shows that the SIO LLAPI provides opportunities of significant performance improvement and is easy to implement.Some high level file system interfaces and applications such as PFS,ADIO and Hartree-Fock application,are also implemented on top of SIO.The performance of PFS is at least the same as that of Intel‘s native pfs,and in many cases,such as small sequential file access,huge I/O requests and collective I/O,it is stable and much better,The SIO features help to support high level interfaces easily,quickly and more efficiently,and the cache,prefetching,hints are useful to get better performance based on different access models.The scalability and performance of SIO are limited by the network latency,network scalable bandwidth,memory copy bandwidth,memory size and pattern of I/O requests.The tadeoff between generality and efficienc should be considered in implementation.     

Multidimensional array I/O in Panda 1.0

Large multidimensional arrays are a common data type in high-performance scientific applications. Without special techniques for handling input and output, I/O can easily become a large fraction of execution time for applications using these arrays, especially on parallel platforms. Our research seeks to provide scientific programmers with simpler and more abstract interfaces for accessing persistent multidimensional arrays, and to produce advanced I/O libraries supporting more efficient layout alternatives for these arrays on disk and in main memory. We have created the Panda (Persistence AND Arrays) I/O library as a result of developing interfaces and libraries for applications in computational fluid dynamics in the areas of checkpoint, restart, and time-step output data. In the applications we have studied, we find that a simple, abstract interface can be used to insulate programmers from physical storage implementation details, while providing improved I/O performance at the same time.(A preliminary version of this paper was presented at Supercomputing '94.)     

基于NOW的Collective I/O技术研究

随着ＮＯＷ在科学研究中白益广泛的应用,如何为ＮＯＷ上的科学计算提供高性能的输入输出成为我们面临的一个新课题。作者根据ＮＯＷ的特点,设计并实现了一个具有ＮＯＷ特色的基于ＣｏｌｌｅｃｔｉｖｅＩ／Ｑ的并行Ｉ／Ｏ系统,吸取了ＤＤＩＯ与ｔｗｏ－ｐｈａｓｅＩ／Ｏ的优点,从而有效地解决了高带宽和低延迟问题。初步的系统吞吐量测试显示了良好的性能。     

RAID的并行I／O调度算法分析

由于越来越多的应用受限于I／O，存储系统正起着越来越重要的作用，磁盘阵列RAID是一种提供高性能I／O的最常见存储设备，本文分析了RAID并行I／O调度算法的I／O执行时间和磁盘利用率，为合理配置高性能阵列提供了依据。     

Windows Vista、Windows7存储I/O优先化

微软操作系统中Windows Vista率先实现了I/O优先化技术,克服了PC的I/O瓶颈,有效地改善了系统的响应能力.文章提供了微软Windows操作系统有关I/O优先级技术信息,为应用程序设计、存储设备设计及系统维护提供了参考依据.