Application of high-throughput computing in bioinformatics

We describe the challenges faced when developing a Linux/PC-based cluster to apply bioinformatics algorithms to the rapidly increasing raw genomics data available. The calculations, which take around two months to complete, result in a powerful resource that can be used for data mining--most obviously for the human genome. Our current infrastructure consists of a 1314 node cluster with 1734 processors supporting both production and research. This paper highlights the problems in achieving high data throughput with such systems and shows that raw computer power is only one component of a complex problem.