基于SpringBatch框架的数据批量处理

通常企业决策分析系统需要对关键业务信息进行批处理操作,而这些业务的批处理操作是在没有用户进行交互的情况下对大量复杂的信息进行自动处理.为了解决批处理数据操作效率低下的问题,本文在对SpringBatch框架进行深入的研究和分析的基础上,选用SpringBatch框架,开源作业调度库Quartz以及关系型数据库MySQL和非关系型数据库Cassandra,设计并实现了高效批处理的决策分析系统.同时本文还对该系统进行相关性能测试,测试结果证明使用SpringBatch框架的决策分析系统批数据处理能力得到了极大的提升.

Application of data batch processing in decision analysis system based on SpringBatch framework

Usually the enterprise decision analysis system needs to deal with the key business information. These operations are automaticly deal with lots of complex information without user interaction. In order to solve the problem of low efficiency of batch data operation, in this paper, based on in depth research and analysis on the Spring Batch framework, we use SpringBatch framework, open source job scheduling Quartz and relational database MySQL and non relational database Cassandra to design and implement the decision analysis system of efficient batch processing. At the same time, this paper also carry out the performance test of the system, test results show that the decision analysis system which used the SpringBatch framework to implement is more efficient in batch data processing.