SQLS: A Storm-Based Query Language System for Real-Time Stream Data Analysis |
| |
| Affiliation: | 1. Computer of Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;2. Computer of Telecommunications, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;3. Department of Computer, Anhui Normal University, Wuhu 241002, China;4. Engineering and Science, Victoria University, Melbourne, Victoria 8001, Australia;5. Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing 210003, China;6. Computer of Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing 210003, China |
| |
| Abstract: | In this work,a Storm-based query language System (SQLS) is proposed for real-time data stream analysis.The system is compatible with Continuous query language (CQL) specification.It supports both continuous queries and one-time queries over streaming data,and meets the requirements of user experience (traditional SQL queries) and QoS (such as real-time and throughput).In order to better meet the requirement of throughput and enhance the processing efficiency,the load shedding algorithm and cache optimization are employed during the implementation of SQL-like operators.Finally,performance testing of the proposed SQLS has been conducted on standalone Storm platform and Storm clusters.Experimental resuits show that our system can not only meet the needs of users,but also extend the function of real-time streaming queries processing. |
| |
| Keywords: | Continuous query Ad hoc query Storm CQL Real-time query processing |
| 本文献已被 万方数据 等数据库收录！ |
|
