| 基于Storm技术的实时数据处理平台研究与实现 |
| |
| 引用本文： | 杨宇,徐万明.基于Storm技术的实时数据处理平台研究与实现[J].广东电脑与电讯,2021,1(1):51-54. |
| |
| 作者姓名： | 杨宇 徐万明 |
| |
| 作者单位： | 贵州电子信息职业技术学院,贵州凯里556000;黔东南民族职业技术学院,贵州 凯里556000 |
| |
| 摘 要： | 针对现有的大数据处理平台实时性差、处理耗时长、资源请求慢等问题,采用Storm实时计算技术,结合Flume、Kafka、Zookeeper等大数据处理组件,设计一个实时数据处理平台.利用tornado+ WSGI+ Apache技术搭建Web服务器,采用Echarts技术对处理结果进行可视化分析.以网站访问日志作为数据...
|
| 关 键 词： | 大数据 Storm 实时计算技术 数据可视化 点击率 访客数 |
Research and Implementation of Real-time Data Processing Platform Based on Storm Technology |
| |
| YANG Yu XU Wang-ming.Research and Implementation of Real-time Data Processing Platform Based on Storm Technology[J].Computer & Telecommunication,2021,1(1):51-54. |
| |
| Authors: | YANG Yu XU Wang-ming |
| |
| Affiliation: | (Guizhou Vocational Technology College of Electronics&Information,Kaili 556000,Guizhou;Qiandongnan Vocational&Technical College for Nationalities,Kaili 556000,Guizhou) |
| |
| Abstract: | Aiming at the problems of poor real-time performance,long processing time,and slow resource request of the existing big data processing platform,this paper uses Storm real-time computing technology,combined with Flume,Kafka,Zookeeper and other big data processing components to design a real-time data processing platform.It uses tornado+WSGI+Apache technology to build a Web server,and uses Echarts technology to visually analyze the processing results.This article uses the website access log as the data source to verify the platform.Through the test,the platform can complete the real-time calculation of the website's click-through rate and the number of visitors.It has the characteristics of stability,reliability and simple operation. |
| |
| Keywords: | big data Storm real-time computing technology data visualization click-through rate number of visitors |
| 本文献已被 维普 万方数据 等数据库收录！ |
| 点击此处可从《广东电脑与电讯》浏览原始摘要信息 |
|
点击此处可从《广东电脑与电讯》下载全文 |
|
