首页 | 本学科首页   官方微博 | 高级检索  
     

Hadoop环境下分布式物联网设备状态分析处理系统
引用本文:张瑞聪,任鹏程,房凯,张卫山.Hadoop环境下分布式物联网设备状态分析处理系统[J].计算机系统应用,2019,28(12):79-85.
作者姓名:张瑞聪  任鹏程  房凯  张卫山
作者单位:中国石油大学 (华东) 计算机与通信工程学院,青岛,266580
基金项目:国家自然科学基金(61309024);山东省自然科学基金(F020509,F060604)
摘    要:设备故障可能会引起严重的生产事故,对企业、社会和人身安全造成严重威胁.因此,对物联网设备状态分析并进行合理的处理具有重要意义.针对物联网设备数据量大且复杂的特性,本文提出了一种针对物联网设备的海量数据处理架构,同时结合Dask分布式计算框架,设计了基于Hadoop环境的分布式物联网设备状态分析处理系统.本系统主要包括数据服务、数据分析和数据存储3个模块,并通过合理的节点调度方案保证了算法的高效运行和分布式计算的稳定性.系统运行表明能有效的处理大批量数据并实时准确预测设备状态,满足工业智能制造过程中的实际应用.

关 键 词:物联网设备状态  Hadoop  Dask分布式计算框架  节点调度
收稿时间:2019/5/7 0:00:00
修稿时间:2019/5/28 0:00:00

Distributed Status Analysis and Processing System for IoT Device in Hadoop Environment
ZHANG Rui-Cong,REN Peng-Cheng,FANG Kai and ZHANG Wei-Shan.Distributed Status Analysis and Processing System for IoT Device in Hadoop Environment[J].Computer Systems& Applications,2019,28(12):79-85.
Authors:ZHANG Rui-Cong  REN Peng-Cheng  FANG Kai and ZHANG Wei-Shan
Affiliation:College of Computer & Communication Engineering, China University of Pertroleum, Qingdao 266580, China,College of Computer & Communication Engineering, China University of Pertroleum, Qingdao 266580, China,College of Computer & Communication Engineering, China University of Pertroleum, Qingdao 266580, China and College of Computer & Communication Engineering, China University of Pertroleum, Qingdao 266580, China
Abstract:Equipment failures can cause serious production accidents and pose a serious threat to business, society, and personal safety. Therefore, it is important to analyze the state of the IoT device and reasonablely process. Aiming at the large and complex data of IoT devices, this study proposes a massive data processing architecture for IoT devices. At the same time, combined with Dask distributed computing framework, a distributed device state analysis and processing system for IoT based on Hadoop environment is designed. The system mainly includes three modules of data service, data analysis, and data storage, and through reasonable node scheduling scheme, the efficient operation of the algorithm and the stability of distributed computing are guaranteed. The system operation shows that it can effectively process large quantities of data and accurately predict the status of the equipment in real time to meet the practical application in the industrial intelligent manufacturing process.
Keywords:status of IoT devices  Hadoop  Dask distributed computing framework  node scheduling
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机系统应用》浏览原始摘要信息
点击此处可从《计算机系统应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号