自适应数据采集组件设计

数据采集作为数据分析的基础起着重要的作用。文章针对现有的大数据信息采集技术方案中存在的采集设备性能数据不可配置、采集容量小等问题,提出了一种性能好、可配置、自适应的数据采集解析方案。该方案可以适配多种网络拓扑及多厂家设备,最大限度地提高数据采集规模,还可以自动调整采集策略,以避免出现单源采集阻塞问题,保证整个采集平台的有效运行。

Design of adaptive data acquisition component

As the basis of data analysis,data acquisition plays an important role.In view of the problems existed in the existing technical scheme of massive data information acquisition,such as the performance data of the acquisition equipment cannot be configured and the acquisition capacity is small,this paper proposes a data acquisition and analysis scheme with good performance,configurable and adaptive.The scheme can adapt to a variety of network topologies and multi vendor equipments,maximize the scale of data acquisition,and automatically adjust the acquisition strategy to avoid single source acquisition blocking,so as to ensure the effective operation of the whole acquisition platform.