首页 | 本学科首页   官方微博 | 高级检索  
     

基于DIV标签树的网页主题信息抽取方法①
引用本文:欧阳柳波,杨柱,易显.基于DIV标签树的网页主题信息抽取方法①[J].计算机系统应用,2010,19(7):193-196.
作者姓名:欧阳柳波  杨柱  易显
作者单位:湖南大学,软件学院,湖南,长沙,41008Z
摘    要:随着CSS+DIV布局方式逐渐成为网页结构布局的主流,对此类网页进行高效的主题信息抽取已成为专业搜索引擎的迫切任务之一。提出一种基于DIV标签树的网页主题信息抽取方法,首先根据DIV标签把HTML文档解析成DIV森林,然后过滤掉DIV标签树中的噪声结点并且建立STU-DIV模型树,最后通过主题相关度分析和剪枝算法,剪掉与主题信息无关的DIV标签树。通过对多个新闻网站的网页进行分析处理,实验证明此方法能够有效地抽取新闻网页的主题信息。

关 键 词:主题信息抽取  DIV标签树  STU—DIV模型树  主题相关度  剪技算法
收稿时间:2009/11/8 0:00:00
修稿时间:2009/12/9 0:00:00

A New Way of Extracting the Topic Information in Web Pages Based on DIV Tag-tree
OU YANG Liu-Bo,YANG Zhu and YI Xian.A New Way of Extracting the Topic Information in Web Pages Based on DIV Tag-tree[J].Computer Systems& Applications,2010,19(7):193-196.
Authors:OU YANG Liu-Bo  YANG Zhu and YI Xian
Affiliation:(Software College, Hunan University, Changsha 410082, China)
Abstract:Since CSS+DIV Topological Mode has become the major trend of the structural layout of web pages, the efficient extraction of the topic information in these web pages has become one of the urgent tasks for all professional surfing engines. This paper puts forward a new way of extracting the topic information in web pages based on the DIV tag-tree. It divides HTML files into DIV-forest with the help of DIV-tag. Then it filters the noise nodes in DIV tag-trees and sets up STU-DIV model-trees. Finally, it crops the DIV tag-trees irrelevant to the topic information by Topic Corelation Analysis and Cut-Tree Algorithm. It proves that this method can efficiently extract the topic information in web pages by analyzing several news web pages.
Keywords:extraction of topic information  DIV tag-tree  STU-DIV model-tree  topic corelation  Cut-Tree algorithm
本文献已被 维普 万方数据 等数据库收录!
点击此处可从《计算机系统应用》浏览原始摘要信息
点击此处可从《计算机系统应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号