基于相似度的网页标题抽取方法

目前网页标题的抽取方法大多结合HTML结构和标签特征进行抽取,但是这些方法并没有考虑标题与正文信息之间内容上的联系。该文提出一种基于相似度的网页标题抽取方法,该方法利用网页标题与正文信息之间的关系,通过计算语言“单位”之间的相似度和对应的权值,并引入HITS算法模型对权值进行调整,根据特定的选取方法抽取出真实标题。实验结果表明,该方法不仅对“非标准网页”的抽取达到满意的效果,而且对“标准网页”具有较高的泛化能力。

Title Extraction from HTML Documents Based on Similarity

Most of the methods for title extraction from HTML documents are based on the structure of HTML document or the features of label. They do not considered the correlation between the title and the content. This paper proposes a method of title extraction from HTML documents based on similarity, which makes full use of the correlation between the title and the main body. The similarity between units are calculated and adjusted by the HITS algorithm. Then the “real title” is extracted in a series of steps. Experimental results show that this method performs well for “nonstandard HTML document” and has good generalization ability for “standard HTML document”.
Key wordstitle extraction;similarity;Web information retrieval