基于小世界模型的中文文本主题分析

本文旨在研究如何基于小世界模型进行文本分割,确定片段主题,进而总结全文的中心主题,使文本的主题脉络呈现出来。为此首先证明由文本形成的词汇共现图呈现短路径,高聚集度的特性,说明小世界结构存在于文本中;然后依据小世界结构将词汇共现图划分为“簇”,通过计算“簇”在文本中所占的密度比重识别片段边界,使“簇”与片段对应起来;最后利用短路径,高聚集度的特性提取图“簇”的主题词,采取背景词汇聚类及主题词联想的方式将主题词扩充到待分析文本之外,尝试挖掘隐藏于字词表面之下的文本内涵。虽然国际上已有很多关于小世界结构及基于其上的应用研究,但利用小世界特性进行主题分析还是一个崭新的课题。实验表明,本文所给方法的结果明显好于其他方法,说明可以为下一步文本推理的工作提供有价值的预处理。

Topic Analysis of Chinese Text Based on Small World Model

The paper aims to perform topic spotting of segments based on text segmentation using small world structure.Main topic of the whole text is generalized and the skeleton of text shows itself.It is explained that the term co-occurrence graph of text is highly clustered and has short path length,which proves that texts have small world structure.Clusters in the small world structure are detected.The density of each cluster is computed to discover the boundary of a segment.Topic words are extracted from clusters of the graph.Words which are not distinctly in the analyzed text can be included to express the topics with the help of word clustering of background and topic words association.The signification behind the words are attempted to dig out.Although much research on applications of small world structure,it is a new task to analyze texts with the characteristics of small world.The experiments tell that the result of tests is far better than that of other methods.Valuable pre-processing is provided for next work of text reasoning.