一种计算汉字串之间相关程度的新方法

本文提出了一种能更准确的反映两个汉字串之间相关程度的新概念——黏结度,并给出了其计算方法。该方法把需要计算相关程度的汉字串放在一个大环境中进行讨论,通过加入上下文信息来提高分词的准确度;另外,该方法在引用汉字词频时,增加了对动态词频的考虑,可以自动识别未登陆的专业词汇。文中同时给出了黏结度在分词领域中的应用实例。通过与前人提出的相关信息的方法相比较,这种计算方法能够解决分词中一些难于解决的问题并提高分词的精确度。

A New Method for Calculating Relativity of Chinese Strings

In this paper we put forward a new concept , the degree of cohering of Chinese strings , and it's computation. It's value reflects how close the two strings are interrelated. This method completely considered the environment of the Chinese strings and the local-use-frequency of the words. Its definition and the examples of applying it in word segmentation are presented。Compared with the method of mutual information the predecessors had put forward , this method can solve some difficult problems in word segmentation and improves the precision.