| 回溯正向匹配中文分词算法 |
| |
| 引用本文： | 张劲松,袁健. 回溯正向匹配中文分词算法[J]. 计算机工程与应用, 2009, 45(22): 132-134. DOI: 10.3778/j.issn.1002-8331.2009.22.043 |
| |
| 作者姓名： | 张劲松 袁健 |
| |
| 作者单位： | 上海理工大学计算机与电气工程学院,上海,200093;上海理工大学计算机与电气工程学院,上海,200093 |
| |
| 摘 要： | 在最大匹配法（The Maximum Matching Method）的基础上，提出了一种回溯正向匹配（The Backtracking Matching Method）的中文分词方法。该方法首先对待切文本进行预处理，将文本分割成长度较短的细粒度文本；利用正向匹配、回溯匹配和尾词匹配来有效发现歧义字段；利用长词优先兼顾2词簇的方式对交集型歧义字段进行切分。最后对该算法进行的定性分析说明了该方法的先进性，从随机抽取大量语料实验结果上证明了该方法的有效性。
|
| 关 键 词： | 中文分词 最大匹配法 回溯匹配 交集型歧义 |
| 收稿时间： | 2008-05-15 |
| 修稿时间： | 2008-8-14 |
Backtracking matching Chinese segmentation method |
| |
| ZHANG Jin-song,YUAN Jian. Backtracking matching Chinese segmentation method[J]. Computer Engineering and Applications, 2009, 45(22): 132-134. DOI: 10.3778/j.issn.1002-8331.2009.22.043 |
| |
| Authors: | ZHANG Jin-song YUAN Jian |
| |
| Affiliation: | College of Computing & Electrical Engineering，University of Shanghai for Science and Technology，Shanghai 200093，China |
| |
| Abstract: | Chinese word segmentation methods of the backtracking matching method is proposed based on the maximum matching method.The text is pretreatment by the BM in the first,then,the text is cut into shorter lengths granular text;Ambiguity field is found effective by forward matching method,backtracking matching method and last words matching Method;Crossing ambiguity field is cut by Long term priorities and 2-words rules.In the last,the algorithm of the qualitative analysis shows that the method of the advanced n... |
| |
| Keywords: | Chinese word segmentation Maximum Matching(MM) methods backtracking matching crossing ambiguity |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
| 点击此处可从《计算机工程与应用》浏览原始摘要信息 |
|
点击此处可从《计算机工程与应用》下载免费的PDF全文 |
