混合策略的维吾尔语名词词干提取系统

通过对维吾尔语名词形态结构进行研究，构造了名词有限状态自动机（FSM）；针对自动机的缺陷使用最大熵模型给有限状态自动机加入了歧义词缀识别能力，根据维吾尔语的元音和谐特点，建立了基于规则和信道噪声模型的元音和谐处理方法。有机地结合以上三种方法构造出了基于规则和统计的名词词干提取方法。为了有效利用现有的资源，提高系统的性能，把基于词典的词干提取方法与规则和统计结合的名词词干提取方法相结合，从而开发出多种策略相结合的维吾尔语名词词干提取系统。该系统具有较强的鲁棒性，准确率保持95%以上。

Uyghur noun stemming system based on hybrid method

This paper researches on Uyghur noun stemming. Uyghur noun morphology has been studied, and generates Finite State Machine(FSM). The errors of FSM is studied. And according to the features of the errors, the FSM integrates with maximum entropy model to disambiguate the ambiguous suffixes. Finally, the noisy channel model is used to resolve the vowel neutralization. After establishing these three models, a rule and statistics based stemming method is proposed. In order to effectively make use of existing resources and improve system performance, dictionary-based approach is also integrated into the Uyghur noun stemming system. Thus, the system has a better performance and robustness, and the precision keeps over 95%.