|
|||||
|
|
| 基于HMM的哈萨克语词性标注研究 | |
| 引用本文： | 侯呈风,古丽拉·阿东别克,陈景超. 基于HMM的哈萨克语词性标注研究[J]. 计算机应用与软件, 2012, 0(2): 31-33 |
| 作者姓名： | 侯呈风 古丽拉·阿东别克 陈景超 |
| 作者单位： | 新疆大学信息科学与工程学院 |
| 基金项目： | 国家自然科学基金(60763005);国家教育部、国家语委民族语言文字规范标准建设及信息化科研项目(MZ115-92) |
| 摘 要： | 词性标注在自然语言信息处理领域中扮演着重要角色,是句法分析、信息抽取、机器翻译等自然语言处理的基础,对于哈萨克语同样如此。在基于词典静态标注的基础上分析了隐马尔科夫模型HMM(H idden M arkovModel)模型参数的选取、数据平滑以及未登录词的处理方法,利用基于统计的方法对哈萨克语熟语料进行训练,然后用V iterb i算法实现词性标注。实验结果表明利用HMM进行词性标注的准确率有所提高。 |
| 关 键 词： | 隐马尔科夫模型 哈萨克语 词性标注 自然语言处理 |
RESEARCH ON KAZAKH PART-OF-SPEECH TAGGING BASED ON HIDDEN MARKOV MODELS |
|
| Hou Chengfeng Gulila Altenbek Chen Jingchao. RESEARCH ON KAZAKH PART-OF-SPEECH TAGGING BASED ON HIDDEN MARKOV MODELS[J]. Computer Applications and Software, 2012, 0(2): 31-33 | |
| Authors: | Hou Chengfeng Gulila Altenbek Chen Jingchao |
| Affiliation: | Hou Chengfeng Gulila Altenbek Chen Jingchao(School of Information Science and Engineering,Xinjiang University,Urumqi 830046,Xinjiang,China) |
| Abstract: | Part-of-speech(POS) tagging plays a key role in natural language information processing.It is the basis of natural language processing including syntactic parsing,information retrieval,and machine translation,etc.,and the same for Kazak as well.In the thesis we analyse the selection of HMM model parameters,data smoothing and the processing approach for new words based on static tagging on dictionary,and use statistics-based means to train mature Kazak corps;then we adopt the Viterbi algorithm to implement part-of-speech tagging.Experimental results show that the preciseness of POS tagging is improved with the use of HMM. |
| Keywords: | Hidden Markov model Kazak Part-of-speech tagging Natural language processing |
| 本文献已被 CNKI 等数据库收录！ | |