Chinese New Word Identification: A Latent Discriminative Model with Global Features |
| |
| Authors: | Xiao Sun De-Gen Huang Hai-Yu Song Fu-Ji Ren |
| |
| Affiliation: | Xiao Sun~1,De-Gen Huang~2 Senior Member,CCF,Hai-Yu Song~1 and Fu-Ji Ren~3 Member,IEEE 1 School of Computer Science and Engineering,Dalian Nationalities University,Dalian 116600,China 2 School of Computer Science and Engineering,Dalian University of Technology,Dalian 116024,China 3 Department of Information Science and Intelligent Systems,Tokushima University,Tokushima 7708506,Japan |
| |
| Abstract: | Chinese new words are particularly problematic in Chinese natural language processing.With the fast development of Internet and information explosion,it is impossible to get a complete system lexicon for applications in Chinese natural language processing,as new words out of dictionaries are always being created.The procedure of new words identification and POS tagging are usually separated and the features of lexical information cannot be fully used.A latent discriminative model,which combines the strength... |
| |
| Keywords: | new word identification new words POS tagging conditional random fields hidden semi-CRF global fragment features |
| 本文献已被 CNKI 万方数据 SpringerLink 等数据库收录！ |
|
