基于知网的词语语义相似度改进算法研究

词语语义相似度计算在很多自然语言处理相关领域都有着广泛应用.基于知网的现有词语语义相似度计算方法未深入考虑同棵义原层次树的义原距离、义原深度、义原密度及主次关系的影响,致使相似度计算结果并不够精确.针对该问题,提出一种词语语义相似度改进算法,通过分析知网中的义项表达式和义原层次树,用集合的加权平均值代替了义项相似度最大...

Research on Improved Algorithm of Word Semantic Similarity Based on HowNet

Semantic similarity of words has been widely used in many fields related to NLP. Distance,depth,density of sememes on the same semantic hierarchy tree and the primary and secondary relationship between them,which are not considered deeply in existing algorithms of word semantic similarity on HowNet,so the results of similarity calculation are inaccurate enough.To solve the problem,the paper proposes improved algorithm of word semantic similarity based on HowNet,by analyzing the semiotic expression and semantic hierarchy tree in HowNet,weighted average of set is used to replace maximum sememe similarity,density of sememe is introduced into the new edge weight function,and the influence of sememe depth and sememe density on sememe similarity is restricted by the weight factor. Experimental results show that the accuracy of word semantic similarity is effectively improved,which is more reasonable than existing methods.