首页 | 本学科首页   官方微博 | 高级检索  
     

注入注意力机制的深度特征融合新闻推荐模型
引用本文:刘羽茜,刘玉奇,张宗霖,卫志华,苗冉. 注入注意力机制的深度特征融合新闻推荐模型[J]. 计算机应用, 2022, 42(2): 426-432. DOI: 10.11772/j.issn.1001-9081.2021050907
作者姓名:刘羽茜  刘玉奇  张宗霖  卫志华  苗冉
作者单位:同济大学 电子与信息工程学院,上海 201804
基金项目:国家自然科学基金资助项目(61976160);
摘    要:现有新闻推荐模型在挖掘新闻特征和用户特征时,往往没有考虑所浏览新闻之间的关系、时序变化以及不同新闻对用户的重要性,从而缺乏全面性;同时,现有模型在新闻更细粒度的内容特征挖掘方面有欠缺.因此构建了一个能够全面而不冗余地进行用户表征并能提取新闻更细粒度片段特征的新闻推荐模型——注入注意力机制的深度特征融合新闻推荐模型.该模...

关 键 词:新闻推荐  自然语言处理  注意力机制  神经网络  时序预测
收稿时间:2021-06-01
修稿时间:2021-07-16

News recommendation model with deep feature fusion injecting attention mechanism
LIU Yuxi,LIU Yuqi,ZHANG Zonglin,WEI Zhihua,MIAO Ran. News recommendation model with deep feature fusion injecting attention mechanism[J]. Journal of Computer Applications, 2022, 42(2): 426-432. DOI: 10.11772/j.issn.1001-9081.2021050907
Authors:LIU Yuxi  LIU Yuqi  ZHANG Zonglin  WEI Zhihua  MIAO Ran
Affiliation:College of Electronic and Information Engineering,Tongji University,Shanghai 201804,China
Abstract:When mining news features and user features, the existing news recommendation models often lack comprehensiveness since they often fail to consider the relationship between the browsed news, the change of time series, and the importance of different news to users. At the same time, the existing models also have shortcomings in more fine-grained content feature mining. Therefore, a news recommendation model with deep feature fusion injecting attention mechanism was constructed, which can comprehensively and non-redundantly conduct user characterization and extract the features of more fine-grained news fragments. Firstly, a deep learning-based method was used to deeply extract the feature matrix of news text through the Convolutional Neural Network (CNN) injecting attention mechanism. By adding time series prediction to the news that users had browsed and injecting multi-head self-attention mechanism, the interest characteristics of users were extracted. Finally, a real Chinese dataset and English dataset were used to carry out experiments with convergence time, Mean Reciprocal Rank (MRR) and normalized Discounted Cumulative Gain (nDCG) as indicators. Compared with Neural news Recommendation with Multi-head Self-attention (NRMS) and other models, on the Chinese dataset, the proposed model has the average improvement rate of nDCG from -0.22% to 4.91% and MRR from -0.82% to 3.48%. Compared with the only model with negative improvement rate, the proposed model has the convergence time reduced by 7.63%. on the English dataset, the proposed model has the improvement rates reached 0.07% to 1.75% and 0.03% to 1.30% respectively on nDCG and MRR; At the same time this model always has fast convergence speed. Results of ablation experiments show that adding attention mechanism and time series prediction module is effective.
Keywords:news recommendation  natural language processing  attention mechanism  neural network  time series prediction  
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机应用》浏览原始摘要信息
点击此处可从《计算机应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号