LinkMF: 结合Linked Data的协同过滤推荐算法

协同过滤(CF)是推荐系统中应用最为广泛的推荐算法之一,然而数据稀疏性和冷启动问题是协同过滤方法的两个主要挑战。由于Linked Data整合了关于实体的丰富且结构化的特征,可以作为额外的信息源来缓解以上两种挑战。该文中我们首次提出了结合Linked Data改进CF推荐算法,基于矩阵分解提出了一种新的CF模型——LinkMF,在保证推荐准确度的基础上利用Linked Data缓解数据稀疏性和冷启动问题。首先,我们从Linked Data中抽取项目的特征表示并为项目建模;然后提出新的相似度度量方法计算项目相似度;最后利用项目相似度约束和指导MF分解过程产生推荐。在MovielLens和YAGO标准数据集上的大量实验结果表明,LinkMF优于现有的一些CF方法,特别在缓解数据稀疏性和冷启动问题上取得很好地效果。     

Enhancing recommender systems by incorporating social information

Although recommendation techniques have achieved distinct developments over the decades,the data sparseness problem of the involved user-item matrix still seriously influences the recommendation quality.Most of the existing techniques for recommender systems cannot easily deal with users who have very few ratings.How to combine the increasing amount of different types of social information such as user generated content and social relationships to enhance the prediction precision of the recommender systems remains a huge challenge.In this paper,based on a factor graph model,we formalize the problem in a semi-supervised probabilistic model,which can incorporate different user information,user relationships,and user-item ratings for learning to predict the unknown ratings.We evaluate the method in two different genres of datasets,Douban and Last.fm.Experiments indicate that our method outperforms several state-of-the-art recommendation algorithms.Furthermore,a distributed learning algorithm is developed to scale up the approach to real large datasets.     

情景感知驱动的移动对象多模式轨迹预测技术综述

如何利用多源异构时空数据进行准确的轨迹预测并且反映移动对象的移动特性是轨迹预测领域的核心问题.现有的大多数轨迹预测方法是长序列轨迹模式预测模型,根据历史轨迹的特点进行预测,或将当前移动对象的轨迹位置放入时空语义场景根据历史移动对象轨迹预测位置.综述当前常用的轨迹预测模型和算法,涉及不同的研究领域.首先,阐述了多模式轨迹预测的主流工作,轨迹预测的基本模型类;其次,对不同类的预测模型进行总结,包括数学统计类、机器学习类、滤波算法,以及上述领域具有代表性的算法;再次,对情景感知技术进行了介绍,描述了不同领域的学者对情景感知的定义,阐述了情景感知技术所包含的关键技术点,诸如情景感知计算、情景获取和情景推理的不同类模型,分析了情景感知的不同分类、过滤、存储和融合以及它们的实现方法等.详细介绍了情景感知驱动的轨迹预测模型技术路线及各阶段任务的工作原理.给出了情景感知技术在真实场景中的应用,包括位置推荐,兴趣点推荐等,通过与传统算法对比,分析情景感知技术在此类应用中的优劣.详细介绍了情景感知结合LSTM (long short-term memory)技术应用于行人轨迹预测领域的新方法.最后,总结了...     

基于序贯三支神经网络的个性化推荐

虽然协同过滤可以实现用户的个性化推荐,但是大多数协同过滤及其改进模型未考虑用户和项目等特征,因而不能发掘样本间的非线性关系.与协同过滤相比,深度学习能挖掘丰富的用户兴趣模式,但网络拓扑结构是基于二支决策的方式,忽略了推荐样本的难易程度.为了增强模型的非线性表达,同时区分推荐样本的难易,受序贯三支决策的启发,提出序贯三支决策神经网络个性化推荐模型(personalized recommendation model based on sequential three-way decision with single feedforward neural network, STWD-SFNN-PR).首先,为了将高维稀疏特征向量映射为低维稠密的特征向量, STWD-SFNN-PR采用嵌入进行特征处理.其次,在增量式的网络结构中学习推荐样本,使用Adam优化网络参数,并返回难以推荐的样本.再次,利用序贯三支决策增加延迟决策的策略,并在不同的粒度层采用序贯的阈值,从而动态地实现难以推荐样本的划分.最后,为了验证模型的可行性和有效性,选择多种电影推荐数据集进行研究,并选择经典的神经网络推荐、经典的...     

Advances in Clustering Collaborative Filtering by means of Fuzzy C-means and trust

Several approaches for recommending products to the users are proposed in literature, and collaborative filtering has been proved to be one of the most successful techniques. Some issues related to the quality of recommendation and to computational aspects still arise (e.g., cold-start recommendations). In this paper, we investigate the application of model-based Collaborative Filtering (CF) techniques and in particular propose a clustering CF framework and two clustering CF algorithms: Item-based Fuzzy Clustering Collaborative Filtering (IFCCF) and Trust-aware Clustering Collaborative Filtering (TRACCF). We compare several approaches by means of Epinions, MovieLens, Jester, and Poste Italiane datasets (with real customers). Experimental results show an increased value of coverage of the recommendations provided by TRACCF without affecting recommendation quality. Moreover, trust information guarantees high level recommendation for different users.     

Multilayer Graph Node Kernels: Stacking While Maintaining Convexity

Nowadays, developing effective techniques able to deal with data coming from structured domains is becoming crucial. In this context kernel methods are the state-of-the-art tool widely adopted in real-world applications that involve learning on structured data. Contrarily, when one has to deal with unstructured domains, deep learning methods represent a competitive, or even better, choice. In this paper we propose a new family of kernels for graphs which exploits an abstract representation of the information inspired by the multilayer perceptron architecture. Our proposal exploits the advantages of the two worlds. From one side we exploit the potentiality of the state-of-the-art graph node kernels. From the other side we develop a multilayer architecture through a series of stacked kernel pre-image estimators, trained in an unsupervised fashion via convex optimization. The hidden layers of the proposed framework are trained in a forward manner and this allows us to avoid the greedy layerwise training of classical deep learning. Results on real world graph datasets confirm the quality of the proposal.     

Personalisation in web computing and informatics: Theories, techniques, applications, and future research

Recently, personalised search engines and recommendation systems have been widely adopted by users who require assistance in searching, classifying, and filtering information. This paper presents an overview of the field of personalisation systems and describes current state-of-the-art methods and techniques. It reviews approaches for (1) user profiling, including behaviour, preference, and intention modelling; (2) content modelling, comprising content representation, analysis, and classification; and (3) filtering methods for recommendation, classified into four main categories: rule-based, content-based, collaborative, and hybrid filtering. The paper also discusses personalisation systems in different domains, and various techniques and their limitations. Finally, it identifies several issues and possible directions for further research that can improve recommendation capabilities and enhance personalised systems.     

Collaborative filtering with interlaced generalized linear models

Collaborative filtering (CF) is a data analysis task appearing in many challenging applications, in particular data mining in Internet and e-commerce. CF can often be formulated as identifying patterns in a large and mostly empty rating matrix. In this paper, we focus on predicting unobserved ratings. This task is often a part of a recommendation procedure. We propose a new CF approach called interlaced generalized linear models (GLM); it is based on a factorization of the rating matrix and uses probabilistic modeling to represent uncertainty in the ratings. The advantage of this approach is that different configurations, encoding different intuitions about the rating process can easily be tested while keeping the same learning procedure. The GLM formulation is the keystone to derive an efficient learning procedure, applicable to large datasets. We illustrate the technique on three public domain datasets.     

基于覆盖约简的个性化协同过滤推荐方法

协同过滤(CF)无法同时提供高精度和多样化的个性化推荐.基于此情况,文中提出基于覆盖约简的协同过滤方法(CRCF).结合覆盖粗糙集中的覆盖约简算法与CF中的用户约简,匹配覆盖中的冗余元素与邻近用户中的冗余用户,利用覆盖约简算法将冗余用户从目标用户的邻近用户中移除,保证CF中邻近用户的高效性.在公开数据集上的实验表明,在稀疏数据环境下,CRCF可以同时为目标用户提供高精度和多样化的个性化推荐.     

A correlative denoising autoencoder to model social influence for top-N recommender system

In recent years,there are numerous works been proposed to leverage the techniques of deep learning to improve social-aware recommendation performance.In most cases,it requires a larger number of data to train a robust deep learning model,which contains a lot of parameters to fit training data.However,both data of user ratings and social networks are facing critical sparse problem,which makes it not easy to train a robust deep neural network model.Towards this problem,we propose a novel correlative denoising autoencoder(CoDAE)method by taking correlations between users with multiple roles into account to learn robust representations from sparse inputs of ratings and social networks for recommendation.We develop the CoDAE model by utilizing three separated autoencoders to learn user features with roles of rater,truster and trustee,respectively.Especially,on account of that each input unit of user vectors with roles of truster and trustee is corresponding to a particular user,we propose to utilize shared parameters to learn common information of the units that corresponding to same users.Moreover,we propose a related regularization term to learn correlations between user features that learnt by the three subnetworks of CoDAE model.We further conduct a series of experiments to evaluate the proposed method on two public datasets for Top-N recommendation task.The experimental results demonstrate that the proposed model outperforms state-of-the-art algorithms on rank-sensitive metrics of MAP and NDCG.     

Weighted-Tau Rank: 一种采用加权Kendall Tau的面向排序的协同过滤算法

已知的面向排序的协同过滤算法主要有两个缺点:计算用户相似度时只考虑用户对同一产品对的偏好是否一致,而忽略了用户对产品对的偏好程度以及该偏好在用户间的流行度; 进行偏好融合和排序时需要中间步骤来构建价值函数然后才能利用贪婪算法产生推荐列表。为解决上述问题: 我们利用类TF-IDF加权策略对用户的偏好程度及偏好流行度进行综合考量,使用加权的Kendall Tau相关系数计算用户间的相似度;进行偏好融合与排序时则使用基于投票的舒尔茨方法直接产生推荐列表。在两个电影数据集上,本文提出的算法在评测指标NDCG上的效果要明显优于其他流行的协同过滤算法。     

Collaborative filtering and deep learning based recommendation system for cold start items

Recommender system is a specific type of intelligent systems, which exploits historical user ratings on items and/or auxiliary information to make recommendations on items to the users. It plays a critical role in a wide range of online shopping, e-commercial services and social networking applications. Collaborative filtering (CF) is the most popular approaches used for recommender systems, but it suffers from complete cold start (CCS) problem where no rating record are available and incomplete cold start (ICS) problem where only a small number of rating records are available for some new items or users in the system. In this paper, we propose two recommendation models to solve the CCS and ICS problems for new items, which are based on a framework of tightly coupled CF approach and deep learning neural network. A specific deep neural network SADE is used to extract the content features of the items. The state of the art CF model, timeSVD++, which models and utilizes temporal dynamics of user preferences and item features, is modified to take the content features into prediction of ratings for cold start items. Extensive experiments on a large Netflix rating dataset of movies are performed, which show that our proposed recommendation models largely outperform the baseline models for rating prediction of cold start items. The two proposed recommendation models are also evaluated and compared on ICS items, and a flexible scheme of model retraining and switching is proposed to deal with the transition of items from cold start to non-cold start status. The experiment results on Netflix movie recommendation show the tight coupling of CF approach and deep learning neural network is feasible and very effective for cold start item recommendation. The design is general and can be applied to many other recommender systems for online shopping and social networking applications. The solution of cold start item problem can largely improve user experience and trust of recommender systems, and effectively promote cold start items.     

General factorization framework for context-aware recommendations

Context-aware recommendation algorithms focus on refining recommendations by considering additional information, available to the system. This topic has gained a lot of attention recently. Among others, several factorization methods were proposed to solve the problem, although most of them assume explicit feedback which strongly limits their real-world applicability. While these algorithms apply various loss functions and optimization strategies, the preference modeling under context is less explored due to the lack of tools allowing for easy experimentation with various models. As context dimensions are introduced beyond users and items, the space of possible preference models and the importance of proper modeling largely increases. In this paper we propose a general factorization framework (GFF), a single flexible algorithm that takes the preference model as an input and computes latent feature matrices for the input dimensions. GFF allows us to easily experiment with various linear models on any context-aware recommendation task, be it explicit or implicit feedback based. The scaling properties makes it usable under real life circumstances as well. We demonstrate the framework’s potential by exploring various preference models on a 4-dimensional context-aware problem with contexts that are available for almost any real life datasets. We show in our experiments—performed on five real life, implicit feedback datasets—that proper preference modelling significantly increases recommendation accuracy, and previously unused models outperform the traditional ones. Novel models in GFF also outperform state-of-the-art factorization algorithms. We also extend the method to be fully compliant to the Multidimensional Dataspace Model, one of the most extensive data models of context-enriched data. Extended GFF allows the seamless incorporation of information into the factorization framework beyond context, like item metadata, social networks, session information, etc. Preliminary experiments show great potential of this capability.     

Exploiting interactions of review text,hidden user communities and item groups,and time for collaborative filtering

Rich side information concerning users and items are valuable for collaborative filtering (CF) algorithms for recommendation. For example, rating score is often associated with a piece of review text, which is capable of providing valuable information to reveal the reasons why a user gives a certain rating. Moreover, the underlying community and group relationship buried in users and items are potentially useful for CF. In this paper, we develop a new model to tackle the CF problem which predicts user’s ratings on previously unrated items by effectively exploiting interactions among review texts as well as the hidden user community and item group information. We call this model CMR (co-clustering collaborative filtering model with review text). Specifically, we employ the co-clustering technique to model the user community and item group, and each community–group pair corresponds to a co-cluster, which is characterized by a rating distribution in exponential family and a topic distribution. We have conducted extensive experiments on 22 real-world datasets, and our proposed model CMR outperforms the state-of-the-art latent factor models. Furthermore, both the user’s preference and item profile are drifting over time. Dynamic modeling the temporal changes in user’s preference and item profiles are desirable for improving a recommendation system. We extend CMR and propose an enhanced model called TCMR to consider time information and exploit the temporal interactions among review texts and co-clusters of user communities and item groups. In this TCMR model, each community–group co-cluster is characterized by an additional beta distribution for time modeling. To evaluate our TCMR model, we have conducted another set of experiments on 22 larger datasets with wider time span. Our proposed model TCMR performs better than CMR and the standard time-aware recommendation model on the rating score prediction tasks. We also investigate the temporal effect on the user–item co-clusters.     

一种基于文本卷积神经网络的推荐算法

传统的矩阵因子分解模型不能有效提取用户和物品特征,而基于深度学习模型可以很好地提取特征信息。当前,主流的基于深度学习推荐算法只是单一地将神经网络的输出或物品特征与用户特征乘积的形式来做推荐预测,不能充分挖掘用户和物品之间的关系。基于此,本文提出一种基于文本卷积神经网络与带偏置项的奇异值分解(BiasSVD)结合的推荐算法,利用文本卷积神经网络(TextCNN)来充分提取用户和物品的特征信息,然后用奇异值分解方法来做推荐,深层次理解文档上下文信息,进一步提高推荐的准确性。将该算法在MovieLens的2个真实数据集上做广泛的评估分析,推荐的准确度要明显优于ConvMF算法及主流深度学习推荐算法。     

一种基于用户情境聚类的个性化推荐算法

面向基于情境感知的推荐问题,提出一种基于用户情境聚类的个性化推荐算法。该算法利用情境预过滤的思想,首先运用模糊聚类的方法对历史数据集中用户的情境进行聚类,构造与当前用户情境相似度较高的用户集合,再与传统的基于用户的协同过滤算法相结合进行个性化推荐。实验采用公开数据集,结果表明该算法在多维情境信息条件下可用,并且推荐准确度要高于传统协同过滤算法,在聚类粒度不同的情况下对推荐结果也会产生不同的影响。     

A Novel Attention-based Global and Local Information Fusion Neural Network for Group Recommendation

Due to the popularity of group activities in social media, group recommendation becomes increasingly significant. It aims to pursue a list of preferred items for a target group. Most deep learning-based methods on group recommendation have focused on learning group representations from single interaction between groups and users. However, these methods may suffer from data sparsity problem. Except for the interaction between groups and users, there also exist other interactions that may enrich group representation, such as the interaction between groups and items. Such interactions, which take place in the range of a group, form a local view of a certain group. In addition to local information, groups with common interests may also show similar tastes on items. Therefore, group representation can be conducted according to the similarity among groups, which forms a global view of a certain group. In this paper, we propose a novel global and local information fusion neural network (GLIF) model for group recommendation. In GLIF, an attentive neural network (ANN) activates rich interactions among groups, users and items with respect to forming a group′s local representation. Moreover, our model also leverages ANN to obtain a group′s global representation based on the similarity among different groups. Then, it fuses global and local representations based on attention mechanism to form a group′s comprehensive representation. Finally, group recommendation is conducted under neural collaborative filtering (NCF) framework. Extensive experiments on three public datasets demonstrate its superiority over the state-of-the-art methods for group recommendation.

     

基于社交信任聚类的混合推荐算法

推荐系统能够有效地解决信息过载问题,其中,协同过滤（collaborative filtering,简称CF）是推荐系统广泛采用的技术之一.然而传统的CF技术存在可扩展性差、数据稀疏和推荐结果精度低等问题.为了提高推荐质量,将信任关系融合到推荐系统中,采用聚类（FCM）方法,对信任关系进行聚类.利用信任类预测用户间的隐式信任,最后将信任关系与用户-项目关系线性融合进行推荐.在Douban和Epinions数据集上的实验结果表明,与传统的基于CF、基于信任和用户项目聚类的推荐算法相比,该算法能够大幅度地改进推荐质量,提升算法的时间效率.     

基于双边兴趣的社交网好友推荐方法研究

随着社交网的广泛流行,用户的数量也急剧增加,针对社交网络用户难以在海量用户环境中快速发现其可能感兴趣的潜在好友的问题,各种推荐算法应运而生,协同过滤算法便是其中最为成功的思想。然而目前的协同过滤算法普遍存在数据稀疏性和推荐精度低等问题,为此提出一种基于动态K-means聚类双边兴趣协同过滤好友推荐算法。该算法结合动态K-means算法对用户进行聚类以降低稀疏性,同时提出相似度可信值的概念调整相似度计算方法以提高相似度精度;利用调整后的相似度分别从用户的吸引与偏好两方面计算近邻用户集,综合考虑这两方面近邻对当前用户的择友影响来生成推荐列表。实验证明,相较于基于用户的协同过滤算法,该算法能有效提高系统的推荐精度与效率。     

Leveraging clustering approaches to solve the gray-sheep users problem in recommender systems

Recommender systems apply data mining and machine learning techniques for filtering unseen information and can predict whether a user would like a given item. This paper focuses on gray-sheep users problem responsible for the increased error rate in collaborative filtering based recommender systems. This paper makes the following contributions: we show that (1) the presence of gray-sheep users can affect the performance – accuracy and coverage – of the collaborative filtering based algorithms, depending on the data sparsity and distribution; (2) gray-sheep users can be identified using clustering algorithms in offline fashion, where the similarity threshold to isolate these users from the rest of community can be found empirically. We propose various improved centroid selection approaches and distance measures for the K-means clustering algorithm; (3) content-based profile of gray-sheep users can be used for making accurate recommendations. We offer a hybrid recommendation algorithm to make reliable recommendations for gray-sheep users. To the best of our knowledge, this is the first attempt to propose a formal solution for gray-sheep users problem. By extensive experimental results on two different datasets (MovieLens and community of movie fans in the FilmTrust website), we showed that the proposed approach reduces the recommendation error rate for the gray-sheep users while maintaining reasonable computational performance.