A collaborative filtering framework based on both local user similarity and global user similarity

Collaborative filtering as a classical method of information retrieval has been widely used in helping people to deal with information overload. In this paper, we introduce the concept of local user similarity and global user similarity, based on surprisal-based vector similarity and the application of the concept of maximin distance in graph theory. Surprisal-based vector similarity expresses the relationship between any two users based on the quantities of information (called surprisal) contained in their ratings. Global user similarity defines two users being similar if they can be connected through their locally similar neighbors. Based on both of Local User Similarity and Global User Similarity, we develop a collaborative filtering framework called LS&GS. An empirical study using the MovieLens dataset shows that our proposed framework outperforms other state-of-the-art collaborative filtering algorithms.     

A novel collaborative filtering approach for recommending ranked items

In recent years, Collaborative Filtering (CF) has proven to be one of the most successful techniques used in recommendation systems. Since current CF systems estimate the ratings of not-yet-rated items based on other items’ ratings, these CF systems fail to recommend products when users’ preferences are not expressed in numbers. In many practical situations, however, users’ preferences are represented by ranked lists rather than numbers, such as lists of movies ranked according to users’ preferences. Therefore, this study proposes a novel collaborative filtering methodology for product recommendation when the preference of each user is expressed by multiple ranked lists of items. Accordingly, a four-staged methodology is developed to predict the rankings of not-yet-ranked items for the active user. Finally, a series of experiments is performed, and the results indicate that the proposed methodology produces high-quality recommendations.     

A new approach for combining content-based and collaborative filters

With the development of e-commerce and the proliferation of easily accessible information, recommender systems have become a popular technique to prune large information spaces so that users are directed toward those items that best meet their needs and preferences. A variety of techniques have been proposed for performing recommendations, including content-based and collaborative techniques. Content-based filtering selects information based on semantic content, whereas collaborative filtering combines the opinions of other users to make a prediction for a target user. In this paper, we describe a new filtering approach that combines the content-based filter and collaborative filter to capitalize on their respective strengths, and thereby achieves a good performance. We present a series of recommendations on the selection of the appropriate factors and also look into different techniques for calculating user-user similarities based on the integrated information extracted from user profiles and user ratings. Finally, we experimentally evaluate our approach and compare it with classic filters, the result of which demonstrate the effectiveness of our approach.     

On the combination of user-based and item-based collaborative filtering

In this paper, we propose two new filtering algorithms which are a combination of user-based and item-based collaborative filtering schemes. The first one, Hybrid-Ib, identifies a reasonably large neighbourhood of similar users and then uses this subset to derive the item-based recommendation model. The second algorithm, Hybrid-CF, starts by locating items similar to the one for which we want a prediction, and then, based on that neighbourhood, it generates its user-based predictions. We start by describing the execution steps of the algorithms and proceed with extended experiments. We conclude that our algorithms are directly comparable to existing filtering approaches, with Hybrid-CF producing favorable or, in the worst case, similar results in all selected evaluation metrics.     

A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem

Collaborative filtering is one of the most successful and widely used methods of automated product recommendation in online stores. The most critical component of the method is the mechanism of finding similarities among users using product ratings data so that products can be recommended based on the similarities. The calculation of similarities has relied on traditional distance and vector similarity measures such as Pearson’s correlation and cosine which, however, have been seldom questioned in terms of their effectiveness in the recommendation problem domain. This paper presents a new heuristic similarity measure that focuses on improving recommendation performance under cold-start conditions where only a small number of ratings are available for similarity calculation for each user. Experiments using three different datasets show the superiority of the measure in new user cold-start conditions.     

A hybrid of sequential rules and collaborative filtering for product recommendation

Customers’ purchase behavior may vary over time. Traditional collaborative filtering (CF) methods make recommendations to a target customer based on the purchase behavior of customers whose preferences are similar to those of the target customer; however, the methods do not consider how the customers’ purchase behavior may vary over time. In contrast, the sequential rule-based recommendation method analyzes customers’ purchase behavior over time to extract sequential rules in the form: purchase behavior in previous periods ⇒ purchase behavior in the current period. If a target customer’s purchase behavior history is similar to the conditional part of the rule, then his/her purchase behavior in the current period is deemed to be the consequent part of the rule. Although the sequential rule method considers the sequence of customers’ purchase behavior over time, it does not utilize the target customer’s purchase data for the current period. To resolve the above problems, this work proposes a novel hybrid recommendation method that combines the segmentation-based sequential rule method with the segmentation-based KNN-CF method. The proposed method uses customers’ RFM (Recency, Frequency, and Monetary) values to cluster customers into groups with similar RFM values. For each group of customers, sequential rules are extracted from the purchase sequences of that group to make recommendations. Meanwhile, the segmentation-based KNN-CF method provides recommendations based on the target customer’s purchase data for the current period. Then, the results of the two methods are combined to make final recommendations. Experiment results show that the hybrid method outperforms traditional CF methods.     

Creating user-adapted Websites by the use of collaborative filtering

The information globalization induced by the rapid development of the Internet and the accompanying adoption of the Web throughout the society leads to Websites which reach large audiences. The diversity of the audiences and the need of customer retention require active Websites, which expose themselves in a customized or personalized way: We call those sites User-adapted Websites. New technologies are necessary to personalize and customize content. Information filtering can be used for the discovery of important content and is therefore a key-technology for the creation of user-adapted Websites.

In this article, we focus on the application of collaborative filtering for user-adapted Websites. We studied techniques for combining and integrating content-based filtering with collaborative filtering in order to address typical problems in collaborative filtering systems and to improve the performance. Other issues which are mentioned but only lightly covered include user interface challenges. To validate our approaches we developed a prototype user-adapted Website, the Active WebMuseum, a museum Website, which exposes its collection in a personalized way by the use of collaborative filtering.     

Property-based collaborative filtering for health-aware recommender systems

Recommender systems aim at solving the problem of information overload by selecting items (commercial products, educational assets, TV programs, etc.) that match the consumers’ interests and preferences. Recently, there have been approaches to drive the recommendations by the information stored in electronic health records, for which the traditional strategies applied in online shopping, e-learning, entertainment and other areas have several pitfalls. This paper addresses those problems by introducing a new filtering strategy, centered on the properties that characterize the items and the users. Preliminary experiments with real users have proved that this approach outperforms previous ones in terms of consumers’ satisfaction with the recommended items. The benefits are especially apparent among people with specific health concerns.     

Improving memory-based collaborative filtering via similarity updating and prediction modulation

Memory-based collaborative filtering (CF) makes recommendations based on a collection of user preferences for items. The idea underlying this approach is that the interests of an active user will more likely coincide with those of users who share similar preferences to the active user. Hence, the choice and computation of a similarity measure between users is critical to rating items. This work proposes a similarity update method that uses an iterative message passing procedure. Additionally, this work deals with a drawback of using the popular mean absolute error (MAE) for performance evaluation, namely that ignores ratings distribution. A novel modulation method and an accuracy metric are presented in order to minimize the predictive accuracy error and to evenly distribute predicted ratings over true rating scales. Preliminary results show that the proposed similarity update and prediction modulation techniques significantly improve the predicted rankings.     

Applying artificial immune systems to collaborative filtering for movie recommendation

Collaborative filtering is a widely used recommendation technique and many collaborative filtering techniques have been developed, each with its own merits and drawbacks. In this study, we apply an artificial immune network to collaborative filtering for movie recommendation. We propose new formulas in calculating the affinity between an antigen and an antibody and the affinity of an antigen to an immune network. In addition, a modified similarity estimation formula based on the Pearson correlation coefficient is also developed. A series of experiments based on MovieLens and EachMovie datasets are conducted, and the results are very encouraging.     

A collaborative filtering framework based on fuzzy association rules and multiple-level similarity

The rapid development of Internet technologies in recent decades has imposed a heavy information burden on users. This has led to the popularity of recommender systems, which provide advice to users about items they may like to examine. Collaborative Filtering (CF) is the most promising technique in recommender systems, providing personalized recommendations to users based on their previously expressed preferences and those of other similar users. This paper introduces a CF framework based on Fuzzy Association Rules and Multiple-level Similarity (FARAMS). FARAMS extended existing techniques by using fuzzy association rule mining, and takes advantage of product similarities in taxonomies to address data sparseness and nontransitive associations. Experimental results show that FARAMS improves prediction quality, as compared to similar approaches. Cane Wing-ki Leung is a PhD student in the Department of Computing, The Hong Kong Polytechnic University, where she received her BA degree in Computing in 2003. Her research interests include collaborative filtering, data mining and computer-supported collaborative work. Stephen Chi-fai Chan is an Associate Professor and Associate Head of the Department of Computing, The Hong Kong Polytechnic University. Dr. Chan received his PhD from the University of Rochester, USA, worked on computer-aided design at Neo-Visuals, Inc. in Toronto, Canada, and researched in computer-integrated manufacturing at the National Research Council of Canada before joining the Hong Kong Polytechnic University in 1993. He is currently working on the development of collaborative Web-based information systems, with applications in education, electronic commerce, and manufacturing. Fu-lai Chung received his BSc degree from the University of Manitoba, Canada, in 1987, and his MPhil and PhD degrees from the Chinese University of Hong Kong in 1991 and 1995, respectively. He joined the Department of Computing, Hong Kong Polytechnic University in 1994, where he is currently an Associate Professor. He has published widely in the areas of computational intelligence, pattern recognition and recently data mining and multimedia in international journals and conferences and his current research interests include time series data mining, Web data mining, bioinformatics data mining, multimedia content analysis,and new computational intelligence techniques.     

Multi-domain collaborative exploration mechanisms for query expansion in an agent-based filtering framework

Novice users often do not have enough domain knowledge to create good queries for searching information on-line. To help alleviate the situation, exploration techniques have been used to increase the diversity of the search results so that not only those explicitly asked will be returned, but also those potentially relevant ones will be returned too. Most existing approaches, such as collaborative filtering, do not allow the level of exploration to be controlled. Consequently, the search results can be very different from what is expected. We propose an exploration strategy that performs intelligent query processing by first searching usable old queries, and then utilising them to adapt the current query, with the hope that the adapted query will be more relevant to the user’s areas of interest. We applied the proposed strategy to the implementation of a personal information assistant (PIA) set up for user evaluation for 3 months. The experimental results showed that the proposed exploration method outperformed collaborative filtering, and mutation and crossover methods by around 25% in terms of the elimination of off-topic results.     

Collaborative information filtering in cooperative communities

Abstract Recently, large amounts of on-line information broadcast from private persons/corporations are available via the Internet. In particular, there are large amounts of on-line resources useful for learning which are currently underutilised due to the sheer volume of information available. The purpose of the study reported in this paper is to develop an information filtering system, which gathers, classifies, stores various kinds of information found on the Internet. The approach taken has been to create filters through the collaboration of members of a community. In this paper, a representation of personal interests and its acquisition method in the system are described.     

Opinion-enhanced collaborative filtering for recommender systems through sentiment analysis

The motivation of collaborative filtering (CF) comes from the idea that people often get the best recommendations from someone with similar tastes. With the growing popularity of opinion-rich resources such as online reviews, new opportunities arise as we can identify the preferences from user opinions. The main idea of our approach is to elicit user opinions from online reviews, and map such opinions into preferences that can be understood by CF-based recommender systems. We divide recommender systems into two types depending on the number of product category recommended: the multiple-category recommendation and the single-category recommendation. For the former, sentiment polarity in coarse-grained manner is identified while for the latter fine-grained sentiment analysis is conducted for each product aspect. If the evaluation frequency for an aspect by a user is greater than the average frequency by all users, it indicates that the user is more concerned with that aspect. If a user's rating for an aspect is lower than the average rating by all users, he or she is much pickier than others on that aspect. Through sentiment analysis, we then build an opinion-enhanced user preference model, where the higher the similarity between user opinions the more consistent preferences between users are. Experiment results show that the proposed CF algorithm outperforms baseline methods for product recommendation in terms of accuracy and recall.     

HQE: A hybrid method for query expansion

Query expansion methods have been extensively studied in information retrieval. This paper proposes a query expansion method. The HQE method employs a combination of ontology-based collaborative filtering and neural networks to improve query expansion. In the HQE method, ontology-based collaborative filtering is used to analyze semantic relationships in order to find the similar users, and the radial basis function (RBF) networks are used to acquire the most relevant web documents and their corresponding terms from these similar users’ queries. The method can improve the precision and only requires users to provide less query information at the beginning than traditional collaborative filtering methods.     

The impact of data obfuscation on the accuracy of collaborative filtering

Collaborative filtering (CF) is a widely-used technique for generating personalized recommendations. CF systems are typically based on a central storage of user profiles, i.e., the ratings given by users to items. Such centralized storage introduces potential privacy breach, since all the user profiles may be accessible by untrusted parties when breaking the access control of the centralized system. Hence, recent studies have focused on enhancing the privacy of CF users by distributing their user profiles across multiple repositories and obfuscating the user profiles to partially hide the actual user ratings. This work combines these two techniques and investigates the unavoidable side effect of data obfuscation: the reduction of the accuracy of the generated CF predictions. The evaluation, which was conducted using three different datasets, shows that considerable parts of the user profiles can be modified without observing a substantial decrease of the CF prediction accuracy. The evaluation also indicates what parts of the user profiles are required for generating accurate CF predictions. In addition, we conducted an exploratory user study that reveals positive attitude of users towards the data obfuscation.     

A structure-based approach for multimedia information filtering

While multimedia documents are sequentially presented to users, an information filtering (IF) system is useful to achieve a good retrieval performance in terms of both quality and efficiency. Conventional approaches for designing an IF system are based on the user's evaluation on information relevance degree (IRD), but ignore other attributes in system design such as relative importance of the data in a collection of multimedia documents. In this paper, we aim at developing a framework of designing structure-based multimedia IF systems, which incorporates the characteristics of the importance and relevance of multimedia documents. A method of calculating the values of relative importance degree of multimedia documents is proposed. Furthermore, these values are combined into the IRD of multimedia documents to improve the representation of user profiles. An illustrative example is given to demonstrate the proposed techniques.     

Cluster ensembles in collaborative filtering recommendation

Recommender systems, which recommend items of information that are likely to be of interest to the users, and filter out less favored data items, have been developed. Collaborative filtering is a widely used recommendation technique. It is based on the assumption that people who share the same preferences on some items tend to share the same preferences on other items. Clustering techniques are commonly used for collaborative filtering recommendation. While cluster ensembles have been shown to outperform many single clustering techniques in the literature, the performance of cluster ensembles for recommendation has not been fully examined. Thus, the aim of this paper is to assess the applicability of cluster ensembles to collaborative filtering recommendation. In particular, two well-known clustering techniques (self-organizing maps (SOM) and k-means), and three ensemble methods (the cluster-based similarity partitioning algorithm (CSPA), hypergraph partitioning algorithm (HGPA), and majority voting) are used. The experimental results based on the Movielens dataset show that cluster ensembles can provide better recommendation performance than single clustering techniques in terms of recommendation accuracy and precision. In addition, there are no statistically significant differences between either the three SOM ensembles or the three k-means ensembles. Either the SOM or k-means ensembles could be considered in the future as the baseline collaborative filtering technique.