Abstract
Problems such as cold startup, accuracy, and scalability are faced by traditional collaborative filtering recommendation algorithm if the system is expanded continuously. To resolve these issues, we propose a parallel collaborative filtering recommendation model on the basis of two-phase similarity (PCF-TPS) and weighted distance similarity measure (WDSM). In accordance with WDSM, the users’ similarity is calculated and their similarity matrix is obtained. At the same time, the items’ similarity is counted and its similarity matrix is got in line with Tanimoto Coefficient Similarity. For the users’ similarity matrix, their preferences are endowed with weights and in this way their new preferences matrix is received. In addition, the nearest neighbor item is found and a more accurate recommendation to the target user is given on the basis of the items’ similarity matrix and users’ new preferences matrix. Besides, in regard to the parallel computing framework, the parallel implementation of the model is completed. All these experiments are done on MovieLens dataset. The results show that PCF-TPS solves the problem of cold startup and increases the accuracy concerning CF. Compared with PCF-EV, PCF-TPS’s parallel realization can be improved to nearly 125 times on the whole. That is to say, it will be more meaningful to complex model using GPU than a small model. What’s more, PCF-EV’s distributed implementation is much more efficient than PCF-EV’s.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Breese, J.S., Heckerman, D., Kadie, C.: Empirical analysis of predictive algorithms for collaborative filtering. In: Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence, pp. 43–52. Morgan Kaufmann Publishers Inc.(1998)
Goldberg, D., Nichols, D., Oki, B.M., et al.: Using collaborative filtering to weave an information tapestry. Commun. ACM 35(12), 61–70 (1992)
Su, H., Wang, C., Zhu, Y. et al.: Parallel collaborative filtering recommendation model based on expand-vector. In: 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI), pp. 1–6. IEEE (2014)
Goldberg, K., Roeder, T., Gupta, D., et al.: Eigentaste: a constant time collaborative filtering algorithm. Inf. Retrieval 4(2), 133–151 (2001)
Miller, B.N., Konstan, J.A., PocketLens, R.J.: Toward a personal recommender system. ACM Trans. Inf. Syst. (TOIS) 22(3), 437–476 (2004)
Wang, C.Q., Su, H.Y., Zhu, Y. et al.: Distributed collaborative filtering recommendation model based on two-phase similarity. Future Communication, Information and Computer Science (2015)
Zhu, Y., Su, H.Y., Wang, C.Q., et al.: Distributed collaborative filtering recommendation model based on expand-vector. Adv. Mater. Res. 989, 2188–2191 (2014)
Zheng, N., Li, Q., Liao, S., et al.: Which photo groups should I choose? a comparative study of recommendation algorithms in Flickr. J. Inf. Sci. 36(6), 733–750 (2010)
Brynjolfsson, E., Hu, Y., Smith, M.D.: Consumer surplus in the digital economy: estimating the value of increased product variety at online booksellers. Manage. Sci. 49(11), 1580–1596 (2003)
Baluja, S., Seth, R., Sivakumar, D. et al.: Video suggestion and discovery for youtube: taking random walks through the view graph. In: Proceedings of the 17th International Conference on World Wide Web, pp. 895–904. ACM (2008)
Zhang, X., Li, Y.: Use of collaborative recommendations for web search: an exploratory user study. J. Inf. Sci. 34(2), 145–161 (2008)
Cong, L., Changyong, L.: Li21 M. A collaborative filtering recommendation algorithm based on domain nearest neighbor. Journal of Computer Research and Development (2008–09)
Dongyan, J., Fuzhi, Z.: A collaborative filtering recommendation algorithm based on double neighbor choosing strategy. J. Comput. Res. Dev. 5, 020 (2013)
Malucelli, F., Cremonesi, P., Rostami, B.: An application of bicriterion shortest paths to collaborative filtering. In: Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 423–429. IEEE (2012)
He, B., Fang, W., Luo, Q. et al.: Mars: a mapreduce framework on graphics processors. In: Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques, pp. 260–269. ACM (2008)
Dean, J., Ghemawat, S.: Mapreduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)
Borthakur, D.: HDFS architecture guide. Hadoop Apache Project, 53 (2008)
Krishnan, S., Tatineni, M., Baru, C.: myHadoop-Hadoop-on-Demand on Traditional HPC Resources. San Diego Supercomputer Center Technical report TR-2011–2, University of California, San Diego (2011)
Guo, G., Zhang, J., Thalmann, D.: Merging trust in collaborative filtering to alleviate data sparsity and cold start. Knowl.-Based Syst. 57, 57–68 (2014)
Choi, K., Suh, Y.: A new similarity function for selecting neighbors for each target item in collaborative filtering. Knowl.-Based Syst. 37, 146–153 (2013)
Wei, S., Ye, N., Zhang, S. et al.: Collaborative filtering recommendation algorithm based on item clustering and global similarity. In: 2012 Fifth International Conference on Business Intelligence and Financial Engineering (BIFE), pp. 69–72. IEEE (2012)
Zhao, Z.D, Shang, M.S.: User-based collaborative-filtering recommendation algorithms on hadoop. In: WKDD 2010 Third International Conference on Knowledge Discovery and Data Mining, pp. 478–481. IEEE (2010)
Ali, M., Johnson, C.C., Tang, A.K.: Parallel collaborative filtering for streaming data. University of Texas Austin, Technical report (2011)
Adamopoulos, P., Tuzhilin, A.: Recommendation opportunities: Improving item prediction using weighted percentile methods in collaborative filtering systems. In: Proceedings of the 7th ACM Conference on Recommender systems, pp. 351–354. ACM (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Su, H., Lin, X., Wang, C., Yan, B., Zheng, H. (2015). Parallel Collaborative Filtering Recommendation Model Based on Two-Phase Similarity. In: Huang, DS., Bevilacqua, V., Premaratne, P. (eds) Intelligent Computing Theories and Methodologies. ICIC 2015. Lecture Notes in Computer Science(), vol 9225. Springer, Cham. https://doi.org/10.1007/978-3-319-22180-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-22180-9_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22179-3
Online ISBN: 978-3-319-22180-9
eBook Packages: Computer ScienceComputer Science (R0)