Abstract
User reviews contain many key phrases that are crucial for business understanding, but they are often obscured by the sheer volume of reviews. Extracting key phrases from user reviews could help to understand what users are concerned about and provide timely improvement suggestions. Current pattern-based methods for target phrase extraction usually analyze reviews at a coarse-grained level, making the extracted topics unfocused and useless. Hence, in order to address this issue, we proposed a fine-grained analysis approach (KFEA) to extract, cluster, and visualize key phrases from e-commerce reviews. In order to fully utilize the relevant information from comments, KFEA fuses the information like categories and ratings from a large volume of user reviews, and then extracts key phrases with the help of a pre-trained model. A method is also designed to cluster and visualize the extracted key phrases for business understanding. Our evaluation on 6,088 reviews from 6 products shows that KFEA can effectively extract key phrases and perform clustering and visualization. In particular, KFEA achieved an precision of 76.6% and a recall of 81.8% in extracting key phrases from manually annotated data. KFEA’s cross-categories effectiveness is also validated on 16,772 reviews from products like mobile phones, laptops, and furniture.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alamoudi, E.S., Alghamdi, N.S.: Sentiment classification and aspect-based sentiment analysis on yelp reviews using deep learning and word embeddings. J. Decis. Syst. 30, 259–281 (2021)
Cambria, E., Schuller, B., **a, Y., Havasi, C.: New avenues in opinion mining and sentiment analysis. IEEE Intell. Syst. 28, 15–21 (2013)
Chatterjee, S., Goyal, D., Prakash, A., Sharma, J.: Exploring healthcare/health-product ecommerce satisfaction: a text mining and machine learning application. J. Bus. Res. 131, 815–825 (2021)
Cheng, X., Zhou, M.: Study on effect of ewom: a literature review and suggestions for future research. In: 2010 International Conference on Management and Service Science, pp. 1–4 (2010)
Dai, H., Lai, P.T., Chang, Y.C., Tsai, R.T.H.: Enhancing of chemical compound and drug name recognition using representative tag scheme and fine-grained tokenization. J. Cheminform, 7, S14–S14 (2015)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. ar**v preprint ar**v:1810.04805 (2018)
Ghose, A., Ipeirotis, P.G.: Estimating the helpfulness and economic impact of product reviews: mining text and reviewer characteristics. IEEE Trans. Knowl. Data Eng. 23, 1498–1512 (2010)
Grootendorst, M.: Bertopic: Neural topic modeling with a class-based TF-IDF procedure. CoRR abs/ ar**v: 2203.05794 (2022)
Hong, W., Zheng, C., Wu, L., Pu, X.: Analyzing the relationship between consumer satisfaction and fresh e-commerce logistics service using text mining techniques. Sustainability 11, 3570–3586 (2019)
Huang, Z., Xu, W., Yu, K.: Bidirectional lstm-crf models for sequence tagging. ar**v preprint ar**v:1508.01991 abs/1508.01991 (2015)
Kohavi, R., et al.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: IJCAI, vol. 14, pp. 1137–1145 (1995)
Li, S., Liu, F., Zhang, Y., Zhu, B., Zhu, H., Yu, Z.: Text mining of user-generated content (ugc) for business applications in e-commerce: A systematic review. Mathematics 10, 1–27 (2022)
Li, S., Zhang, Y., Li, Y., Yu, Z.: The user preference identification for product improvement based on online comment patch. Electron. Commer. Res. 21, 423–444 (2021)
Mandal, S., Maiti, A.: Network promoter score (neps): an indicator of product sales in e-commerce retailing sector. Electron. Mark. 32, 1327–1349 (2022)
McInnes, L., Healy, J., Astels, S.: hdbscan: hierarchical density based clustering. J. Open Source Softw. 2, 205–206 (2017)
Munikar, M., Shakya, S., Shrestha, A.: Fine-grained sentiment classification using bert. In: 2019 Artificial Intelligence for Transforming Business and Society (AITB), vol. 1, pp. 1–5 (2019)
Nadeau, D., Sekine, S.: A survey of named entity recognition and classification. Lingvisticae Investigationes 30, 3–26 (2007)
Park, S., Kim, H.M.: Phrase embedding and clustering for sub-feature extraction from online data. J. Mech. Design 144, 054501-1-054501-10 (2022)
Reimers, N., Gurevych, I.: Sentence-bert: sentence embeddings using siamese bert-networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 3982–3992 (2019)
Röder, M., Both, A., Hinneburg, A.: Exploring the space of topic coherence measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 399–408 (2015)
Shoja, B.M., Tabrizi, N.: Customer reviews analysis with deep neural networks for e-commerce recommender systems. IEEE Access 7, 1–1 (2019)
Su, Y., Shen, Y.: A deep learning-based sentiment classification model for real online consumption. Front. Psychol. 13, 886982–886991 (2022)
Syed, S., Spruit, M.: Full-text or abstract? examining topic coherence scores using latent dirichlet allocation. In: 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA), pp. 165–174 (2017)
Tan, Y., Zhang, M., Liu, Y., Ma, S.: Rating-boosted latent topics: understanding users and items with ratings and reviews. In: IJCAI, vol. 16, pp. 2640–2646 (2016)
Vaswani, A., et al.: Attention is all you need. Adv. Neural. Inf. Process. Syst. 30, 5998–6008 (2017)
Wang, Y., Wang, J., Zhang, H., Ming, X., Shi, L., Wang, Q.: Where is your app frustrating users? In: Proceedings of the 44th International Conference on Software Engineering, pp. 2427–2439 (2022)
Xu, X.: What are customers commenting on, and how is their satisfaction affected? examining online reviews in the on-demand food service context. Decis. Support Syst. 142, 113467–113479 (2021)
Yadav, N.B.: Harnessing customer feedback for product recommendations: an aspect-level sentiment analysis framework. In: Human-Centric Intelligent Systems, pp. 1–11 (2023)
Acknowledgement
This work is supported by Hainan Provincial Key Research and Development Program (No. ZDYF2022GXJS230), and National Natural Science Foundation of China (No.61962017).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Huang, L., Yang, Y., Tang, X., Zhou, H., Ye, C. (2023). KFEA: Fine-Grained Review Analysis Using BERT with Attention: A Categorical and Rating-Based Approach. In: Yang, X., et al. Advanced Data Mining and Applications. ADMA 2023. Lecture Notes in Computer Science(), vol 14176. Springer, Cham. https://doi.org/10.1007/978-3-031-46661-8_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-46661-8_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46660-1
Online ISBN: 978-3-031-46661-8
eBook Packages: Computer ScienceComputer Science (R0)