Abstract
While sentiment analysis has been widely used in public opinion to explore tendency of users for a target product from large online review data, less work focus on aspect-level or fine-grained sentiment analysis in which the polarity of not only the aspect of a target object but also the attribute of that given aspect should be determinated. Recent work regards aspect-level sentiment analysis as two separate tasks, i.e., aspect classification and sentiment analysis, and this pipeline method leads to error propagation. To address this issue, this paper proposes an improved multi-way matching deep neural network model for fine-grained sentiment analysis, which jointly models the two tasks in one phase and improves current attention by directly capturing past attention in the multi-round alignment architecture, so as to prevent error propagation and attention deficiency problems. Experimental results on fine-grained sentiment analysis data sets of catering industry indicate that the F1 score of this model in actual test set reaches 0.7302 and EM score 87.1973, which are higher than baseline DocRNN model by 3.8% and 0.88% in F1 and EM, and are higher than SVM by 15.4% and 25.6%, which verified that our model could effectively predict fine-grained sentiment and have better generalization performance.
Similar content being viewed by others
References
Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2(1–2):1–135
Song K, Gao W, Feng S et al (2017) Recommendation vs Sentiment Analysis: A Text-Driven Latent Factor Model for Rating Prediction with Cold-Start Awareness. In: The 26th international joint conference on artificial intelligence (IJCAI 2017)
Sirisha Devi J, Nandyala Siva Prasad, Vijaya Bhaskar Reddy P (2019) A novel approach for sentiment analysis of public posts. Innov Comput Sci Eng 32:161
Ahmad DK (2007) Sentiment polarity identification in financial news: a cohesion-based approach. In: Proceedings of the 45th annual meeting of the association of computational linguistics (ACL2007), Prague, pp 984–991
Elalfy D, Gad W, Ismail R (2015) Predicting best answer in community questions based on content and sentiment analysis. In: 2015 IEEE seventh international conference on intelligent computing and information systems (ICICIS). IEEE
Liu B (2012) Sentiment analysis and opinion mining. Synth Lect Hum Lang Technol 5(1):1–167
Ku LW, Liang YT, Chen HH (2006) Opinion extraction, summarization and tracking in news and blog corpora. In: Proceedings of AAAI’2006, pp 100–107
Gyamfi Y, Wiebe J, Mihalcea R, et al (2009) Integrating Knowledge for Subjectivity Sense Labeling. In: Human language technologies: the conference of the North American chapter of the association for computational linguistics. Association for computational linguistics
Esuli A, Sebastiani F (2007) PageRanking WordNet Synsets: an application to opinion mining. In: Proceeding of 2007 ACL, pp 424–431
Dong ZD (2010) HowNet knowledge database. http://www.keenage.com
Liu W, Zhu Y, Li C et al (2009) Research on building Chinese basic Sentiment lexicon. J Comput Appl (in Chinese) 29(10):2875–2877
Xu L, Lin H, Pan Y et al (2008) Constructing the affective lexicon ontology. J China Soc Sci Tech Inf (in Chinese) 27(2):180–185
Wiebe J, Breck E, Buckley C et al (2002) NRRC summer workshop on multi-perspective question answering
Quan CQ, Ren FJ (2009) Construction of a blog emotion corpus for chinese emotional expression analysis. In: 2009 proceedings of EMNLP, 2009, pp 1446–1454
Liao J, Li Y, Wang S (2016) The constitution of a fine-grained opinion annotated corpus on weibo. Lect Notes Artif Intel 2016:227–240
Wagner J, Arora P, Cortes S, Barman U, Bogdanova D, Foster J, Tounsi L (2014) Dcu: aspect-based polarity classification for semeval task 4. In: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), pp 223–229
Liao J, Wang S, Li D et al (2017) FREERL: fusion relation embedded representation learning framework for aspect extraction. Knowl Based Syst 135:9–17
Septiandri AA, Sutiono AP (2019) Aspect and opinion term extraction for aspect based sentiment analysis of hotel reviews using transfer learning. ar**v:1909.11879 [Cs]. Accessed 7 Nov 2019
Hu M, Zhao S, Guo H, Cheng R, Su Z (2019) Learning to detect opinion snippet for aspect-based sentiment analysis. https://arxiv.org/abs/1909.11297v1. Accessed 7 Nov 2019
Tang D, Qin B, Feng X, Liu T (2015) Target-dependent sentiment classification with long short term memory. Ar**v preprint 2015, ar**v:1512.01100
Huang B, Carley KM (2019) Parameterized convolutional neural networks for aspect level sentiment classification. https://arxiv.org/abs/1909.06276v1. Accessed 7 Nov 2019
Tang D, Qin B, Liu T (2016) Aspect level sentiment classification with deep memory network. ar**v e-prints 2016, ar**v:1605.08900
He, R, Lee WS, Ng HT, Dahlmeier D (2019) An interactive multi-task learning network for end-to-end aspect-based sentiment analysis. ar**v:1906.06906 [cs]. Accessed 7 Nov 2019
Li Y, Yin C, Wei T et al. (2019) A joint model for aspect-category sentiment analysis with contextualized aspect embedding. https://arxiv.org/abs/1908.11017v1. Accessed 7 Nov 2019
Peng H, Xu L, Bing L et al (2019) Knowing what, how and why: a near complete solution for aspect-based sentiment analysis. http://arxiv.org/abs/1911.01616 [Cs]. Accessed 7 Nov 2019
Dey L, Chakraborty S, Biswas A (2016) Sentiment analysis of review datasets using Naïve Bayes‘ and K–NN classifier. Int J Inf Eng Electron Bus 8(4):54–62
Turney PD (2002) Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of annual meeting of the association for computational linguistics, pp 417–424
Pang B, Lee L, Vaithyanathan S (2002) sentiment classification using machine learning techniques. In: Proceedings of the 2002 conference on empirical methods in natural language processing, ACL, pp 79–86
Tan C, Wei F, Wang W, Lv W, Zhou M (2018) Multiway attention networks for modeling sentence Pairs. In: Proceedings of the 27th international joint conference on artificial intelligence (IJCAI), pp 4411–4417
Lin Z, Feng M, Santos CND et al (2017) A structured self-attentive sentence embedding. In: Proceedings of the 5th international conference on learning representations (ICLR2017)
Wang W, Yang N, Wei F, Chang B, Zhou M (2017) Gated self-matching networks for reading comprehension and question answering. In: Association for computational linguistics (ACL)
Chen D, Fisch A, Weston J, Bordes A (2017) Reading Wikipedia to answer open-domain questions. ar**v:1704.00051 [cs]
Hu M, Peng Y, Huang Z et al (2018) Reinforced mnemonic reader for machine reading comprehension. In: Proceedings of the 27th international joint conference on artificial intelligence (IJCAI)
Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. In: Proceedings of the 53th annual meeting of the association for computational linguistics, ACL2015
Acknowledgements
This study was supported by the National Natural Science Foundation of China (Grant No. 61502288, 61632011, 61573231, 61403238, 61673248), the National Natural Science Foundation of Shanxi Provincial (Grant No. 201701D221101, 201901D111032), and the National High Technology Research and Development Program of China (Grant No. 2018YFB1005103). The authors would also like to thank the anonymous reviewers for their invaluable comments.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Guo, X., Zhang, G., Wang, S. et al. Multi-way matching based fine-grained sentiment analysis for user reviews. Neural Comput & Applic 32, 5409–5423 (2020). https://doi.org/10.1007/s00521-019-04686-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-019-04686-9