Abstract
Clustering text data streams is an important issue in data mining community and has a number of applications such as news group filtering, text crawling, document organization and topic detection and tracing etc. However, most methods are similarity-based approaches and use the TF*IDF scheme to represent the semantics of text data and often lead to poor clustering quality. In this paper, we firstly give an improved semantic smoothing model for text data stream environment. Then we use the improved semantic model to improve the clustering quality and present an online clustering algorithm for clustering massive text data streams. In our algorithm, a new cluster statistics structure, cluster profile, is presented in which the semantics of text data streams are captured. We also present the experimental results illustrating the effectiveness of our technique.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aggarwal, C.C.: A Framework for Diagnosing Changes in Evolving Data Streams. In: Proc. ACM SIGMOD 2003, pp. 575–586 (2003)
Agrawal, C.C., Han, J., Wang, J., Yu, P.S.: A framework for clustering evolving data streams. In: Aberer, K., Koubarakis, M., Kalogeraki, V. (eds.) Databases, Information Systems, and Peer-to-Peer Computing. LNCS, vol. 2944, pp. 81–92. Springer, Heidelberg (2004)
Agrawal, C.C., Han, J., Wang, J., Yu, P.S.: A framework for projected clustering of high dimensional data streams. In: Jonker, W., Petković, M. (eds.) SDM 2004. LNCS, vol. 3178, pp. 852–863. Springer, Heidelberg (2004)
Aggarwal, C.C., Yu, P.S.: A Framework for Clustering Massive Text and Categorical Data Streams. In: Proc. SIAM conference on Data Mining, pp. 477–481 (2006)
Yang, Y., Pierce, T., Carbonell, J.: A study of retrospective and on-line event detection. In: Proc. ACM SIGIR 1998, pp. 28–36. ACM Press, New York (1998)
Zhong, S.: Efficient Streaming Text Clustering. Neural Networks 18(5-6), 790–798 (2005)
**aodan, Z., Zhou, X., Hu, X.: Semantic Smoothing for Model-based Document Clustering. In: Perner, P. (ed.) ICDM 2006. LNCS (LNAI), vol. 4065, pp. 1193–1198. Springer, Heidelberg (2006)
Zhou, X., Hu, X., Zhang, X., Lin, X., Song, I.-Y.: Context-Sensitive Semantic Smoothing for the Language Modeling Approach to Genomic IR. In: Proc. ACM SIGIR 2006, pp. 170–177 (2006)
Fung, G.P.C., Yu, J.X., Yu, P.S., Lu, H.: Parameter Free Bursty Events Detection in Text Streams. In: Draheim, D., Weber, G. (eds.) TEAA 2005. LNCS, vol. 3888, pp. 181–192. Springer, Heidelberg (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Liu, Y., Cai, J., Yin, J., Fu, A.WC. (2007). Clustering Massive Text Data Streams by Semantic Smoothing Model. In: Alhajj, R., Gao, H., Li, J., Li, X., Zaïane, O.R. (eds) Advanced Data Mining and Applications. ADMA 2007. Lecture Notes in Computer Science(), vol 4632. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73871-8_36
Download citation
DOI: https://doi.org/10.1007/978-3-540-73871-8_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73870-1
Online ISBN: 978-3-540-73871-8
eBook Packages: Computer ScienceComputer Science (R0)