Hyperclique Pattern Based Off-Topic Detection

  • Conference paper
Advances in Data and Web Management (APWeb 2007, WAIM 2007)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4505))

Abstract

This paper addresses the problem of detecting access to off-topic documents by exploiting user profiles. Existing methods usually store a few prototype off-topic documents as the profile and label their top nearest neighbors in the test set as suspects. This is based on the common assumption that nearby documents are from the same class. However, due to the inherent sparseness of high-dimensional space, a document and its nearest neighbors may not belong to the same class. To this end, we develop a hyperclique pattern based off-topic detection method for selecting which ones to label. Hyperclique patterns consider joint similarity among a set of objects instead of the traditional pairwise similarity. As a result, the objects from hypercliques are more reliable as seeds for classifying their neighbors. Indeed, our experimental results on real world document data favorably demonstrate the effectiveness of our technique over the existing methods in terms of detection precision.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Dept. of Justice of United States: Press releases (2006), http://www.usdoj.gov/criminal/cybercrime/

  2. Kumar, S., Spafford, E.H.: A pattern matching model for misuse intrusion detection. In: Proc. the 17th National Computer Security Conf., pp. 11–21 (1994)

    Google Scholar 

  3. Liao, Y., Vemuri, V.R.: Using text categorization techniques for intrusion detection. In: Proc. of the 11th USENIX Security Symp., pp. 51–59 (2002)

    Google Scholar 

  4. Chung, C.Y., Gertz, M., Levitt, K.: DEMIDS: A misuse detection system for database systems. In: Proc. the 3rd Int. IFIP TC-11 WG11.5 Working Conf. Integrity and Internal Control in Information Systems, pp. 159–178 (1999)

    Google Scholar 

  5. Goharian, N., Platt, A.: Detection using clustering query results. In: Proc. IEEE Int. Conf. Intelligence and Security Informatics, pp. 671–673 (2006)

    Google Scholar 

  6. Goharian, N., Ma, L.: On off-topic access detection in information systems. In: Proc. ACM CIKM, pp. 353–354 (2005)

    Google Scholar 

  7. Cathey, R., Ma, L., Goharian, N., Grossman, D.A.: Misuse detection for information retrieval systems. In: Proc. ACM CIKM, pp. 183–190 (2003)

    Google Scholar 

  8. Breunig, M.M., Kriegel, H.P., Ng, R.T., Sander, J.: LOF: Identifying density-based local outliers. In: Proc. ACM SIGMOD, pp. 93–104 (2000)

    Google Scholar 

  9. Ramaswamy, S., Rastogi, R., Shim, K.: Efficient algorithms for mining outliers from large data sets. In: Proc. ACM SIGMOD, pp. 427–438 (2000)

    Google Scholar 

  10. **ong, H., Tan, P.N., Kumar, V.: Mining strong affinity association patterns in data sets with skewed support distribution. In: Proc. IEEE ICDM, pp. 387–394 (2003)

    Google Scholar 

  11. Huang, Y., **ong, H., Wu, W., Zhang, Z.: A hybrid approach for mining maximal hyperclique patterns. In: Proc. IEEE ICTAI, pp. 354–361 (2004)

    Google Scholar 

  12. Aggarwal, C.C., Yu, P.S.: Outlier detection for high dimensional data. In: Proc. ACM SIGMOD, pp. 37–46 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Guozhu Dong Xuemin Lin Wei Wang Yun Yang Jeffrey Xu Yu

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer Berlin Heidelberg

About this paper

Cite this paper

Hu, T., Xu, Q., Yuan, H., Hou, J., Qu, C. (2007). Hyperclique Pattern Based Off-Topic Detection. In: Dong, G., Lin, X., Wang, W., Yang, Y., Yu, J.X. (eds) Advances in Data and Web Management. APWeb WAIM 2007 2007. Lecture Notes in Computer Science, vol 4505. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72524-4_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-72524-4_40

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-72483-4

  • Online ISBN: 978-3-540-72524-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation