Mining Data Streams with Skewed Distribution by Static Classifier Ensemble

  • Chapter
Opportunities and Challenges for Next-Generation Applied Intelligence

Part of the book series: Studies in Computational Intelligence ((SCI,volume 214))

Abstract

In many data stream applications, the category distribution is imbalanced. However, current research community on data stream mining focus on mining balanced data streams, without enough attention being paid to the study of mining skewed data streams. In this paper, we proposed an clustering-sampling based ensemble algorithm with weighted majority voting for learning skewed data streams. We made experiments on synthetic data set simulating skewed data streams. The experiment results show that clustering-sampling outperforms under-sampling, and that compared with single window, the proposed ensemble based algorithm has better classification performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Street, W.N., Kim, Y.S.: A streaming ensemble algorithm for large-scale classification. In: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 377–382. ACM, New York (2001)

    Google Scholar 

  2. Wang, H., Fan, W., Yu, P.S., Han, J.: Mining concept-drifting data streams using ensemble classifiers. In: 9th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, pp. 226–235. ACM, New York (2003)

    Google Scholar 

  3. Gao, J., Fan, W., Han, J., Yu, P.S.: A general framework for mining concept-drifting data streams with skewed distributions. In: Proc. 2007 SIAM Int. Conf. Data Mining (SDM 2007), Minneapolis, MN (2007)

    Google Scholar 

  4. Elkan, C.: The foundations of cost-sensitive learning. In: Proceedings of the 17th international joint conference on artificial intelligence (IJCAI 2001), pp. 973–978 (2001)

    Google Scholar 

  5. Drummond, C., Holte,R.: C4.5, class imbalance, and costsensitivity: why undersampling beats over-sampling. In: Proceedings of the ICML 2003 Workshop: Learning with Imbalanced DataSets II (2003)

    Google Scholar 

  6. Hongyu, G., Viktor Herna, L.: Learning from Imbalanced Data Sets with Boosting and Data Generation: The DataBoost-IM Approach. Newsletter of the ACM Special Interest Group on Knowledge Discovery and Data Mining 6(1) (2004)

    Google Scholar 

  7. Domingos, P., Hulten, G.: Mining High Speed Data Streams. In: 6th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, pp. 71–80. ACM, New York (2000)

    Chapter  Google Scholar 

  8. Fawcett, T.: An introduction to ROC analysis. Pattern Recognition Letters 27(8), 861–874 (2006)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Wang, Y., Zhang, Y., Wang, Y. (2009). Mining Data Streams with Skewed Distribution by Static Classifier Ensemble. In: Chien, BC., Hong, TP. (eds) Opportunities and Challenges for Next-Generation Applied Intelligence. Studies in Computational Intelligence, vol 214. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92814-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-92814-0_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-92813-3

  • Online ISBN: 978-3-540-92814-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Navigation