Study on the Performance Support Vector Machine by Parameter Optimized

  • Conference paper
Advances in Software Engineering (ASEA 2008)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 30))

Abstract

With the quick increase of information and knowledge, automatically classifying text documents is becoming a hotspot of knowledge management. Standard machine learning techniques like support vector machines(SVM) and related large margin methods have been successfully applied for this task. Unfortunately, the high dimensionality of input feature vectors impacts on the classification speed. The kernel parameters setting for SVM in a training process impacts on the classification accuracy. Feature selection is another factor that impacts classification accuracy. The objective of this work is to reduce the dimension of feature vectors, optimizing the parameters to improve the SVM classification accuracy and speed. In order to improve classification speed we spent rough sets theory to reduce the feature vector space. We present a genetic algorithm approach for feature selection and parameters optimization to improve classification accuracy. Experimental results indicate our method is more effective than traditional SVM methods and other traditional methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Burges, C.: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2(2), 121–167 (1998)

    Article  Google Scholar 

  2. Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines (2001), http://www.csie.ntu.edu.tw/~cjlin/libsvm

  3. Cristianini, N., Shawe-Taylor, J.: An introduction to support vector machines, pp. 100–103. Cambridge University Press, Cambridge (2000)

    Google Scholar 

  4. Pal, S.K., Skowron, A.: Rough Fuzzy Hybridization: A New Trend in Decision-Making, pp. 36–70. Springer, Singapore (1983)

    Google Scholar 

  5. Pawlak, Z.: Rough sets. Int. J. Comput. Sci. 11, 341–356 (1982)

    Article  MATH  MathSciNet  Google Scholar 

  6. Pawlak, Z.: Rough Sets, Theoretical Aspects of Reasoning About Data, pp. 10–50. Kluwer, Dordrecht (1991)

    MATH  Google Scholar 

  7. Pawlak, Z., Skowron, A.: Rough membership functions. In: Yaeger, R.R., Fedrizzi, M., Kacprzyk, J. (eds.) Advances in the Dempster Shafer Theory of Evidence, pp. 251–271. Wiley Inc., Chichester (1994)

    Google Scholar 

  8. Pawlak, Z., Wong, S.K.M., Ziarko, W.: Rough sets: probabilistic versus deterministic approach. Int. J. Man-Mach. Stud. 29, 81–85 (1988)

    Article  MATH  Google Scholar 

  9. Davis, L.: Handbook of genetic algorithms, pp. 55–61. Nostrand Reinhold, New York (1991)

    Google Scholar 

  10. Goldberg, D.E.: Genetic algorithms in search, optimization and machine learning, pp. 23–32. Addison-Wesley, Reading (1989)

    MATH  Google Scholar 

  11. Grefenstette, J.J.: Genetic algorithms for machine learning, pp. 100–106. Kluwer, Boston (1994)

    Google Scholar 

  12. Vapnik, V.N.: The nature of statistical learning theory, pp. 61–70. Springer, New York (1995)

    MATH  Google Scholar 

  13. Frohlich, H., Chapelle, O.: Feature selection for support vector machines by means of genetic algorithms. In: Proceedings of the 15th IEEE international conference on tools with artificial intelligence, Sacramento, CA, USA, pp. 142–148 (2003)

    Google Scholar 

  14. Yu, G.X., Ostrouchov, G., Geist, A., Samatova, N.F.: An SVMbased algorithm for identification of photosynthesis-specific genome features. In: Second IEEE computer society bioinformatics conference, CA, USA, pp. 235–243 (2003)

    Google Scholar 

  15. Bradley, P.S., Mangasarian, O.L., Street, W.N.: Feature selection via mathematical programming. INFORMS Journal on Computing 10, 209–217 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  16. Hsu, C.W., Chang, C.C., Lin, C.J.: A practical guide to support vector classification (2003), http://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf

  17. LaValle, S.M., Branicky, M.S.: On the relationship between classical grid search and probabilistic roadmaps. International Journal of Robotics Research 23, 673–692 (2002)

    Google Scholar 

  18. Joachims, T.: Text categorization with support vector machines. In: Proceedings of European conference on machine learning (ECML), Chemintz, DE, pp. 137–142 (1998)

    Google Scholar 

  19. Pontil, M., Verri, A.: Support vector machines for 3D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(6), 637–646 (1998)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Liao, J., Bai, R. (2009). Study on the Performance Support Vector Machine by Parameter Optimized. In: Kim, Th., Fang, WC., Lee, C., Arnett, K.P. (eds) Advances in Software Engineering. ASEA 2008. Communications in Computer and Information Science, vol 30. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10242-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-10242-4_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-10241-7

  • Online ISBN: 978-3-642-10242-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation