Abstract
Life of any living being is impossible if it does not have the ability to differentiate between various things, objects, smell, taste, colors, etc. Human being is a good ability to classify the object easily such as different human face, images. This is time of the machine so we want that machine can do all the work like as a human, this is part of machine learning. Here this paper discusses the some important technique for the image classification. What are the techniques through which a machine can learn for the image classification task as well as perform the classification task with efficiently. The most known technique to learn a machine is SVM. Support Vector machine (SVM) has evolved as an efficient paradigm for classification. SVM has a strongest mathematical model for classification and regression. This powerful mathematical foundation gives a new direction for further research in the vast field of classification and regression. Over the past few decades, various improvements to SVM has appeared, such as twin SVM, Lagrangian SVM, Quantum Support vector machine, least square support vector machine, etc., which will be further discussed in the paper, led to the creation of a new approach for better classification accuracy. For improving the accuracy as well as performance of SVM, we must aware of how a kernel function should be selected and what are the different approaches for parameter selection. This paper reviews the different computational model of SVM and key process for the SVM system development. Furthermore provides survey on their applications for image classification.
Similar content being viewed by others
References
Cortes C, and Vapnik V (1995) Support-vector network. Mach Learn 20(3):273–297
Tomar D, Agarwal S (2015) A comparison on multi-class classification methods based on least squares twin support vector machine. Knowl-Based Syst 81:131–147
Mangasarian OL, Musicant DR (2001) Lagrangian support vector machines. J Mach Learn Res 1:161–177
**ang Z, XueqiangLv, Zhang K (2014) An Image Classification Method Based On Multi-feature Fusion and Multi-kernel SVM. In: Seventh International Symposium on Computational Intelligence and Design, Hangzhou, p 49–52
Hsu C-W, Lin C-J (2012) A comparison of methods for multi-class support vector machines. IEEE Trans Neural Networks 13(2):415–425
Milgram J, Cheriet M, Sabourin R (2006) One Against One or One Against All: Which One is Better for Handwriting Recognition with SVMs. In: Tenth International Workshop on Frontiers in Handwriting Recognition, Oct 2006, La Baule (France), Suvisoft,
Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vectormachine for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910
Han J, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann Publishers, USA
Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46:389–422
Prajapati GL,and Patle A(2010) On Performing Classification Using SVM with Radial Basis and Polynomial Kernel Functions. In: Third International Conference on Emerging Trends in Engineering and Technology, p 512–515
Kuo B-C, Ho H-H, Li C-H, Hung C-C, Taur J-S (2014) A kernel-based feature selection method for SVM with RBF kernel for hyperspectral image classification. IEEE J sel Topic Appl Earth Observ Remote Sens 7(1):317–326
Morariu D, Vintan LN, Volker Tresp V (2006) Feature selection methods for an improved SVM classifier. Trans Eng 14:83–89
Huang C, Chen M, Wang C (2007) Credit scoring with a data mining approach based on SVMs. National Kaohsiung First university of Science and Technology, Department of Information Management, Nantz District, pp 847–856
Lin W, Lee Z, Lee S (2008) Parameter determination of support vector machine and feature selection using simulated annealing approach. Applied Soft Comput 8:1505–1512
Wang Z, Zhu C, Niu Z, Gao D, Feng X (2014) Multi-kernel classification machine with reduced complexity. Knowl-Based Syst 65:83–95
Scholkopf B, Burges CJC, Smola AJ (1999) Advances in kernel methods: support vector learning. MIT Press, Cambridge
Du P, Tan K, **ng X (2010) Wavelet SVM in reproducing kernel hilbert space for hyper-spectral remote sensing image classification. Opt Commun 283(24):4978–4984
Haar A (1910) Zurtheorie der orthogonalen funktionen systeme. Math Ann 69:331–371
Graps A (1995) An Introduction to Wavelets. IEEE Comput Sci Eng 2(2):50–61
Agarwal E, Gupta S, Chandra MA (2014) Data hiding using lazy wavelet transform strategy. IJCA Proceedings on International Conference on Advances in Computer Engineering and Applications. ICACEA 5:5–8
Wickerhauser MV (1992) Acoustic signal compression with wave packets: wavelets: a tutorial in theory and applications. Academic Press Professional, San Diego, pp 679–700
Myint SW, Zhu T, Zheng B (2015) A novel image classification algorithm using over complete wavelet transforms. IEEE Geosci Remote Sens Lett 12(6):1232–1236
Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) Classification of healthcare data using genetic fuzzy logic system and wavelets. Expert Syst Appl 42:2184–2197
Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) Medical data classification using interval type-2 fuzzy logic system and wavelets. Applied Soft Comput 30:812–822
Tan Y, Li G, Duan H, Li C (2014) Enhancement of medical image details via wavelet homomorphic filtering transform. J Intell Syst 23(1):83–94
McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5:115–133
Rosenblatt F (1957) The perceptron—a perceiving and recognizing automaton. Cornell aeronautical laboratory, report number: 85-460-1
Kohonen T (1982) Self-organized formation of topologically correct feature maps. Biol Cybern 43:59–69
Broomhead D S, lowe D (1988) Radial basis functions, multi-variable functional interpolation and adaptive networks, royal signals and radar establishment memorandum No. 4148, 38
Widrow B, Hoff ME (1960) Adaptive switching circuits. IRE WESCON Conven Rec 4:96–104
Rumelhart DE, McClelland JL (eds) (1986) Parallel distributed processing: explorations in the microstructure of cognition, vol 1. MIT Press, Cambridge
Broomhead DS, Lowe D (1988) Multivariable function interpolation and adaptive networks. Complex Syst 2:321–355
Weston J, Mukherjee S, Chapelle O, Pontil M, Poggio T, Vapnik V (2000) Feature Selection for SVMs. In: Proceeding NIPS’00 Proceedings of the 13th International Conference on Neural Information Processing Systems. p 647–653
Chapelle O, Vapnik V, Bousquet O, Mukhetjee S (2000) Choosing kernel parameters for support vector machines. Mach Learn 46(1–3):131–159
Burbidge R, Buxton B (2001) An introduction to support vector machines for data mining. Computer Science Dept.,UCL, UK
Chi M, Feng R, Bruzzone L (2008) Classification of hyper-spectral remote-sensing data with primal SVM for small-sized training dataset problem. Adv Space Res 41:1793–1799
Tao S, Chen D, Zhao W (2009) pruning algorithm for multi-output LS-SVM and its application in chemical pattern classification. Chemometr Intell Lab Syst 96:63–69
Tanoori B, Azimifar Z, Shakibafar A, Katebi S (2011) Brain volumetry: an active contour model-based segmentation followed by SVM-based classification. Comput Biol Med 41:619–632
Sugumaran V, Ramchandran KI (2011) Effect of number of features on classification of roller bearing faults using SVM and PSVM. Expert Syst Appl 38:4088–4096
Liu Y-T, Zhang H-X, Li P-H (2011) Research on SVM-based MRI image segmentation. J China Univ Posts Telecommun 18(2):129–132
YANG L, YANG F, NOGUCHI N (2011) Apple Internal Quality Classification Using X-ray and SVM. In: Proceedings of the 18th World Congress The International Federation of Automatic Control IFAC Proceedings, Volume 44, Issue 1, January 2011, p 14145–14150 Milano (Italy)
Wang Z, Sun X (2011) Document classification algorithm based on MMP and LS-SVM. Advanced in Control Engineering and Information Science. Procedia Eng 15:1565–1569
Homaeinezhad MR, Tavakkoli E, Atyabi SA, Ghaffari A, Ebrahimpour R (2011) Synthesis of multiple-type classification algorithms for robust heart rhythm type recognition: neuro-svm-pnn learning machine with virtual QRS image-based geometrical features. Scientia Iranica B 18(3):423–431
Lo C-S, Wang C-M (2012) Support vector machine for breast MR image classification. Comput Math Appl 64:1153–1162
Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCs in mammogram imaging. Knowl-Based Syst 26:144–153
Yang Q, Liang J, Hub Z, **ng Z, Zhao H (2012) Automatic recognition of poleward moving auroras from all-sky image sequences based on HMM and SVM. Planet Space Sci 69(2012):40–48
**ang Z, Lv X, Zhang K (2014) An Image Classification method based on multi-feature fusion and multi-kernel SVM. In: 2014 seventh international symposium on computational intelligence and design, Hangzhou, p 49–52
Tang YY, Lu Y, Yuan H (2015) Hyper-spectral image classification based on three-dimensional scattering wavelet transform. IEEE Trans Geosci Remote Sens 53(5):2467–2480
Kumar B, Dikshit O (2015) Spectral-Spatial Classification of Hyper-spectral Imagery Based on Moment Invariants. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8(6):2457–2463
Goela S, Gaur M, Jain E (2015) Nature inspired algorithms in remote sensing image classification. Procedia Comput Sci 57:377–384
Peng J, Zhou Y, Chen CLP (2015) Region-kernel-based support vector machines for hyper-spectral image classification. IEEE Trans Geosci Remote Sens 53(9):4810–4824
Yang W, Yin X, **a G-S (2015) Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans Geosci Remote Sens 53(8):4472–4482
Wu Z, Liu J, Plaza A, Li J, Wei Z (2015) GPU implementation of composite kernels for hyper-spectral image classification. IEEE Geosci Remote Sens Lett 12(9):1973–1977
Song Y, Cai W, Huang H, Zhou Y, Feng DD, Wang Y, Fulham MJ, Chen M (2015) large margin local estimate with applications to medical image classification. IEEE Trans Med Imaging 34(6):1362–1377
Luo Y, Liu T, Tao D, Xu C (2015) Multiview matrix completion for multilabelimage classification. IEEE Trans Image Process 24(8):2355–2368
Yin H, Jiao X, Chai Y, Fang B (2015) Scene classification based on single-layer SAE and SVM. Expert Syst Appl 42:3368–3380
Sugamya K, Pabboju S, Babu S V (2016) A CBIR Classification Using Support Vector Machines. In: International Conference on Advances in Human Machine Interaction (HMI—2016)
Liu S, Chen X, Fan D, Chen X, Meng F, Huang Q (2016) 3D Smiling Facial Expression Recognition Based on SVM. In: 2016 IEEE International Conference on Mechatronics and Automation, Harbin, p 1661–1666
Oliva J T, Lee HD, Spolaôr N, Coy CSR, Wu FC (2016) Prototype system for feature extraction, classification and study of medical images. Expert Syst Appl 63 No. C, 267–283
Wei Z, Hoai M (2016) Region Ranking SVM for Image Classification. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, p 2987–2996
Ding J, Cao G, Meng D (2016) Classification of Tongue Images Based on Doublet SVM. In: International Symposium on System and Software Reliability (ISSSR), Shanghai, p 77–81
Sachdeva J, Kumar V, Gupta I, Khandelwal N, Ahuja CK (2016) A package-SFERCB-Segmentation, feature extraction, reduction and classification analysis by both SVM and ANN for brain tumors. Appl Soft Comput 47:151–167
Garali I, Adel M, Bourennane S, Guedj E (2016) Classification of positron emission tomography brain images using first and second derivative features. In: 2016 6th European Workshop on Visual Information Processing (EUVIP), Marseille, pp. 1-5.EUVIP 201, p 1–5
Park S, Lee HS, Kim J (2017) Seed growing for interactive image segmentation using SVM classification with geodesic distance. Electron Lett 53(1):22–24
Wang S, Liu Q, Zhu E, Porikli F, Yin J (2018) Hyperparameter selection of one-class support vector machine by self-adaptive data shifting. Pattern Recogn 74:198–211
Mahesh VGV, Raj ANJ (2018) Zernike moments and machine learning based gender classification using facial images. In: Abraham A, Cherukuri A, Madureira A, Muda A (eds) Proceedings of the Eighth International Conference on Soft Computing and Pattern Recognition (SoCPaR 2016). SoCPaR 2016. Advances in Intelligent Systems and Computing, vol 614. Springer, Cham
Priya C A, Balasaravanan T, Thanamani A S (2012) An efficient leaf recognition algorithm for plant classification using support vector machine. In: International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME-2012), Salem, Tamilnadu, p 428–432
Es-saady Y, Massi I El, Yassa I El, Mammass, D, A. Benazoun A (2016) Automatic recognition of plant leaves diseases based on serial combination of two SVM classifiers. In: 2016 International Conference on Electrical and Information Technologies (ICEIT), Tangiers, p 561–566
Tomar D, Agarwal S (2016) Leaf recognition for plant classification using direct acyclic graph based multi-class least squares twin support vector machine. Int J Image Graph 16(3):1650012
Lukic M, Tuba E, Tuba M (2017) Leaf recognition algorithm using support vector machine with Hu moments and local binary patterns. In: IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI), Herl’any p 000485–000490
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chandra, M.A., Bedi, S.S. Survey on SVM and their application in image classification. Int. j. inf. tecnol. 13, 1–11 (2021). https://doi.org/10.1007/s41870-017-0080-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41870-017-0080-1