SpringerLink
Log in

An improved image clustering algorithm based on Kernel method and Tchebychev orthogonal moments

  • Research Paper
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

In this paper, we introduce a new clustering algorithm called Improved Kernel Possibilistic Fuzzy C-Means algorithm (ImKPFCM), based on the kernel method and possibilistic approach. The proposed ImKPFCM algorithm corrects several FCM, PFCM and GPFCM algorithms shortcomings, reliably detects clustering centers and allows in addition to use Euclidean distance, the employment of other more powerful additional norms able to handle various complex situations. In this study, we applied ImKPFCM algorithm as a new image clustering method on the basis of Tchebychev orthogonal moments to extract feature vectors and then compared it with FCM, PFCM and GPFCM algorithms to evaluate its performance. The comparative study results applied to several image dataset, revealed that the ImKPFCM clustering algorithm improves the clustering accuracy over the FCM, PFCM and GPFCM methods. Therefore, we conclude that the ImKPFCM algorithm is more efficient and produces satisfactory image clustering results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Spain)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

This manuscript has associated real data in data UCI Machine Learning Repository, https://archive.ics.uci.edu/ml/index.php. The data used to support the findings of this study are available in: Coil-20: http://www.cs.columbia.edu/cave/software/softlib/coil-20.php. MPEG-7-CE: http://www.dabi.temple.edu/shape/mpeg7/dataset.html. ORL: http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.Html

References

  1. Rodriguez MZ et al (2019) Clustering algorithms: a comparative approach. PLoS ONE 14(1):e0210236

    Article  MathSciNet  Google Scholar 

  2. Clustering algorithm-an overview Science direct topics. https://www.sciencedirect.com/topics/engineering/clustering-algorithm

  3. Aslam Y, Santhi N, Ramasamy N, Ramar K (2020) A review on various clustering approaches for image segmentation. In 2020 fourth international conference on inventive systems and control (ICISC), pp 679–685, 8 Jan 2020

  4. Rajput K, Oza B (2017) A comparative study of classification techniques in data mining. Int J Creat Res Thoughts 5:154–163

    Google Scholar 

  5. Pérez-Suárez A, Martínez-Trinidad JF, Carrasco-Ochoa JA (2019) A review of conceptual clustering algorithms. Artif Intell Rev 52(2):1267–1296

    Article  Google Scholar 

  6. Alam A, Muqeem M, Ahmad S (2021) Comprehensive review on clustering techniques and its application on high dimensional data. Int J Comput Sci Netw Secur 21:237

    Google Scholar 

  7. Faizan M, Zuhairi MF, Ismail S, Sultan S (2020) Applications of clustering techniques in data mining: a comparative study. Int J Adv Comput Sci Appl (IJACSA). https://doi.org/10.14569/IJACSA.2020.0111218

    Article  Google Scholar 

  8. Gan G, Ma C, Wu J (2020) Data clustering: theory, algorithms, and applications. Soc Ind Appl Math

  9. Seising R (2015) On the history of fuzzy clustering: an interview with Jim Bezdek and Enrique Ruspini [History]. IEEE Syst Man Cybern Mag 1(1):20–48

    Article  Google Scholar 

  10. Ruspini EH, Bezdek JC, Keller JM (2019) Fuzzy clustering: a historical perspective. IEEE Comput Intell Mag 14(1):45–55

    Article  Google Scholar 

  11. Kumar S (2020) Understanding K-means, K-means++ and, K-medoids Clustering Algorithms. Toward data science 11. https://towardsdatascience.com/understanding-k-means-k-means-and-k-medoids-clustering-algorithms-ad9c9fbf47ca. Accessed 15 Apr 2021

  12. Keshava Reddy K, Mrudula K (2017) Hard and fuzzy clustering methods: a comparative study

  13. Rajan S (2020) Overview of clustering algorithms. https://towardsdatascience.com/overview-of-clustering-algorithms-27e979e3724d. Accessed 7 Apr 2022

  14. Fuzzy clustering algorithm-an overview. Science direct topics. https://www.sciencedirect.com/topics/computer-science/fuzzy-clustering-algorithm

  15. Djellali C, Moutacalli MT (2021) A comparative study on fuzzy clustering for cloud computing taking web service as a case. Procedia Comput Sci 184:622–627

    Article  Google Scholar 

  16. Gibran M, Nababan E, Sihombing P (2020) Analysis of face recognition with fuzzy C-means clustering image segmentation and learning vector quantization. In 2020 3rd international conference on mechanical, electronics, computer, and industrial technology (MECnIT), pp 188–193, June 2020

  17. Sajja VR, Kalluri HK (2021) Classification of brain tumors using fuzzy C-means and VGG16. Turk J Comput Math Educ (TURCOMAT) 12(9):2103–2113

    Google Scholar 

  18. Cebeci Z, Yildiz F (2015) Comparison of K-means and fuzzy C-means algorithms on different cluster structures. J Agric Inf 6(3):13–23

    Google Scholar 

  19. Ghosh S, Dubey SK (2013) Comparative analysis of K-means and fuzzy C-means algorithms. Int J Adv Comput Sci Appl (IJACSA). https://doi.org/10.14569/IJACSA.2013.040406

    Article  Google Scholar 

  20. Deng S (2020) Clustering with fuzzy C-means and common challenges. J Phys Conf Ser 1453(1):012137

    Article  Google Scholar 

  21. Rajkumar KV, Yesubabu A, Subrahmanyam K (2019) Fuzzy clustering and fuzzy c-means partition cluster analysis and validation studies on a subset of citescore dataset. Int J Electr Comput Eng (IJECE) 9(4):2760

    Article  Google Scholar 

  22. Lin P-L, Huang P-W, Kuo CH, Lai YH (2014) A size-insensitive integrity-based fuzzy c-means method for data clustering. Pattern Recognit 47(5):2042–2056

    Article  Google Scholar 

  23. Ozdemir O, Kaya AA (2019) Comparison of FCM, PCM, FPCM and PFCM algorithms in clustering methods. Afyon Kocatepe Üniversitesi Fen ve Mühendislik Bilimleri Dergisi 19(1):92–102

    Google Scholar 

  24. Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10(2):191–203

    Article  Google Scholar 

  25. Krishnapuram R, Keller JM (1996) The possibilistic C-means algorithm: insights and recommendations. IEEE Trans Fuzzy Syst 4(3):385–393

    Article  Google Scholar 

  26. Jafar OM, Sivakumar R (2012) A study on possibilistic and fuzzy possibilistic C-means clustering algorithms for data clustering. In 2012 international conference on emerging trends in science, engineering and technology (INCOSET), pp 90–95, Dec 2012

  27. Szilágyi L, Lefkovits S, Szilágyi SM (2019) Self-tuning possibilistic C-means clustering models. Int J Unc Fuzz Knowl Based Syst 27(Supp 01):143–159

    Article  MathSciNet  MATH  Google Scholar 

  28. Pal NR, Pal K, Keller JM, Bezdek JC (2005) A possibilistic fuzzy C-means clustering algorithm. IEEE Trans Fuzzy Syst 13(4):517–530

    Article  Google Scholar 

  29. Timm H, Borgelt C, Döring C, Kruse R (2004) An extension to possibilistic fuzzy cluster analysis. Fuzzy Sets Syst 147(1):3–16

    Article  MathSciNet  MATH  Google Scholar 

  30. Timm H, Kruse R (2002) A modification to improve possibilistic fuzzy cluster analysis. In 2002 IEEE World congress on computational intelligence. 2002 IEEE international conference on fuzzy systems. FUZZ-IEEE’02. Proceedings (Cat. No.02CH37291), vol 2. Honolulu, HI, USA, pp 1460–1465

  31. Askari S, Montazerin N, Zarandi MHF, Hakimi E (2017) Generalized entropy based possibilistic fuzzy C-means for clustering noisy data and its convergence proof. Neurocomputing 219:186–202

    Article  Google Scholar 

  32. Askari S, Montazerin N, Fazel Zarandi MH (2017) Generalized possibilistic fuzzy C-means with novel cluster validity indices for clustering noisy data. Appl Soft Comput 53:262–283

    Article  Google Scholar 

  33. Unzueta D (2021) Kernel methods: a simple introduction. https://towardsdatascience.com/kernel-methods-a-simple-introduction-4a26dcbe4ebd. Accessed 15 Oct 2021

  34. Johnson JE, Laparra V, Pérez-Suay A, Mahecha MD, Camps-Valls G (2020) Kernel methods and their derivatives: concept and perspectives for the earth system sciences. PLoS ONE 15(10):e0235885

    Article  Google Scholar 

  35. Wu X-H, Zhou J-J (2005) Possibilistic fuzzy c-means clustering model using kernel methods. In international conference on computational intelligence for modelling, control and automation and international conference on intelligent agents, web technologies and internet commerce (CIMCA-IAWTIC’06), vol 2, pp 465–470, Nov 2005

  36. Polap D, Woźniak M (2021) Image features extractor based on hybridization of fuzzy controller and meta-heuristic. In 2021 IEEE international conference on fuzzy systems (FUZZ-IEEE), pp 1–6, July 2021

  37. Camastra F (2006) Kernel methods for clustering. In: Apolloni B, Marinaro M, Nicosia G, Tagliaferri R (eds) Neural nets. Springer, pp 1–9

    Google Scholar 

  38. Nichita M-V, Paun M-A, Paun V-A, Paun V-P (2020) Image clustering algorithms to identify complicated cerebral diseases description and comparison. IEEE Access 8:88434–88442

    Article  Google Scholar 

  39. Bhatia S, Upadhyay J (2011) Image segmentation using fuzzy clustering algorithm

  40. Image segmentation by fuzzy and possibilistic clustering algorithms for the identification of microcalcifications-ScienceDirect. https://www.sciencedirect.com/science/article/pii/S1026309811000472

  41. Sankar K, Nirmala K (2015) Orthogonal features based classification of microcalcification in mammogram using Jacobi moments. Indian J Sci Technol. https://doi.org/10.17485/ijst/2015/v8i15/73229

    Article  Google Scholar 

  42. Wu Y, Yang P (2019) Chebyshev polynomials, moment matching, and optimal estimation of the unseen. Ann Statist 47(2):857–883

    Article  MathSciNet  MATH  Google Scholar 

  43. Kaur P, Pannu HS, Malhi AK (2019) Comprehensive study of continuous orthogonal moments—A systematic review. ACM Comput Surv 52(4):1–30

    Google Scholar 

  44. Discrete orthognal moment features using Chebyshev polynomials. https://www.researchgate.net/publication/29487108_Discrete_Orthognal_Moment_Features_Using_Chebyshev_Polynomials

  45. Bayraktar B, Bernas T, Robinson J, Rajwa B (2006) Image reconstruction from discrete Chebyshev moments via formation of lookup tables-art. no. 61424T. Proceedings of SPIE-the international society for optical engineering, vol 6142

  46. Mukundan R, Ong SH, Lee PA (2022) Discrete orthognal moment features using Chebyshev polynomials. University of Canterbury. Computer science and software engineering

  47. Kernel clustering algorithm. https://www.researchgate.net/publication/279902909_Kernel_clustering_algorithm

  48. Multiple kernel fuzzy clustering. IEEE Journals & Magazine. IEEE Xplore. https://ieeexplore.ieee.org/document/6031914

  49. Byju AP, Kumar A, Stein A, Kumar AS (2018) Combining the FCM classifier with various kernels to handle non-linearity of class boundaries. J Indian Soc Remote Sens 46(9):1519–1526

    Article  Google Scholar 

  50. Putri RA, Rustam Z, Pandelaki J (2019) Kernel based fuzzy C-means clustering for chronic sinusitis classification. IOP Conf Ser Mater Sci Eng 546(5):052060

    Article  Google Scholar 

  51. Wu Z, **e W, Yu J (2003) Fuzzy C-means clustering algorithm based on kernel method. In: Proceedings fifth international conference on computational intelligence and multimedia applications (ICCIMA), pp 49–54, Sept 2003

  52. Haridas K, Thanamani AS (2014) An efficient image clustering and content based image retrieval using fuzzy K means clustering algorithm. Int Rev Comput Softw (IRECOS) 9(1):147

    Article  Google Scholar 

  53. Gangodkar D (2021) A novel image retrieval technique based on semi supervised clustering. Multimed Tools Appl 80(28):35741–35769

    Google Scholar 

  54. Jain M, Singh SK (2018) An efficient content based image retrieval algorithm using clustering techniques for large dataset. In 2018 4th international conference on computing communication and automation (ICCCA), pp 1–5, Dec 2018

  55. Spång A (2017) Automatic image annotation by sharing labels based on image clustering

  56. Chester U, Ratsaby J (2013) Machine learning for image classification and clustering using a universal distance measure. In: Brisaboa N, Pedreira O, Zezula P (eds) Similarity search and applications. Springer, Heidelberg, pp 59–72

    Chapter  Google Scholar 

  57. Papakostas G, Karakasis EG, Koulouriotis D (2013) Orthogonal image moment invariants: highly discriminative features for pattern recognition applications. Image processing: concepts, methodologies, tools, and applications. pp 15–32

    Chapter  Google Scholar 

  58. Flusser J, Zitova B, Suk T (2009) Moments and moment invariants in pattern recognition. Wiley

    Book  MATH  Google Scholar 

  59. Qi S, Zhang Y, Wang C, Zhou J, Cao X (2021) A survey of orthogonal moments for image representation: theory, implementation, and evaluation. ACM Comput Surv 55(1):1–35

    Article  Google Scholar 

  60. Yang B, Tang W, Chen X (2019) Image reconstruction by orthogonal moments derived by the parity of polynomials. In: ICASSP 2019-2019 IEEE international conference on acoustics, speech and signal processing (ICASSP), p 1672–1676, May 2019

  61. Kaur P, Pannu HS (2018) Comprehensive review of continuous and discrete orthogonal moments in biometrics. Int J Comput Math Comput Syst Theory 3(2):64–91

    Article  MathSciNet  Google Scholar 

  62. Singh S, Urooj S (2018) Orthogonal moment extraction and classification of melanoma images

  63. Hunt O, Mukundan R (2004) A comparison of discrete orthogonal basis functions for image compression. https://www.semanticscholar.org/paper/A-Comparison-of-Discrete-Orthogonal-Basis-Functions-Hunt Mukundan/53c069d79bba82e5ba5d4763a31f4119a8fae4bf

  64. Hosaini SJ, Alirezaee S, Ahmadi M, Makki S (2013) Comparison of the Legendre, Zernike and pseudo-Zernike moments for feature extraction. In iris recognition, 2013 5th international conference on computational intelligence and communication networks, Sept 2013

  65. Siminovitch D (2019) Chebyshev Polynomials of a discrete variable and their physical applications

  66. Yap PT, Raveendran P, Ong SH (2001) Chebyshev moments as a new set of moments for image reconstruction, In IJCNN’01. International joint conference on neural networks. Proceedings (Cat. No.01CH37222), https://www.academia.edu/6958689/Chebyshev_moments_as_a_new_set_of_moments_for_image_reconstruction, Jan 2001

  67. Pankaja K, Suma V (2019) Leaf recognition and classification using Chebyshev moments. In: Bhateja V, Das S, Satapathy SC (eds) Smart intelligent computing and applications: proceedings of the second international conference on SCI 2018. Springer, pp 667–678

    Chapter  Google Scholar 

  68. Njionou Sadjang P, Koepf W, Foupouagnigni M (2015) On moments of classical orthogonal polynomials. J Math Anal Appl 424(1):122–151

    Article  MathSciNet  MATH  Google Scholar 

Download references

Funding

The authors received no specific funding for this work.

Author information

Authors and Affiliations

  1. Mechanical Engineering Laboratory, Faculty of Sciences and Techniques, Sidi Mohammed Ben Abdellah University, Fez, Morocco

    Souad Azzouzi & Ahmed EL Khalfi

  2. LISAC, Faculty of Sciences Dhar El Mehraz, Sidi Mohamed Ben Abdellah University, Fez, Morocco

    Amal Hjouji

  3. TI Laboratory, High School of Technology, Sidi Mohamed Ben Abdellah University, Fez, Morocco

    Jaouad EL-Mekkaoui

Authors
  1. Souad Azzouzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amal Hjouji
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jaouad EL-Mekkaoui
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ahmed EL Khalfi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Souad Azzouzi.

Ethics declarations

Conflict of interest

The authors declare that the essay serves no personal or organizational interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Azzouzi, S., Hjouji, A., EL-Mekkaoui, J. et al. An improved image clustering algorithm based on Kernel method and Tchebychev orthogonal moments. Evol. Intel. 16, 1237–1258 (2023). https://doi.org/10.1007/s12065-022-00734-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-022-00734-x

Keywords

Search

Navigation