SpringerLink
Log in

AFCGD: an adaptive fuzzy classifier based on gradient descent

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

In traditional fuzzy classification systems, learning is done from a stationary data distribution. In online rule learning, however, data are non-stationary and change dynamically over time. It confronts the learning process with some new challenges including concept drift. Evolving fuzzy schemes are common solutions in this field which try to handle these issues by in-time modification of their structures. In this regard, a basic challenge is how to apply a fast and simple scheme to modify the rule-base regarding each new sample. This paper introduces an efficient adaptive mechanism named adaptive fuzzy classifier based on gradient descent (AFCGD) for online learning of an evolving fuzzy model. We derive online rule update formulas for modification of the classifier’s structure regarding the concept of data to minimize the misclassification error through gradient descent. The updating formulas, which are computationally cheap, allow AFCGD to adjust the rule-base after emergence of new incoming sample. Therefore, it always remains up-to-date and can handle any alteration in the concept of data. AFCGD has simple structure to build; thus, it is so effective in memory usage and computational time. The efficacy of our proposed algorithm has been assessed by some synthetic data and several real-world benchmark problems while comparing with some recent evolving and state-of-the-art classifiers. The proposed method achieves comparable and even better results against other fuzzy and non-fuzzy classifiers in terms of accuracy and run-time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Almaksour A, Anquetil E (2010) Improving premise structure in evolving Takagi–Sugeno neuro-fuzzy classifiers. In: Ninth international conference on machine learning and applications (ICMLA), Washington, DC, USA, pp 25–33

  • Amin F, Fahmi A, Abdullah S, Ali A, Ahmad R, Ghani F (2018) Triangular cubic linguistic hesitant fuzzy aggregation operators and their application in group decision making. J Intell Fuzzy Syst 34:2401–2416

    Article  Google Scholar 

  • Angelov P (2010) Evolving Takagi–Sugeno fuzzy systems from data streams (eTS+). In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. IEEE Press series in Computational Intelligence, Wiley and IEEE Press, New York, USA, pp 21–50

  • Angelov P (2012) Autonomous learning systems from data streams to knowledge in real time. Wiley, West Sussex

    Book  Google Scholar 

  • Angelov PP, Filev D (2004) An approach to online identification of Takagi–Sugeno fuzzy models. IEEE Trans Syst Man Cybern Part B Cybern 34(1):484–498

    Article  Google Scholar 

  • Angelov PP, Filev D (2005) Simpl_eTS: a simplified method for learning evolving Takagi–Sugeno fuzzy models. IEEE, Reno

  • Angelov Filev DP, Kasabov N (2010) Evolving intelligent systems: methodology and applications. Wiley-IEEE Press, New York

    Book  Google Scholar 

  • Angelov PP, Zhou X (2008) Evolving fuzzy-rule-based classifiers from data streams. IEEE Trans Fuzzy Syst 16(6):1462–1475

    Article  Google Scholar 

  • Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) MOA: massive online analysis. J Mach Learn Res 99:1601–1604

    Google Scholar 

  • Bouchachia A, Mittermeir R (2007) Towards incremental fuzzy classifiers. Soft Comput 11(2):193–207

    Article  Google Scholar 

  • Chen Z, Liu B (2016) Lifelong machine learning. Morgan & Claypool Publishers, San Rafael

    Book  Google Scholar 

  • Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278

    Google Scholar 

  • Elton L, Gomide F, Ballini R (2006) Participatory evolving fuzzy modeling. In: International symposium on evolving fuzzy systems, Ambleside, UK, pp 36–41

  • Esmaeilpour M, Mohammadi ARA (2016) Analyzing the EEG signals in order to estimate the depth of anesthesia using wavelet and fuzzy neural networks. Int J Interact Multimed Artif Intell 4(2):12–15

    Google Scholar 

  • Fahmi A, Abdullah S, Amin F, Siddiqui N, Ali A (2017) Aggregation operators on triangular cubic fuzzy numbers and its application to multi-criteria decision making problems. J Intell Fuzzy Syst 33:3323–3337

    Article  Google Scholar 

  • Fahmi A, Abdullah S, Amin F, Ali A (2018) Weighted average rating (war) method for solving group decision making problem using triangular cubic fuzzy hybrid aggregation (TCFHA). Punjab Univ J Math 50(1):23–34

    MathSciNet  Google Scholar 

  • Fakhrahmad SM, Zolghadri Jahromi M (2009) A new rule-weight learning method based on gradient descent. In: Proceedings of the world congress on engineering, London, UK, pp 1–3

  • Gama J (2011) Knowledge discovery from data streams, 1st edn. Chapman and Hall/CRC, London

    MATH  Google Scholar 

  • Gama J, Medas P, Castillo G, Rodrigues P (2004) Learning with drift detection. In: SBIA Brazilian symposium on artificial intelligence, pp 286–295

  • Hamzeloo S, Zolghadri Jahromi M (2017) An incremental fuzzy controller for large dec-POMDPs. In: Artificial intelligence and signal processing conference (AISP), Shiraz, Iran

  • Harries M (1999) Splice-2 comparative evaluation: electricity pricing. Technical report, The University of South Wales

  • Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Upper Saddle River

    MATH  Google Scholar 

  • Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining (KDD-2001), San Francisco, CA, pp 97–106

  • Juang C-F, Tsao Y-W (2008) A self-evolving interval type-2 fuzzy neural network with on-line structure and parameter learning. IEEE Trans Fuzzy Syst 16(6):1411–1424

    Article  Google Scholar 

  • Kasabov N (2001) Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning. IEEE Trans Syst Man Cybern Part B Cybern 31(6):902–918

    Article  Google Scholar 

  • Kasabov N, Song Q (2002) DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10(2):144–154

    Article  Google Scholar 

  • Katakis I, Tsoumakas G, Banos E, Bassiliades N, Vlahavas I (2009) An adaptive personalized news dissemination system. J Intell Inf Syst 32(2):191–212

    Article  Google Scholar 

  • Liang N, Huang G, Saratchandran P, Sun N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423

    Article  Google Scholar 

  • Lima E, Hell M, Ballini R, Gomide F (2010) Evolving fuzzy modeling using participatory learning. In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York

    Google Scholar 

  • Lughofer E (2008a) Extensions of vector quantization for incremental clustering. Pattern Recognit 41(3):995–1011

    Article  MATH  Google Scholar 

  • Lughofer E (2008b) FLEXFIS: a robust incremental learning approach for evolving Takagi–Sugeno fuzzy models. IEEE Trans Fuzzy Syst 16(6):1393–1410

    Article  Google Scholar 

  • Lughofer E (2011) Evolving fuzzy systems—methodologies, advanced concepts and applications. Springer, Berlin

    Book  MATH  Google Scholar 

  • Lughofer E, Angelov PP (2011) Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Appl Soft Comput 11(2):2057–2068

    Article  Google Scholar 

  • Maciel L, Gomide F, Ballini R (2014) Enhanced evolving participatory learning fuzzy modeling: an application for asset returns volatility forecasting. Evol Syst 5(2):75–88

    Article  Google Scholar 

  • Mansoori G (2014) GACH: a grid-based algorithm for hierarchical clustering of high-dimensional data. Soft Comput 18(5):905–922

    Article  Google Scholar 

  • Mansoori EG, Zolghadri MJ, Katebi SD (2008) SGERD: a steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Trans Fuzzy Syst 16(4):1061–1071

    Article  Google Scholar 

  • Minku LL, Yao X (2012) DDD: a new ensemble approach for dealing with drifts. IEEE Trans Knowl Data Eng 24(4):619–633

    Article  Google Scholar 

  • Minku LL, White AP, Yao X (2010) The impact of diversity on online ensemble learning in the presence concept of drift. IEEE Trans Knowl Data Eng 22(5):730–742

    Article  Google Scholar 

  • Pelossof R, Jones M, Vovsha I, Rudin C (2010) Online coordinate boosting. In: 2009 IEEE 12th international conference on computer vision workshops (ICCV Workshops), Kyoto, Japan

  • Pratama M, Anavatti SG, Lughofer E (2014) GENEFIS: toward an effective localist network. IEEE Trans Fuzzy Syst 22(3):547–562

    Article  Google Scholar 

  • Pratama M, Anavatti SG, Joo M, Lughofer E (2015) pClass: an effective classifier for streaming examples. IEEE Trans Fuzzy Syst 23(2):369–386

    Article  Google Scholar 

  • Rubio JDJ (2010) Stability analysis for an on-line evolving neuro-fuzzy recurrent network. In: Angelov P, Filev D, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York

    Google Scholar 

  • Shahparast H, Mansoori EG (2017) FERHD: a feasible approach for extracting fuzzy classification rules from high-dimensional data. Intell Data Anal 21(1):63–75

    Article  Google Scholar 

  • Shahparast H, Hamzeloo S, Zolghadri Jahromi M (2014) A self-tuning fuzzy rule-based classifier for data streams. Int J Uncertain Fuzziness Knowl Based Syst 22(2):293–304

    Article  MATH  Google Scholar 

  • Shaker A, Senge R, Hüllermeier E (2013) Evolving fuzzy pattern trees for binary classification on data streams. Inf Sci 220:34–45

    Article  Google Scholar 

  • Shalev-Shwartz S, Singer Y, Srebro N, Cotter A (2011) Pegasos: primal estimated sub-GrAdient SOlver for SVM. Math Program 127(1):3–30

    Article  MathSciNet  MATH  Google Scholar 

  • Street N, Kim Y (2001) A streaming ensemble algorithm SEA for largescale classification. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, pp 377–382

  • Sugeno M, Takagi T (1983) Multi-dimensional fuzzy reasoning. Fuzzy Sets Syst 9(1–3):313–325

    Article  MATH  Google Scholar 

  • Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019

    Article  Google Scholar 

  • Vigdor B, Lerner B (2007) The Bayesian ARTMAP. IEEE Trans Neural Netw 18(6):1628–1644

    Article  Google Scholar 

  • Wang H, Fan W, Yu PS, Han J (2003) Mining concept-drifting data streams using ensemble classifiers. In: 9th ACM international conference on knowledge discovery and data mining (SIGKDD), Washington DC, USA

  • Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101

    Google Scholar 

  • Zhang K, Fan W, Yuan X, Davidson I, Li X (2006) Forecasting skewed biased stochastic ozone days: analyses and solutions. In: ICDM ‘06 proceedings of the sixth international conference on data mining, pp 753–764

  • Zliobaite I, Bifet A, Holmes G, Pfahringer B (2011) MOA concept drift active learning strategies for streaming data. In: 2nd Workshop on applications of pattern analysis, pp 48–55

Download references

Author information

Authors and Affiliations

  1. School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran

    Homeira Shahparast, Eghbal G. Mansoori & Mansoor Zolghadri Jahromi

Authors
  1. Homeira Shahparast
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eghbal G. Mansoori
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mansoor Zolghadri Jahromi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Homeira Shahparast.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shahparast, H., Mansoori, E.G. & Zolghadri Jahromi, M. AFCGD: an adaptive fuzzy classifier based on gradient descent. Soft Comput 23, 4557–4571 (2019). https://doi.org/10.1007/s00500-018-3485-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-018-3485-2

Keywords

Search

Navigation