Log in

Multilevel detection and classification of diseased plant leaf images using high-resolution superlet transform and E-ResNet

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

Plant leaf disease detection in early stage is a very challenging task that and is one of the most promising research areas in the field of precision agriculture. Advancements in the field of artificial intelligence improves the practice of precise plant protection and growth. Different deep-learning architectures are proposed in the recent past to detect and classify the diseased plant images. These architectures cannot detect multiple occurrences of a particular disease in an image. Also, these methods suffer from different illumination conditions, a complex background, and location of the disease. To overcome these limitations, this paper proposed a novel framework to detect and classify diseased plant images effectively. The proposed framework incorporates a combination of LBP, HOG, and GLCM features which can easily locate the diseased part from the image even in the complex background. Further, the framework utilizes superlet transform (SLT) which provides an enhancement in the classification accuracy by generating high resolution time–frequency spectrograms of the fused features. Further, these spectrograms help in detection of multiple occurrences and easily classify the diseased plant images using Enhanced-ResNet (E-ResNet) network. To validate the performance of the proposed framework experiments are conducted on PlantDoc dataset which provided an accuracy of 97.4% and 98.1% with VGGNet and E-ResNet classification model respectively. To further validate the efficiency and efficacy of the proposed framework an ablation study is also carried out.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Availability of data and materials

https://github.com/pratikkayal/PlantDoc-Dataset (PlantDoc-Dataset).

References

  1. Tai APK, Val Martin M, Heald CL (2014) Threat to future global food security from climate change and ozone air pollution. Nat Clim Change. https://doi.org/10.1038/nclimate2317. (online first)

    Article  Google Scholar 

  2. Report of the Plenary of the Intergovernmental Science-PolicyPlatform on Biodiversity and Ecosystem Services on the work of its fourth session (2016) Plenary of the intergovernmental science-policy platform on biodiversity and ecosystem services fourth session. Kuala Lumpur. http://www.ipbes.net/sites/default/files/downloads/pdf/IPBES-4-4-19-AmendedAdvance.pdf

  3. Strange RN, Scott PR (2005) Plant disease: a threat to global food security. Phytopathology 43:83–116. https://doi.org/10.1146/annurev.phyto.43.113004.133839

    Article  Google Scholar 

  4. Savary S, Ficke A, Aubertot J-N, Hollier C (2012) Crop losses due to diseases and their implications for global food production losses and food security. Food Sec 4:519–537

    Article  Google Scholar 

  5. Bhagat M, Kumar D, Kumar S (2023) Bell pepper leaf disease classification with LBP and VGG-16 based fused features and RF classifier. Int j inf tecnol 15:465–475. https://doi.org/10.1007/s41870-022-01136-z

    Article  Google Scholar 

  6. Nerkar B, Talbar S (2021) Cross-dataset learning for performance improvement of leaf disease detection using reinforced generative adversarial networks. Int j inf tecnol 13:2305–2312. https://doi.org/10.1007/s41870-021-00772-1

    Article  Google Scholar 

  7. Kusuma S, Jothi KR (2023) Early betel leaf disease detection using vision transformer and deep learning algorithms. Int j inf tecnol. https://doi.org/10.1007/s41870-023-01647-3

    Article  Google Scholar 

  8. Daniya T, Vigneshwari S (2022) Exponential Rider-Henry Gas Solubility optimization-based deep learning for rice plant disease detection. Int j inf tecnol 14:3825–3835. https://doi.org/10.1007/s41870-022-01022-8

    Article  Google Scholar 

  9. Admass WS, Munaye YY, Bogale GA (2023) Convolutional neural networks and histogram-oriented gradients: a hybrid approach for automatic mango disease detection and classification. Int j inf tecnol. https://doi.org/10.1007/s41870-023-01605-z

    Article  Google Scholar 

  10. Chung C-L, Huang K-J, Chen S-Y, Lai M-H, Chen Y-C, Kuo Y-F (2016) Detecting Bakanae disease in rice seedlings by machine vision. Comput Electron Agric 121:404–411

    Article  Google Scholar 

  11. Shrivastava S, Singh SK, Hooda DS (2017) Soybean plant foliar disease detection using image retrieval approaches. Multimedia Tools Appl 76:26647–26674

    Article  Google Scholar 

  12. Camargo A, Smith JS (2009) Image pattern classification for the identification of disease-causing agents in plants. Comput Electron Agric 66:121–125

    Article  Google Scholar 

  13. Liu T, Chen W, Wu W, Sun C, Guo W, Zhu X (2016) Detection of aphids in wheat fields using a computer vision technique. Biosyst Eng 141:82–93

    Article  Google Scholar 

  14. Amara J, Bouaziz B, Algergawy A (2017) A deep learning-based approach for banana leaf diseases classification. In: Gesellsch. Inf. Bonn 2017, pp 79–88

  15. Fuentes A, Yoon S, Kim S, Park D (2017) A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17:2022

    Article  Google Scholar 

  16. Kaur S, Pandey S, Goel S (2019) Plants disease identification and classification through leaf images: a survey. Arch Comput Methods Eng 26:507–530

    Article  Google Scholar 

  17. Barbedo JGA (2016) A review on the main challenges in automatic plant disease identification based on visible range images. Biosyst Eng 144:52–60

    Article  Google Scholar 

  18. Yang CC, Prasher SO, Enright P, Madramootoo C, Burgess M, Goel PK et al (2003) Application of decision tree technology for image classification using remote sensing data. Agric Syst 76(3):1101–1117. https://doi.org/10.1016/S0308-521X(02)00051-3

    Article  Google Scholar 

  19. Babu BSR MSP (2007) Leaves recognition using back propagation neural network-advice for pest and disease control on crops. IndiaKisan 13. http://www.indiakisan.net/web/leafrecgnition.pdf. Accessed 12 Oct 2019

  20. Garcia-Ruiz F, Sankaran S, Maja JM, Lee WS, Rasmussen J, Ehsani R (2013) Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees. Comput Electron Agric 91:106–115. https://doi.org/10.1016/j.compag.2012.12.002

    Article  Google Scholar 

  21. Wetterich CB, de Oliveira Neves RF, Belasque J, Ehsani R, Marcassa LG (2017) Detection of Huanglongbing in Florida using fluorescence imaging spectroscopy and machine-learning methods. Appl Opt 56(1):15–23. https://doi.org/10.1364/AO.56.000015

    Article  Google Scholar 

  22. Rumpf T, Mahlein A-K, Steiner U, Oerke E-C, Dehne H-W, Plümer L (2010) Early detection and classification of plant diseases with support vector machines based on hyperspectral reflectance. Comput Electron Agric 74(1):91–99. https://doi.org/10.1016/j.compag.2010.06.009

    Article  Google Scholar 

  23. Calderón R, Navas-Cortés JA, Zarco-Tejada PJ (2015) Early detection and quantification of verticillium wilt in olive using hyperspectral and thermal imagery over large areas. Remote Sens 7(5):5584–5610. https://doi.org/10.3390/rs70505584

    Article  Google Scholar 

  24. Guo Y, Han S, Li Y, Zhang C, Bai Y (2018) K-Nearest neighbor combined with guided filter for hyperspectral image classification. Procedia Comput Sci 129:159–165. https://doi.org/10.1016/j.procs.2018.03.066

    Article  Google Scholar 

  25. Pantazi XE, Moshou D, Tamouridou AA, Kasderidis S (2016) Leaf disease recognition in vine plants based on local binary patterns and one class support vector machines. In: Iliadis L, Maglogiannis I (eds) Artificial intelligence applications and innovations. Springer, Cham, pp 319–327

    Chapter  Google Scholar 

  26. Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Navajas AD et al (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209. https://doi.org/10.1016/j.compag.2017.04.013

    Article  Google Scholar 

  27. Javidan SM, Banakar A, Vakilian KA, Ampatzidis Y (2023) Diagnosis of grape leaf diseases using automatic K-means clustering and machine learning. Smart Agric Technol 3:100081

    Article  Google Scholar 

  28. Pothen ME, Pai ML (2020) Detection of rice leaf diseases using image processing. In: 2020 Fourth international conference on computing methodologies and communication (ICCMC), Erode, India, 2020, pp 424–430. https://doi.org/10.1109/ICCMC48092.2020.ICCMC-00080

  29. Suman T, Dhruvakumar T (2015) Classification of paddy leaf diseases using shape and color features. Int J Electr Electron Eng 07(01):239–250

    Google Scholar 

  30. Waghmare H, Kokare R (2016) Detection and classification of diseases of grape plant using color local binary pattern feature and machine learning for automated decision support system. In: 2016 International conference on signal processing and integrated networks (SPIN)

  31. Sharma D, Dhiman C, Kumar D (2022) Automated image caption generation framework using adaptive attention and Bi-LSTM. In: 2022 IEEE Delhi section conference (DELCON), New Delhi, India, 2022, pp 1–5. https://doi.org/10.1109/DELCON54057.2022.9752859

  32. Rautela K, Sharma D, Kumar V et al (2023) Obscenity detection transformer for detecting inappropriate contents from videos. Multimedia Tools Appl. https://doi.org/10.1007/s11042-023-16078-2

    Article  Google Scholar 

  33. Sharma D, Dhiman C, Kumar D (2024) XGL-T transformer model for intelligent image captioning. Multimedia Tools Appl 83:4219–4240. https://doi.org/10.1007/s11042-023-15291-3

    Article  Google Scholar 

  34. Sharma D, Dingliwal R, Dhiman C, Kumar D (2022) Lightweight transformer with GRU integrated decoder for image captioning. In: 2022 16th International conference on signal-image technology & internet-based systems (SITIS), Dijon, France, pp 434–438. https://doi.org/10.1109/SITIS57111.2022.00072

  35. Rautela K, Sharma D, Kumar V et al (2023) DVRGNet: an efficient network for extracting obscenity from multimedia content. Multimedia Tools Appl. https://doi.org/10.1007/s11042-023-16619-9

    Article  Google Scholar 

  36. Babu VS, Satheesh Kumar R, Sunder R (2017) A comparative study on disease detection of plants using machine learning techniques. In: 2021 7th International conference on advanced computing and communicating systems (ICACCS 2021)

  37. Jadhav N, Kasar H, Chandak S, Machha S (2020) Crop leaf disease diagnosis using convolutional neural network. Biol Int J Trend Sci Res Dev, Volume 4 Issue 2, pp1056-1058, https://api.semanticscholar.org/CorpusID:219634722.

  38. Sun J, Yang Y, He X, Wu X (2020) Northern maize leaf blight detection under complex field environment based on deep learning. IEEE Access 8:33679–33688

    Article  Google Scholar 

  39. Jiang P, Chen Y, Liu B, He D, Liang C (2019) Real-time detection of apple leaf diseases using deep learning approach based on improved convolutional neural networks. IEEE Access 7:59069–59080

    Article  Google Scholar 

  40. Teenu Sahasra M, Sai Kumari S, Sai Meghana S, Rama Devi P (2021) Leaf disease detection using deep learning. In: 2021 Second international conference on electronics and sustainable communication systems (ICESC), Coimbatore, India, 2021, pp 1797–1804. https://doi.org/10.1109/ICESC51422.2021.9532909

  41. Zhang Y-D, Dong Z, Chen X, Jia W, Du S, Muhammad K et al (2019) Image based fruit category classification by 13-layer deep convolutional neural network and data augmentation. Multimedia Tools Appl 78(3):3613–3632. https://doi.org/10.1007/s11042-017-5243-3

    Article  Google Scholar 

  42. Wang S-H, Tang C, Sun J, Yang J, Huang C, Phillips P et al (2018) Multiple sclerosis identification by 14-layer convolutional neural network with batch normalization, dropout, and stochastic pooling. Front Neurosci 12:818. https://doi.org/10.3389/fnins.2018.00818

    Article  Google Scholar 

  43. **ao X-Y, Hu R, Zhang S-W, Wang X-F (2010) HOG-based approach for leaf classification. In: International conference on intelligent computing. Springer, Berlin, Heidelberg, pp 149–155 10

  44. Chaki J, Parekh R, Bhattacharya S (2015) Plant leaf recognition using texture and shape features with neural classifiers. Pattern Recogn Lett 58(61–68):12

    Google Scholar 

  45. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59

    Article  Google Scholar 

  46. Moca VV, Bârzan H, Nagy-Dăbâcan A, Mureșan RC (2021) Time-frequency super-resolution with superlets. Nat Commun 12(1):1–18. https://doi.org/10.1038/s41467-020-20539-9

    Article  Google Scholar 

  47. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), Las Vegas, NV, USA, 2016, pp 770–778. https://doi.org/10.1109/CVPR.2016.90

  48. Singh D, Jain N, Jain P, Kayal P, Kumawat S, Batra N (2020) PlantDoc: a dataset for visual plant disease detection. In: Proceedings of the 7th ACM IKDD CoDS and 25th COMAD, pp 249–253

  49. Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327. https://doi.org/10.1109/TPAMI.2018.2858826

    Article  Google Scholar 

  50. Mohanty SP, Hughes DP, Salathe M (2016) ´ Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419

    Article  Google Scholar 

  51. Toda Y, Okura F (2019) How convolutional neural networks diagnose plant disease. Plant Phenom. https://doi.org/10.34133/2019/9237136

    Article  Google Scholar 

  52. Geetharamani G, Arun Pandian J (2019) Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Comput Electr Eng 76:323–338

    Article  Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

AS contributed to Abstract, Introduction, Related Works, Proposed Works, Result and Discussions, Implementation Details, Performance Comparison, Ablation Study, Conclusions, References. AK contributed to proof reading and visualization.

Corresponding author

Correspondence to Astha Sharma.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Ethical approval

This paper does not contain any studies with human participants or animals performed by any of the authors.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sharma, A., Kumar, A. Multilevel detection and classification of diseased plant leaf images using high-resolution superlet transform and E-ResNet. Int. j. inf. tecnol. 16, 3135–3147 (2024). https://doi.org/10.1007/s41870-024-01822-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-024-01822-0

Keywords

Navigation