SpringerLink
Log in

Deep learning-based classification and application test of multiple crop leaf diseases using transfer learning and the attention mechanism

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

Crop diseases are among the major natural disasters in agricultural production that seriously restrict the growth and development of crops, threatening food security. Timely classification, accurate identification, and the application of methods suitable for the situation can effectively prevent and control crop diseases, improving the quality of agricultural products. Considering the huge variety of crops, diseases, and differences in the characteristics of diseases during each stage, the current convolutional neural network models based on deep learning need to meet the higher requirement of classifying crop diseases accurately. It is necessary to introduce a new architecture scheme to improve the recognition effect. Therefore, in this study, we optimized the deep learning-based classification model for multiple crop leaf diseases using combined transfer learning and the attention mechanism, the modified model was deployed in the smartphone for testing. Dataset that containing 10 types of crops, 61 types of diseases, and different degrees was established, the algorithm structure based on ResNet50 was designed using transfer learning and the SE attention mechanism. The classification performances of different improvement methods were compared by model training. Result indicates that the average accuracy of the proposed TL-SE-ResNet50 model is increased by 7.7%, reaching 96.32%. The model was also integrated and implemented in the smartphone and the test result of the application reaches 94.8%, and the average response time is 882 ms. The improved model proposed has a good effect on the identification of diseases and their condition of multiple crops, and the application can meet the portable usage needs of farmers. This study can provide reference for more crop disease management research in agricultural production.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

References

  1. FAO launches 2020 as the UN's International Year of PlantHealth, https://www.fao.org/plant-health-2020/about/en

  2. Shi L, Chen DY, Ma XY (2011) Overview and prospect of application of expert system in agriculture. J Agric Mech Res 1(43):215–218

    Google Scholar 

  3. Rangarajan AK, Purushothaman R, Ramesh A (2018) Tomato crop disease classification using pre-trained deep learning algorithm. Procedia Comput Sci 133:1040–1047

    Article  Google Scholar 

  4. Wspanialy P, Moussa M (2020) A detection and severity estimation system for generic diseases of tomato greenhouse plants. Comput Electron Agric 178:105701

    Article  Google Scholar 

  5. Picon A, San-Emeterio MG, Bereciartua-Perez A, Klukas C, Eggers T, Navarra-Mestre R (2022) Deep learning-based segmentation of multiple species of weeds and corn crop using synthetic and real image datasets. Comput Electron Agric 194:106719

    Article  Google Scholar 

  6. Thenmozhi K, Srinivasulu Reddy U (2019) Crop pest classification based on deep convolutional neural network and transfer learning. Comput Electron Agric 164:104906

    Article  Google Scholar 

  7. Coulibaly S, Kamsu-Foguem B, Kamissoko D, Traore D (2019) Deep neural networks with transfer learning in millet crop images. Comput Ind 108:115–120

    Article  Google Scholar 

  8. Krishnamoorthy N, Narasimha Prasad LV, Pavan Kumar CS, Subedi B, Abraha HB, Sathishkumar VE (2021) Rice leaf diseases prediction using deep neural networks with transfer learning. Environ Res 198:111275

    Article  Google Scholar 

  9. Le TT, Lin CY, Piedad EJ (2019) Deep learning for noninvasive classification of clustered horticultural crops—a case for banana fruit tiers. Postharvest Biol Tec 156:110922

    Article  Google Scholar 

  10. **ong YH, Liang LF, Wang L, She JH, Wu M (2020) Identification of cash crop diseases using automatic image segmentation algorithm and deep learning with expanded dataset. Comput Electron Agric 177:105712

    Article  Google Scholar 

  11. Saeed F, Khan MA, Sharif M, Mittal M, Goyal LM, Roy S (2021) Deep neural network features fusion and selection based on PLS regression with an application for crops diseases classification. Appl Soft Comput 103:107164

    Article  Google Scholar 

  12. Tang Z, Yang J, Li Z, Qi F (2020) Grape disease image classification based on lightweight convolution neural networks and channelwise attention. Comput Electron Agric 178:105735

    Article  Google Scholar 

  13. Chen J, Zhang D, Suzauddola M, Zeb A (2021) Identifying crop diseases using attention embedded MobileNet-V2 model. Appl Soft Comput 113:107901

    Article  Google Scholar 

  14. Pan SQ, Qiao JF, Wang R, Yu HL, Wang C, Taylor K, Pan HY (2022) Intelligent diagnosis of northern corn leaf blight with deep learning model. J Integr Agr 21(4):1094–1105

    Article  Google Scholar 

  15. Wang K, Chen K, Du H, Liu S, Xu J, Zhao J, Chen H, Liu Y, Liu Y (2022) New image dataset and new negative sample judgment method for crop pest recognition based on deep learning models. Ecol Inform 69:101620

    Article  Google Scholar 

  16. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 770–778

  17. Chen J, Chen J, Zhang D, Sun Y, Nanehkaran YA (2020) Using deep transfer learning for image-based plant disease identification. Comput Electron Agric 173:105393

    Article  Google Scholar 

  18. Jiang Z, Dong Z, Jiang W, Yang Y (2021) Recognition of rice leaf diseases and wheat leaf diseases based on multi-task deep transfer learning. Comput Electron Agric 186:106184

    Article  Google Scholar 

  19. Hu J, Li S, Sun G (2018) Squeeze-and-excitation networks. In: 2018 IEEE/CVF conference on computer vision and pattern recognition, pp 7132–7141

  20. Lin TY, Goyal P, Girshick R, He K, Dollár P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 2(42):318–327

    Article  Google Scholar 

  21. Sarker MRKR, Borsha NA, Sefatullah M, Khan AR, Jannat S, Ali H (2022) A deep transfer learning-based approach to detect potato leaf disease at an earlier stage. In: 2022 Second International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT), pp1–5

  22. Wang GW, Yu HY, Sui YY (2021) Research on maize disease recognition method based on improved ResNet50. Mob Inf Syst. https://doi.org/10.1155/2021/9110866

    Article  Google Scholar 

  23. Pangilinan JR, Legaspi J, Linsangan N (2022) InceptionV3, ResNet50, and VGG19 performance comparison on tomato ripeness classification. In: IEEE/2022 5th International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), pp 619–624

  24. Eligar V, Patil U, Mudenagudi U (2022) Performance analysis of deep learning algorithms toward disease detection: tomato and potato plant as use-cases. In: Proceedings of Intelligent and Cloud Computing 2021, Springer Nature, Singapore, pp 595-606

  25. Kumar A, Razi R, Singh A, Das H (2020) Res-VGG: A novel model for plant disease detection by fusing VGG16 and ResNet models. In: Machine Learning, Image Processing, Network Security and Data Sciences 2020, Springer Nature, Singapore, pp 383-400

  26. **ng SL, Lee HJ (2022) Crop pests and diseases recognition using DANet with TLDP. Comput Electron Agric 199:107144

    Article  Google Scholar 

  27. Kamal KC, Yin ZD, Li B, Ma B, Wu M (2019) Transfer learning for fine-grained crop disease classification based on leaf images. In: IEEE/2019 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), pp 1–5

  28. Yadav S, Sengar N, Singh A, Singh A, Dutta MK (2021) Identification of disease using deep learning and evaluation of bacteriosis in peach leaf. Ecol Inform 61:101247

    Article  Google Scholar 

  29. Bian NX, Zhao DX (2016) Integrated framework of web service automated testing based on JMeter. Comput Appl Softw 33(05):8–12+16

    Google Scholar 

Download references

Funding

The National Natural Science Foundation of China (No. 52002349), Industry University Research Cooperation Project of Jiangsu Province (No. BY20231143), and Yangtze River Culture Institute Open Project (No. CJ2309).

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Yangzhou University, Yangzhou, 225127, China

    Yifu Zhang & Qian Sun

  2. Business School, Yangzhou University, Yangzhou, 225127, China

    Ji Chen & Huini Zhou

Authors
  1. Yifu Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qian Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ji Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huini Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Yifu Zhang: Conceptualization, Investigation, Writing—review &editing. Qian Sun: Methodology, Writing—original draft, Visualization, Writing- review & editing. Ji Chen: Methodology, Writing—review & editing. Huini Zhou: Methodology, Supervision. Writing—review & editing.

Corresponding author

Correspondence to Huini Zhou.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appearedto influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Sun, Q., Chen, J. et al. Deep learning-based classification and application test of multiple crop leaf diseases using transfer learning and the attention mechanism. Computing (2024). https://doi.org/10.1007/s00607-024-01308-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00607-024-01308-8

Keywords

Search

Navigation