Abstract
Deep learning has shown remarkable performances in image classification, including those of plants and leaves. However, high-performing networks in terms of accuracy may not be using the salient regions for making the prediction and could be prone to biases. This work proposes a neural network architecture incorporating handcrafted features and fusing them with the learned features. Using hybrid features provides better control and understanding of the feature space while leveraging deep learning capabilities. Furthermore, a new IoU-based metric is introduced to assess the CNN-based classifier’s performance based on the regions focused on making predictions. Experiments over multiple leaf disease datasets demonstrate the performance improvement with the model using hybrid features. Classification using hybrid features performed better than the baseline models in terms of P@1 and also on the IoU-based metric.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alexandratos, N., Bruinsma, J.: World agriculture towards 2030/2050: the 2012 revision (2012)
Atila, Ü., Uçar, M., Akyol, K., Uçar, E.: Plant leaf disease classification using efficientNet deep learning model. Eco. Inform. 61, 101182 (2021)
Bae, W., Noh, J., Kim, G.: Rethinking Class Activation Map** for Weakly Supervised Object Localization. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12360, pp. 618–634. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58555-6_37
Barbedo, J.G.: Factors influencing the use of deep learning for plant disease recognition. Biosys. Eng. 172, 84–91 (2018)
Brahimi, M., Boukhalfa, K., Moussaoui, A.: Deep learning for tomato diseases: classification and symptoms visualization. Appl. Artif. Intell. 31(4), 299–315 (2017)
Chaerle, L., Lenk, S., Hagenbeek, D., Buschmann, C., Van Der Straeten, D.: Multicolor fluorescence imaging for early detection of the hypersensitive reaction to tobacco mosaic virus. J. Plant Physiol. 164(3), 253–262 (2007)
Chouhan, S.S., Singh, U.P., Kaul, A., Jain, S.: A data repository of leaf images: Practice towards plant conservation with plant pathology. In: 2019 4th International Conference on Information Systems and Computer Networks (ISCON), pp. 700–707. IEEE (2019)
Cisternas, I., Velásquez, I., Caro, A., RodrÃguez, A.: Systematic literature review of implementations of precision agriculture. Comput. Electron. Agric. 176, 105626 (2020)
Cruz, A.C., Luvisi, A., De Bellis, L., Ampatzidis, Y.: X-FIDO: An effective application for detecting olive quick decline syndrome with deep learning and data fusion. Front. Plant Sci. 8, 1741 (2017)
Çuğu, İ., et al.: Treelogy: A novel tree classifier utilizing deep and hand-crafted representations. ar**v preprint ar**v:1701.08291 (2017)
Fenu, G., Malloci, F.M.: DiaMos plant: a dataset for diagnosis and monitoring plant disease. Agronomy 11(11), 2107 (2021)
Ferentinos, K.P.: Deep learning models for plant disease detection and diagnosis. Comput. Electron. Agric. 145, 311–318 (2018)
Fujita, E., Kawasaki, Y., Uga, H., Kagiwada, S., Iyatomi, H.: Basic investigation on a robust and practical plant diagnostic system. In: 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA). pp. 989–992. IEEE (2016)
Hossin, M., Sulaiman, M.N.: A review on evaluation metrics for data classification evaluations. Int. J. Data Min. knowl. Manag. Process 5(2), 1 (2015)
Huang, Z., Huang, L., Gong, Y., Huang, C., Wang, X.: Mask scoring r-CNN. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6409–6418 (2019)
Huertas-Tato, J., MartÃn, A., Fierrez, J., Camacho, D.: Fusing CNNS and statistical indicators to improve image classification. Information Fusion 79, 174–187 (2022)
Hughes, D., Salathé, M., et al.: An open access repository of images on plant health to enable the development of mobile disease diagnostics. ar**v preprint ar**v:1511.08060 (2015)
Islam, M., Dinh, A., Wahid, K., Bhowmik, P.: Detection of potato diseases using image segmentation and multiclass support vector machine. In: 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1–4. IEEE (2017)
Johannes, A., Picon, A., Alvarez-Gila, A., Echazarra, J., Rodriguez-Vaamonde, S., Navajas, A.D., Ortiz-Barredo, A.: Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput. Electron. Agric. 138, 200–209 (2017)
Kamal, K., Yin, Z., Wu, M., Wu, Z.: Depthwise separable convolution architectures for plant disease classification. Comput. Electron. Agric. 165, 104948 (2019)
Kawasaki, Y., Uga, H., Kagiwada, S., Iyatomi, H.: Basic study of automated diagnosis of viral plant diseases using convolutional neural networks. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Pavlidis, I., Feris, R., McGraw, T., Elendt, M., Kopper, R., Ragan, E., Ye, Z., Weber, G. (eds.) ISVC 2015. LNCS, vol. 9475, pp. 638–645. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-27863-6_59
Kaya, A., Keceli, A.S., Catal, C., Yalic, H.Y., Temucin, H., Tekinerdogan, B.: Analysis of transfer learning for deep neural network based plant classification models. Comput. Electron. Agric. 158, 20–29 (2019)
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)
Li, W., Abad, J.A., French-Monar, R.D., Rascoe, J., Wen, A., Gudmestad, N.C., Secor, G.A., Lee, M., Duan, Y., Levy, L.: Multiplex real-time PCR for detection, identification and quantification of ‘Candidatus liberibacter solanacearum’in potato plants with zebra chip. J. Microbiol. Methods 78(1), 59–65 (2009)
Mohanty, S.P., Hughes, D.P., Salathé, M.: Using deep learning for image-based plant disease detection. Front. Plant Sci. 7, 1419 (2016)
Muthireddy, V., Jawahar, C.V.: Computer vision for capturing flora. In: Mukhopadhyay, J., Sreedevi, I., Chanda, B., Chaudhury, S., Namboodiri, V.P. (eds.) Digital Techniques for Heritage Presentation and Preservation, pp. 245–272. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-57907-4_12
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
PatrÃcio, D.I., Rieder, R.: Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review. Comput. Electron. Agric. 153, 69–81 (2018)
Purcell, D.E., O’Shea, M.G., Johnson, R.A., Kokot, S.: Near-infrared spectroscopy for the prediction of disease ratings for fiji leaf gall in sugarcane clones. Appl. Spectrosc. 63(4), 450–457 (2009)
Qin, F., Liu, D., Sun, B., Ruan, L., Ma, Z., Wang, H.: Identification of alfalfa leaf diseases using image recognition technology. PLoS ONE 11(12), e0168274 (2016)
Ribeiro, M.T., Singh, S., Guestrin, C.: " why should i trust you?" explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. pp. 1135–1144 (2016)
Ruiz-Ruiz, S., Ambrós, S., del Carmen Vives, M., Navarro, L., Moreno, P., Guerri, J.: Detection and quantitation of citrus leaf blotch virus by taqman real-time rt-PCR. J. Virol. Methods 160(1–2), 57–62 (2009)
Sankaran, S., Mishra, A., Maja, J.M., Ehsani, R.: Visible-near infrared spectroscopy for detection of huanglongbing in citrus orchards. Comput. Electr. Agric. 77, 127–134 (2011)
Saponari, M., Manjunath, K., Yokomi, R.K.: Quantitative detection of citrus tristeza virus in citrus and aphids by real-time reverse transcription-PCR (Taqman®). J. Virol. Methods 147(1), 43–53 (2008)
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, vol. 128, pp. 336–359 (2017)
Shafi, U., Mumtaz, R., GarcÃa-Nieto, J., Hassan, S.A., Zaidi, S.A.R., Iqbal, N.: Precision agriculture techniques and practices: From considerations to applications. Sensors 19(17), 3796 (2019)
Singh, D., et al.: Plantdoc: a dataset for visual plant disease detection. In: Proceedings of the 7th ACM IKDD CoDS and 25th COMAD, pp. 249–253 (2020)
Singh, V., Misra, A.K.: Detection of plant leaf diseases using image segmentation and soft computing techniques. Information processing in Agriculture 4(1), 41–49 (2017)
Sladojevic, S., Arsenovic, M., Anderla, A., Culibrk, D., Stefanovic, D.: Deep neural networks based recognition of plant diseases by leaf image classification. Computational intelligence and neuroscience 2016 (2016)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 2818–2826 (2016)
Wang, H., Li, G., Ma, Z., Li, X.: Image recognition of plant diseases based on backpropagation networks. In: 2012 5th International Congress on Image and Signal Processing. pp. 894–900. IEEE (2012)
Wu, S., Li, X., Wang, X.: Iou-aware single-stage object detector for accurate localization. Image Vis. Comput. 97, 103911 (2020)
Ye, W., Yao, J., Xue, H., Li, Y.: Weakly supervised lesion localization with probabilistic-cam pooling. ar**v preprint ar**v:2005.14480 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Muthireddy, V., Jawahar, C.V. (2023). Plant Disease Classification Using Hybrid Features. In: Gupta, D., Bhurchandi, K., Murala, S., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2022. Communications in Computer and Information Science, vol 1776. Springer, Cham. https://doi.org/10.1007/978-3-031-31407-0_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-31407-0_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-31406-3
Online ISBN: 978-3-031-31407-0
eBook Packages: Computer ScienceComputer Science (R0)