Log in

Convolutional Neural Networks based classifications of soil images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The utilization of Artificial Intelligence (AI) and Machine Learning(ML) in the image processing domain is useful to detect and recognize the types of soil. The main aim of the present work is to process the soil images and classify them accurately by using Tensorflow and Keras Deep Learning (DL) frameworks with pre-trained weights. There are several ML models already implemented for the classification of soil images. A dataset has 903 soil images of four different types of soil (alluvial, black, clay, and red). These images were divided into a training dataset and a validation dataset. The image augmentation process was applied to the dataset, and then the models are trained with these augmented images. In the present work, the Convolutional Neural Network (CNN) model was implemented to classify the soil images and achieved an accuracy of 99.86% for training and 97.68% for validation. Furthermore, six Deep Convolution Neural Network (DCNN) models were implemented, such as Rsnet152V2, VGG-16, VGG-19, Inception-ResNetV2, Xception, and DenseNet201, to classify the soil images. The accuracy of a Rsnet152V2, VGG-16, VGG-19, Inception-ResNetV2, Xception, and Densnet201 DCNN models were 99.15%, 97.58%, 98.44%, 98.15%, 98.86%, and 98.58%, respectively. The performance of CNN and DCNN models was evaluated using a confusion matrix and K-fold technique. The proposed CNN model has outperformed the DCNN models, and also literature reported works.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Alemi A (2016) Improving Inception and Image Classification in TensorFlow. https://ai.googleblog.com/2016/08/improving-inception-and-image.html

  2. Alom MZ, Hasan M, Yakopcic C, Taha TM, Asari VK (2021) Inception recurrent convolutional neural network for object recognition. Mach Vis Appl 32:28. https://doi.org/10.1007/s00138-020-01157-3

    Article  Google Scholar 

  3. Anguraj DK, Mandhala VN, Bhattacharyya D, Kim TH (2021) Hybrid neural network classification for irrigation control in WSN based precision agriculture. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-02704-6

  4. Athanasios V, Nikolaos D, Anastasios D, Eftychios P (2018) Deep learning for computer vision: a brief review. Computational Intelligence and Neuroscience Article ID 7068349. https://doi.org/10.1155/2018/7068349

  5. Azizi A, Gilandeh YA, Tarahom MG, Saleh-Bigdeli AA, Moghaddam HA (2020) Classification of soil aggregates: a novel approach based on deep learning. Soil Tillage Res 199:104586

    Article  Google Scholar 

  6. Babenko A, Slesarev A, Chigorin A, Lempitsky V (2014) Neural codes for image retrieval. In: European conference on computer vision. Springer, Cham, pp 584–599

    Google Scholar 

  7. Behrens T, Schmidt K, MacMillan RA et al (2018)Multi-scale digital soil map** with deep learning. Sci Rep 8:15244. https://doi.org/10.1038/s41598-018-33516-6

    Article  Google Scholar 

  8. Bhattacharya B, Solomatine DP (2006) Machine learning in soil classification. Neural Netw 19(2):186–195

    Article  Google Scholar 

  9. Cavallaro G, Riedel M, Bodenstein C et al (2015) Scalable developments for big data analytics in remote sensing. IEEE International Geoscience and Remote Sensing Symposium (IGARSS) pp 2015:1366–1369

  10. Chandan RT (2018) An intelligent model for Indian soil classification using various machine learning techniques. International Journal of Computational Engineering Research (IJCER) 33:2250–3005

    Google Scholar 

  11. Choudhury RD, Barman U (2020) Soil texture classification using multi class support vector machine. Information Processing in Agriculture 7(2):318–332

    Article  Google Scholar 

  12. Christian S, Sergey I, Vincent V, Alex A (2016) Inception-v4, inception-ResNet and the impact of residual connections on learning. Computer Vision and Pattern Recognition ar**v 1602:07261

    Google Scholar 

  13. Chu J, Guo Z, Leng L (2018) Object detection based on multi-layer convolution feature fusion and online hard example mining. IEEE Access 6:19959–19967

    Article  Google Scholar 

  14. Chung SO, Cho KH, Cho JW, Jung KY, Yamakawa T (2012) Soil texture classification algorithm using rgb characteristics of soil images. J Fac Agr Kyushuuniv 57(2):393–397

    Google Scholar 

  15. Doulamis A, Doulamis N, Maragos P (2001) Generalized multiscale connected operators with applications to granulometric image analysis. In: Proceedings 2001 international conference on image processing (cat. No.01CH37205), vol 3, pp 684–687. https://doi.org/10.1109/ICIP.2001.958211

    Chapter  Google Scholar 

  16. Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Computer Electronics Agriculture 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009

    Article  Google Scholar 

  17. Foody GM, Mathur A, Sanchez-Hernandez C, Boyd DS (2006) Training set size requirements for the classification of a specific class. Remote Sens Environ 1:1–14

    Article  Google Scholar 

  18. Franc O (2017) Xception: deep learning with depth wise separable convolutions. Computer vision foundation Google Inc IEEE Xplore

  19. Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J, Chen T (2018) Recent advances in convolutional neural networks. Pattern Recogn 77:354–377

    Article  Google Scholar 

  20. Guan Q, Wang Y, ** B, Li D, du J, Qin Y, Lu H, Wan X, **ang J (2019) Deep convolutional neural network VGG-16 model for differential diagnosing of papillary thyroid carcinomas in cytological images: a pilot study. J Cancer 10:4876–4882

    Article  Google Scholar 

  21. Guang Y, Shujun Q, Pengfei C (2015) Rock and soil classification using PLS-DA and SVM combined with a laser-induced breakdown spectroscopy library. Plasma SciTechnol 17(8):656–663

    Google Scholar 

  22. He K et al (2016) Identity map**s in deep residual networks. In: EuropeanConference on Computer Vision. Springer

    Google Scholar 

  23. He K et al (2016) Deep residual learning for image recognition. In: Proceedingsof the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778. https://doi.org/10.1109/CVPR.2016.90

    Chapter  Google Scholar 

  24. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Las Vegas NV, pp 770–778

    Chapter  Google Scholar 

  25. Honawad SK, Chinchali SS, Pawar K, Deshpande P (2017) Soil classification and suitable crop prediction. 4IOSR Journal of Computer Engineering (IOSR-JCE):25–29

  26. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition (CVPR) Honolulu HI USA 21–26, pp 2261–2269

  27. Hussain M (2020) What is rectified linear unit (ReLU)?. Introduction to ReLU Activation Function. https://www.mygreatlearning.com/blog/relu-activation-function/

  28. Javaheri SH, Teimourpour B (2014) Response modeling in direct marketing, in Data Mining Applications with R. https://doi.org/10.1016/B978-0-12-411511-8.00006-2

  29. Kestrilia RP, Syaiful A, Tatas HPB, Agus S (2020)Real-time assessment of plant photosynthetic pigment contentswith an artificial intelligence approach in a mobile application. Journal of Agricultural Engineering LI:1082

    Google Scholar 

  30. Kiattisin S (2021) Machine learning techniques for classifying the sweetness of watermelon using acoustic signal and image processing. Comput Electron Agric 181:105938

    Article  Google Scholar 

  31. Kumar V, Balakrishnan N (2021) Artificial intelligence-based agriculture automated monitoring systems using WSN. J Ambient Intell Human Comput. 12:8009–8016. https://doi.org/10.1007/s12652-020-02530-w

    Article  Google Scholar 

  32. Lameck O, Odhiambo RS, Freeland RE, Yoder J, Wesley H (2002) Application of fuzzy-neural network in classification of soils using ground-penetrating radar imagery. In: 2002 ASAE annual international meeting/ CIGR XVth world congress

    Google Scholar 

  33. Lu Y, Perez D, Dao M, Kwan C, Li J (2018) Deep learning with synthetic hyperspectral images for improved soil detection in multispectral imagery. In: 2018 9th IEEE annual ubiquitous computing, Electronics & Mobile Communication Conference (UEMCON), pp 666–672. https://doi.org/10.1109/UEMCON.2018.8796838

    Chapter  Google Scholar 

  34. Mengistu AD, Alemayehu DM (2018) Soil characterization and classification: a hybrid approach of computer vision and sensor network. Int J Electr Comput Eng 8(2):989–995

    Google Scholar 

  35. Mohapatra H, Rath AK (2021) IoE based framework for smart agriculture. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-021-02908-4

  36. Nguyen L, Lin D, Lin Z, Cao J (2018) Deep CNNs for microscopic image classification by exploiting transfer learning and feature concatenation. In: 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp 1–5. https://doi.org/10.1109/ISCAS.2018.8351550

    Chapter  Google Scholar 

  37. Online Article, Top 6 Indian AgriTech startups that are Revolutionising Agriculture (2018). https://analyticsindiamag.com/top-6-indian-agritech-startups-that-are-revolutionising-agriculture/

  38. Online Article (n.d.) Machine Learning In Agriculture: How Ai Helps Solve The Industry's Most Pressing Challenges. https://objectcomputing.com/expertise/machine-learning/machine-learning-in-agriculture

  39. Online Article (n.d.) https://www.mathworks.com/help/physmod/simscape/ug/estimate-computation-costs.html

  40. Online Article Salty Soils. (n.d.) http://www.fao.org/3/r4082e/r4082e08.htm

  41. Pan Y, Pi D, Khan I et al (2021) DenseNetFuse: a study of deep unsupervised DenseNet to infrared and visual image fusion. J Ambient Intell Human Comput. 12:10339–10351. https://doi.org/10.1007/s12652-020-02820-3

    Article  Google Scholar 

  42. Pannu HS, Ahuja S, Dang N, Soni S, Malhi AK (2020) Deep learning based image classification for intestinal hemorrhage. Multimed Tools Appl 79:21941–21966. https://doi.org/10.1007/s11042-020-08905-7

    Article  Google Scholar 

  43. Parab J, Sequeira M, Lanjewar M, Pinto C, Naik G (2021) Backpropagation neural network-based machine learning model for prediction of blood urea and glucose in CKD patients. IEEE Journal of Translational Engineering in Health and Medicine 9:1–8 Art no. 4900608. https://doi.org/10.1109/JTEHM.2021.3079714

    Article  Google Scholar 

  44. Patil N, Patil PN, Rao PV (2021) Convolution neural network and deep-belief network (DBN) based automatic detection and diagnosis of Glaucoma. Multimed Tools Appl 80:29481–29495. https://doi.org/10.1007/s11042-021-11087-5

    Article  Google Scholar 

  45. Ramezan CA, Warner TA, Maxwell AE, Price BS (2021) Effects of training set size on supervised machine-learning land-cover classification of large-area high-resolution remotely sensed data. Remote Sens 13(3):368. https://doi.org/10.3390/rs13030368

    Article  Google Scholar 

  46. Rao A, Abhishek JU, Manjunatha GNS, Beham R (2016) Machine learn soil classification. Crop Detect 4:792–794

    Google Scholar 

  47. Sanjay M (2018) Why and how to Cross Validate a Model? Importance and types of Cross validation techniques. https://towardsdatascience.com/why-and-how-to-cross-validate-a-model-d6424b45261f

  48. Santos L, Santos FN, Oliveira PM, Shinde P (2020) Deep Learning Applications in Agriculture: A Short Review. In: Silva M, Luís LJ, Reis L, Sanfeliu A, Tardioli D (eds) Robot 2019: Fourth Iberian Robotics Conference. ROBOT 2019. Advances in intelligent systems and computing, vol 1092. Springer, Cham. https://doi.org/10.1007/978-3-030-35990-4_12

    Chapter  Google Scholar 

  49. Shenbagavalli R, Ramar K (2011) Classification of soil textures based on Law’s features extracted from preprocessing images on sequential and random windows. Bonfring Int J Adv Image Process 1(1):15–15

    Article  Google Scholar 

  50. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. ar**v:1409.1556

  51. Srivastava P, Shukla A, Bansal A (2021) A comprehensive review on soil classification using deep learning and computer vision techniques. Multimed Tools Appl 80:14887–14914. https://doi.org/10.1007/s11042-021-10544-5

    Article  Google Scholar 

  52. Srunitha K, Padmavathi S (2016) Performance of SVM classifier for image based soil classification. In: Int. Conf. on signal processing, communication, power and embedded system. SCOPES, pp 411–415

    Google Scholar 

  53. Szegedy C, Liu W, Jia Y, Sermanet P et al (2015) Going deeper with convolutions. In: Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit, pp 1–9

  54. Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning In AAAI, pp 4278–4284

  55. Too EC, Yujian L, Njuki S, Yingchun L (2018) A comparative study of fine-tuning deep learning models for plant disease identification. Computers and Electronics in Agriculture 161:272–279. https://doi.org/10.1016/j.compag.2018.03.032

    Article  Google Scholar 

  56. Varçın F (2020) Crop pest classification with a genetic algorithm-based weighted ensemble of deep convolutional neural networks. Comput Electron Agric 179:105809

    Article  Google Scholar 

  57. Vibhute AD, Kale KV, Dhumal RK, Mehrotra SC (2015) Soil type classification and map** using hyperspectral remote sensing data. In: Conference on man and machine interfacing (MAMI), pp 1–4

  58. Wu W, Li AD, He XH, Ma R, Liu HB, Lv JK (2018) A comparison of support vector machines, artificial neural network and classification tree for identifying soil texture classes in Southwest China. Comput Electron Agric 144:86–93

    Article  Google Scholar 

  59. Yanming G, Yu L, Ard O, Songyang L, Song W, Michael SL (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27–48

    Article  Google Scholar 

  60. Zhang X, Younan NH, King RL (2003) Soil texture classification, using wavelet transform and maximum likelihood approach. In: 2003 IEEE International Geoscience and Remote Sensing Symposium. Toulouse: Proceedings (IEEE Cat.No.03CH37477), pp 2888–2890

    Google Scholar 

  61. Zhang Y, Chu J, Leng L, Miao J (2020)Mask-refined R-CNN: a network for refining object details in instance segmentation. Sensors 20(4):1010

    Article  Google Scholar 

  62. Zhao Z, Chow TL, Rees HW, Yang Q, **ng Z, Meng FR (2009) Predict soil texture distributions using an artificial neural network model. Comput Electron Agric 65:36–48

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Contributions

M G Lanjewar: Methodology, Software, Validation, Investigation, Writing - Original Draft, Performance analysis. O L Gurav: Dataset creation, Software.

Corresponding author

Correspondence to M. G. Lanjewar.

Ethics declarations

Conflicts of interest/competing interests

No conflict of interest.

Ethics approval

NA.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lanjewar, M.G., Gurav, O.L. Convolutional Neural Networks based classifications of soil images. Multimed Tools Appl 81, 10313–10336 (2022). https://doi.org/10.1007/s11042-022-12200-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12200-y

Keywords

Navigation