Abstract
In the context of environmental and social applications, the analysis of land use and land cover (LULC) holds immense significance. The growing accessibility of remote sensing (RS) data has led to the development of LULC benchmark datasets, especially pivotal for intricate image classification tasks. This study addresses the scarcity of such benchmark datasets across diverse settings, with a particular focus on the distinctive landscape of India. The study entails the creation of patch-based datasets, consisting of 4000 labelled images spanning four distinct LULC classes derived from Sentinel-2 satellite imagery. For the subsequent classification task, three traditional machine learning (ML) models and three convolutional neural networks (CNNs) were employed. Despite facing several challenges throughout the process of dataset generation and subsequent classification, the CNN models consistently attained an overall accuracy of 90% or more. Notably, one of the ML models stood out with 96% accuracy, surpassing CNNs in this specific context. The study also conducts a comparative analysis of ML models on existing benchmark datasets, revealing higher prediction accuracy when dealing with fewer LULC classes. Thus, the selection of an appropriate model hinges on the given task, available resources, and the necessary trade-offs between performance and efficiency, particularly crucial in resource-constrained settings. The standardized benchmark dataset contributes valuable insights into the relative performance of deep CNN and ML models in LULC classification, providing a comprehensive understanding of their strengths and weaknesses.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The data generated and analyzed in this study are available from the corresponding author upon reasonable request.
References
Adegun, A. A., Viriri, S., & Tapamo, J. R. (2023). Review of deep learning methods for remote sensing satellite images classification: Experimental survey and comparative analysis. Journal of Big Data, 10(1), 93. https://doi.org/10.1186/s40537-023-00772-x
AlAfandy, K. A., Omara, H., Lazaar, M., & Al Achhab, M. (2020). Using classic networks for classifying remote sensing images: Comparative study. Advances in Science, Technology and Engineering Systems Journal, 5(5), 770–780. https://doi.org/10.25046/aj050594
Alshari, E. A., & Gawali, B. W. (2021). Development of a classification system for LULC using remote sensing and GIS. Global Transitions Proceedings, 2(1), 8–17. https://doi.org/10.1016/j.gltp.2021.01.002
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021). Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions. Journal of Big Data, 8, 1–74. https://doi.org/10.1186/s40537-021-00444-8
Barsi, Á., Kugler, Z., László, I., Szabó, G., & Abdulmutalib, H. M. (2018). Accuracy dimensions in remote sensing. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 42, 61–67. https://doi.org/10.5194/isprs-archives-XLII-3-61-2018
Basheer, S., Wang, X., Farooque, A. A., Nawaz, R. A., Liu, K., Adekanmbi, T., & Liu, S. (2022). Comparison of land use land cover classifiers using different satellite imagery and machine learning techniques. Remote Sensing, 14(19), 4978. https://doi.org/10.3390/rs14194978
Basu, S., Ganguly, S., Mukhopadhyay, S., DiBiano, R., Karki, M., & Nemani, R. (2015). DeepSAT: A learning framework for satellite imagery. In Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems, 1–10. https://doi.org/10.1145/2820783.2820816
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) A training algorithm for optimal margin classifiers. In Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, 144–152.
Boulila, W., Ghandorh, H., Khan, M. A., Ahmed, F., & Ahmad, J. (2021). A novel CNN-LSTM-based approach to predict urban expansion. Ecological Informatics, 64, 101325. https://doi.org/10.1016/j.ecoinf.2021.101325
Breiman, L. (2001). Random forests. Machine Learning, 45, 5–32. https://doi.org/10.1023/A:1010933404324
Broni-Bediako, C., Murata, Y., Mormille, L. H., & Atsumi, M. (2021). Searching for CNN architectures for remote sensing scene classification. IEEE Transactions on Geoscience and Remote Sensing, 60, 1–13. https://doi.org/10.1109/TGRS.2021.3097938
Carranza-García, M., García-Gutiérrez, J., & Riquelme, J. C. (2019). A framework for evaluating land use and land cover classification using convolutional neural networks. Remote Sensing, 11(3), 274. https://doi.org/10.3390/rs11030274
Castelluccio, M., Poggi, G., Sansone, C., & Verdoliva, L. (2015). Land use classification in remote sensing images by convolutional neural networks. ar**v:1508.00092. https://doi.org/10.48550/ar**v.1508.00092
Chaib, S., Liu, H., Gu, Y., & Yao, H. (2017). Deep feature fusion for VHR remote sensing scene classification. IEEE Transactions on Geoscience and Remote Sensing, 55(8), 4775–4784. https://doi.org/10.1109/TGRS.2017.2700322
Chaves, M. E. D., Picoli, M. C. A., & Sanches, I. D. (2020). Recent applications of Landsat 8/OLI and Sentinel-2/MSI for land use and land cover map**: A systematic review. Remote Sensing, 12(18), 3062. https://doi.org/10.3390/rs12183062
Chen, F., & Tsou, J. Y. (2021). DRSNet: Novel architecture for small patch and low-resolution remote sensing image scene classification. International Journal of Applied Earth Observation and Geoinformation, 104, 102577. https://doi.org/10.1016/j.jag.2021.102577
Chen, C., Zhang, P., Zhang, H., Dai, J., Yi, Y., Zhang, H., & Zhang, Y. (2020). Deep learning on computational-resource-limited platforms: A survey. Mobile Information Systems, 2020, 1–19. https://doi.org/10.1155/2020/8454327
Chen, W., Xu, Y., Zhang, Z., Yang, L., Pan, X., & Jia, Z. (2021). Map** agricultural plastic greenhouses using Google Earth images and deep learning. Computers and Electronics in Agriculture, 191, 106552. https://doi.org/10.1016/j.compag.2021.106552
Cheng, G., Han, J., & Lu, X. (2017). Remote sensing image scene classification: Benchmark and state of the art. Proceedings of the IEEE, 105(10), 1865–1883. https://doi.org/10.1109/JPROC.2017.2675998
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20, 273–297. https://doi.org/10.1007/BF00994018
Das, T. K., Barik, D. K., & Kumar, K. R. (2022). Land-use land-cover prediction from satellite images using machine learning techniques. In International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON), 338–343. IEEE. https://doi.org/10.1109/COM-IT-CON54601.2022.9850602
Dewangkoro, H. I., & Arymurthy, A. M. (2021). Land use and land cover classification using CNN, SVM, and channel squeeze & spatial excitation block. In IOP Conference Series: Earth and Environmental Science, 704(1), 012048. https://doi.org/10.1088/1755-1315/704/1/012048. IOP Publishing.
Digra, M., Dhir, R., & Sharma, N. (2022). Land use land cover classification of remote sensing images based on the deep learning approaches: A statistical analysis and review. Arabian Journal of Geosciences, 15(10), 1003. https://doi.org/10.1007/s12517-022-10246-8
Feizizadeh, B., MohammadzadeAlajujeh, K., Lakes, T., Blaschke, T., & Omarzadeh, D. (2021). A comparison of the integrated fuzzy object-based deep learning approach and three machine learning techniques for land use/cover change monitoring and environmental impacts assessment. Giscience & Remote Sensing, 58(8), 1543–1570. https://doi.org/10.1080/15481603.2021.2000350
Ferreira, L. M. R., Esteves, L. S., de Souza, E. P., & dos Santos, C. A. C. (2019). Impact of the urbanisation process in the availability of ecosystem services in a tropical ecotone area. Ecosystems, 22(2), 266–282. https://doi.org/10.1007/s10021-018-0270-0
Ferreira, F. L. V., Rodrigues, L. N., & da Silva, D. D. (2021). Influence of changes in land use and land cover and rainfall on the streamflow regime of a watershed located in the transitioning region of the Brazilian Biomes Atlantic Forest and Cerrado. Environmental Monitoring and Assessment, 193, 1–17. https://doi.org/10.1007/s10661-020-08782-5
Fix, E., & Hodges, J. L. (1952). Discriminatory analysis: Nonparametric discrimination: Small sample performance.
Gharbia, R., Khalifa, N. E. M., & Hassanien, A. E. (2020). Land cover classification using deep convolutional neural networks. In International Conference on Intelligent Systems Design and Applications, 911–920. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-71187-0_84
Günen, M. A. (2022). Performance comparison of deep learning and machine learning methods in determining wetland water areas using EuroSAT dataset. Environmental Science and Pollution Research, 29(14), 21092–21106. https://doi.org/10.1007/s11356-021-17177-z
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770–778. https://doi.org/10.1109/CVPR.2016.90
Helber, P., Bischke, B., Dengel, A., & Borth, D. (2019). Eurosat: A novel dataset and deep learning benchmark for land use and land cover classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(7), 2217–2226. https://doi.org/10.1109/JSTARS.2019.2918242
Iftenea, M., Liub, Q., & Wangc, Y. (2017). Very high resolution images classification by fusing deep convolutional neural networks. In The 5th International Conference on Advanced Computer Science Applications and Technologies (ACSAT 2017), 172–176. https://doi.org/10.23977/acsat.2017.1022
Iorga, C., & Neagoe, V. (2019). A deep CNN approach with transfer learning for image recognition. 2019 11th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), 1–6. https://doi.org/10.1109/ECAI46879.2019.9042173
Janiesch, C., Zschech, P., & Heinrich, K. (2021). Machine learning and deep learning. Electronic Markets, 31, 685–695. https://doi.org/10.1007/s12525-021-00475-2
Jozdani, S. E., Johnson, B. A., & Chen, D. (2019). Comparing deep neural networks, ensemble classifiers, and support vector machine algorithms for object-based urban land use/land cover classification. Remote Sensing, 11(14), 1713. https://doi.org/10.3390/rs11141713
Jozdani, S., Chen, D., Pouliot, D., & Johnson, B. A. (2022). A review and meta-analysis of generative adversarial networks and their applications in remote sensing. International Journal of Applied Earth Observation and Geoinformation, 108, 102734. https://doi.org/10.1016/j.jag.2022.102734
Kattenborn, T., Leitloff, J., Schiefer, F., & Hinz, S. (2021). Review on convolutional neural networks (CNN) in vegetation remote sensing. ISPRS Journal of Photogrammetry and Remote Sensing, 173, 24–49. https://doi.org/10.1016/j.isprsjprs.2020.12.010
Kavhu, B., Mashimbye, Z. E., & Luvuno, L. (2021). Climate-based regionalization and inclusion of spectral indices for enhancing transboundary land-use/cover classification using deep learning and machine learning. Remote Sensing, 13(24), 5054. https://doi.org/10.3390/rs13245054
Krivoguz, D., Chernyi, S. G., Zinchenko, E., Silkin, A., & Zinchenko, A. (2023). Using Landsat-5 for accurate historical LULC classification: A comparison of machine learning models. Data, 8(9), 138. https://doi.org/10.3390/data8090138
Kulkarni, K., & Vijaya, P. A. (2021). NDBI based prediction of land use land cover change. Journal of the Indian Society of Remote Sensing, 49(10), 2523–2537. https://doi.org/10.1007/s12524-021-01411-9
Laban, N., Abdellatif, B., Ebied, H. M., Shedeed, H. A., & Tolba, M. F. (2018). Performance enhancement of satellite image classification using a convolutional neural network. In Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2017, 673–682. Springer International Publishing. https://doi.org/10.1007/978-3-319-64861-3_63
Luus, F. P., Salmon, B. P., Van den Bergh, F., & Maharaj, B. T. J. (2015). Multiview deep learning for land-use classification. IEEE Geoscience and Remote Sensing Letters, 12(12), 2448–2452. https://doi.org/10.1109/LGRS.2015.2483680
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019). Deep learning in remote sensing applications: A meta-analysis and review. ISPRS Journal of Photogrammetry and Remote Sensing, 152, 166–177. https://doi.org/10.1016/j.isprsjprs.2019.04.015
Mahamunkar, G. S., & Netak, L. D. (2021). Comparison of various deep CNN models for land use and land cover classification. In International Conference on Intelligent Human Computer Interaction, 499–510. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-98404-5_46
Main-Knorn, M., Pflug, B., Louis, J., Debaecker, V., Müller-Wilm, U., & Gascon, F. (2017). Sen2Cor for sentinel-2. Image and Signal Processing for Remote Sensing XXIII, 10427, 37–48. https://doi.org/10.1117/12.2278218. SPIE.
Muhammad, U., Wang, W., Chattha, S. P., & Ali, S. (2018). Pre-trained VGGNet architecture for remote-sensing image scene classification. In 2018 24th International Conference on Pattern Recognition (ICPR), 1622–1627. IEEE. https://doi.org/10.1109/ICPR.2018.8545591
Naushad, R., Kaur, T., & Ghaderpour, E. (2021). Deep transfer learning for land use and land cover classification: A comparative study. Sensors, 21(23), 8083. https://doi.org/10.3390/s21238083
O'Shea, K., & Nash, R. (2015). An introduction to convolutional neural networks. ar**v preprint ar**v:1511.08458.
Ozturk, M. Y., & Colkesen, I. (2021). Evaluation of effectiveness of patch based image classification technique using high resolution WorldView-2 image. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 46, 417–423. https://doi.org/10.5194/isprs-archives-XLVI-4-W5-2021-417-2021
Pallavi, M., Thivakaran, T. K., & Ganapathi, C. (2022). A tile-based approach for the LULC classification of sentinel image using deep learning techniques. In 2022 International Conference for Advancement in Technology, 1–5. https://doi.org/10.1109/ICONAT53423.2022.9726030
Penatti, O. A. B., Nogueira, K., & Santos, J. A. D. (2015). Do deep features generalize from everyday objects to remote sensing and aerial scenes domains? Computer Vision Pattern Recognition, 44–51.
Petrovska, B., Zdravevski, E., Lameski, P., Corizzo, R., Štajduhar, I., & Lerga, J. (2020). Deep learning for feature extraction in remote sensing: A case-study of aerial scene classification. Sensors, 20(14), 3906. https://doi.org/10.3390/s20143906
Rajagopal, A., Ramachandran, A., Shankar, K., Khari, M., Jha, S., Lee, Y., & Joshi, G. P. (2020). Fine-tuned residual network-based features with latent variable support vector machine-based optimal scene classification model for unmanned aerial vehicles. IEEE Access, 8, 118396–118404. https://doi.org/10.1109/ACCESS.2020.3004233
Rawat, A. K., Banerjee, S., & Roy, A. K. (2020). Assessment of land use/land cover changes of potential growing fringe areas of Lucknow using remote sensing and GIS. In 2020 International Conference on Contemporary Computing and Applications (IC3A), 254–259. IEEE. https://doi.org/10.1109/IC3A48958.2020.233308
Rohith, G., & Kumar, L. S. (2020). Remote sensing signature classification of agriculture detection using deep convolution network models. In International Conference on Machine Learning, Image Processing, Network Security and Data Sciences, 343–355. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-6315-7_28
Sarkar, A., Yang, Y., & Vihinen, M. (2020). Variation benchmark datasets: Update, criteria, quality and applications. Database, 2020, baz117. https://doi.org/10.1093/database/baz117
Shafizadeh-Moghadam, H., Khazaei, M., Alavipanah, S. K., & Weng, Q. (2021). Google Earth Engine for large-scale land use and land cover map**: An object-based classification approach using spectral, textural and topographical factors. Giscience & Remote Sensing, 58(6), 914–928. https://doi.org/10.1080/15481603.2021.1947623
Sheng, G., Yang, W., Xu, T., & Sun, H. (2012). High-resolution satellite scene classification using a sparse coding based multiple feature combination. International Journal of Remote Sensing, 33(8), 2395–2412. https://doi.org/10.1080/01431161.2011.608740
Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. ar**v preprint ar**v:1409.1556.
Song, C., & Woodcock, C. E. (2003). Monitoring forest succession with multitemporal Landsat images: Factors of uncertainty. IEEE Transactions on Geoscience and Remote Sensing, 41(11), 2557–2567. https://doi.org/10.1109/TGRS.2003.818367
Sowmya, D. R., Deepa Shenoy, P., & Venugopal, K. R. (2017). Remote sensing satellite image processing techniques for image classification: A comprehensive survey. International Journal of Computer Applications, 161(11), 24–37. https://doi.org/10.1155/2022/5880959
Talukdar, S., Singha, P., Mahato, S., Pal, S., Liou, Y. A., & Rahman, A. (2020). Land-use land-cover classification by machine learning classifiers for satellite observations—A review. Remote Sensing, 12(7), 1135. https://doi.org/10.3390/rs12071135
Tassi, A., & Vizzari, M. (2020). Object-oriented LULC classification in google earth engine combining snic, glcm, and machine learning algorithms. Remote Sensing, 12(22), 3776. https://doi.org/10.3390/rs12223776
Temenos, A., Temenos, N., Kaselimi, M., Doulamis, A., & Doulamis, N. (2023). Interpretable deep learning framework for land use and land cover classification in remote sensing using SHAP. IEEE Geoscience and Remote Sensing Letters, 20, 1–5. https://doi.org/10.1109/LGRS.2023.3251652
Tesfay, F., Kibret, K., Gebrekirstos, A., & Hadgu, K. M. (2022). Land use and land cover dynamics and ecosystem services values in Kewet district in the central dry lowlands of Ethiopia. Environmental Monitoring and Assessment, 194(11), 801. https://doi.org/10.1007/s10661-022-10486-x
Thiagarajan, K., ManapakkamAnandan, M., Stateczny, A., BidareDivakarachari, P., & KivudujogappaLingappa, H. (2021). Satellite image classification using a hierarchical ensemble learning and correlation coefficient-based gravitational search algorithm. Remote Sensing, 13(21), 4351. https://doi.org/10.3390/rs13214351
Vapnik, V. (1999). The nature of statistical learning theory. Springer Science & Business Media. https://doi.org/10.1007/978-1-4757-3264-1
Vuolo, F., Żółtak, M., Pipitone, C., Zappa, L., Wenng, H., Immitzer, M., Weiss, M., Baret, F., & Atzberger, C. (2016). Data service platform for Sentinel-2 surface reflectance and value-added products: System use and examples. Remote Sensing, 8(11), 938. https://doi.org/10.3390/rs8110938
Wang, X., Xu, M., **ong, X., & Ning, C. (2020). Remote sensing scene classification using heterogeneous feature extraction and multi-level fusion. IEEE Access, 8, 217628–217641. https://doi.org/10.1109/ACCESS.2020.3042501
**a, G. S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L., & Lu, X. (2017). AID: A benchmark data set for performance evaluation of aerial scene classification. IEEE Transactions on Geoscience and Remote Sensing, 55(7), 3965–3981. https://doi.org/10.1109/TGRS.2017.2685945
**a, G. S., Yang, W., Delon, J., Gousseau, Y., Sun, H., & Maître, H. (2010). Structural high-resolution satellite image indexing.In ISPRS TC VII Symposium-100 Years ISPRS, 38, 298-303
Yaloveha, V., Hlavcheva, D., & Podorozhniak, A. (2021). Spectral indexes evaluation for satellite images classification using CNN. Journal of Information and Organizational Sciences, 45(2), 435–449. https://doi.org/10.31341/jios.45.2.5
Yang, Y., & Newsam, S. (2010). Bag-of-visual-words and spatial extensions for land-use classification. In Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, 270–279. https://doi.org/10.1145/1869790.1869829
Yassine, H., Tout, K., & Jaber, M. (2021). Improving lulc classification from satellite imagery using deep learning-eurosat dataset. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 43, 369–376. https://doi.org/10.5194/isprs-archives-XLIII-B3-2021-369-2021
Yifter, T., Razoumny, Y. N., & Lobanov, V. K. (2022). Deep transfer learning of satellite imagery for land use and land cover classification. Informatics and Automation, 21(5), 963–982. https://doi.org/10.15622/ia.21.5.5
Yun, J., & Woo, J. (2019). A comparative analysis of deep learning and machine learning on detecting movement directions using PIR sensors. IEEE Internet of Things Journal, 7(4), 2855–2868. https://doi.org/10.1109/JIOT.2019.2963326
Zhang, C., Li, Z., Jiang, H., Luo, Y., & Xu, S. (2021). Deep learning method for evaluating the photovoltaic potential of urban land-use: A case study of Wuhan, China. Applied Energy, 283, 116329. https://doi.org/10.1016/j.apenergy.2020.116329
Zhang, Y., & Ling, C. (2018). A strategy to apply machine learning to small datasets in materials science. Npj Computational Materials, 4(1). https://doi.org/10.1038/s41524-018-0081-z
Zhao, L., Tang, P., & Huo, L. (2016). Feature significance-based multibag-of-visual-words model for remote sensing image scene classification. Journal of Applied Remote Sensing, 10(3), 035004–035004. https://doi.org/10.1117/1.JRS.10.035004
Zhou, W., Newsam, S., Li, C., & Shao, Z. (2018). PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval. ISPRS Journal of Photogrammetry and Remote Sensing, 145, 197–209. https://doi.org/10.1016/j.isprsjprs.2018.01.004
Zou, Q., Ni, L., Zhang, T., & Wang, Q. (2015). Deep learning based feature selection for remote sensing scene classification. IEEE Geoscience and Remote Sensing Letters, 12(11), 2321–2325. https://doi.org/10.1109/LGRS.2015.2475299
Author information
Authors and Affiliations
Contributions
Nyenshu Seb Rengma and Manohar Yadav designed the conceptual framework of the study. Nyenshu Seb Rengma designed the methodology, conducted the experiment and wrote the initial manuscript with inputs from Manohar Yadav. Both Nyenshu Seb Rengma and Manohar Yadav reviewed and edited the final manuscript.
Corresponding author
Ethics declarations
Ethical approval
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Rengma, N.S., Yadav, M. Generation and classification of patch-based land use and land cover dataset in diverse Indian landscapes: a comparative study of machine learning and deep learning models. Environ Monit Assess 196, 568 (2024). https://doi.org/10.1007/s10661-024-12719-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10661-024-12719-7