Uncertainty Analysis of Sea Ice and Open Water Classification on SAR Imagery Using a Bayesian CNN

  • Conference paper
  • First Online:
Pattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges (ICPR 2022)

Abstract

Algorithms designed for ice-water classification of synthetic aperture radar (SAR) sea ice imagery produce only binary (ice and water) output typically using manually labelled samples for assessment. This is limiting because only a small subset of samples are used which, given the non-stationary nature of the ice and water classes, will likely not reflect the full scene. To address this, we implement a binary ice-water classification in a more informative manner taking into account the uncertainty associated with each pixel in the scene. To accomplish this, we have implemented a Bayesian convolutional neural network (CNN) with variational inference to produce both aleatoric (data-based) and epistemic (model-based) uncertainty. This valuable information provides feedback as to regions that have pixels more likely to be misclassified and provides improved scene interpretation. Testing was performed on a set of 21 RADARSAT-2 dual-polarization SAR scenes covering a region in the Beaufort Sea captured regularly from April to December. The model is validated by demonstrating; (i) a positive correlation between misclassification rate and model uncertainty and (ii) a higher uncertainty during the melt and freeze-up transition periods, which are more challenging to classify. Integration of the Iterative Region Growing with Semantics (IRGS) unsupervised segmentation algorithm with the Bayesian CNN outputs generates improved classification results, with notable improved results via visual inspection even when sample-based classification rates are similar.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Li, X.-M., Sun, Y., Zhang, Q.: Extraction of sea ice cover by Sentinel-1 SAR based on support vector machine with unsupervised generation of training data. IEEE Trans. Geosci. Remote Sens. 59(4), 3040–3053 (2021)

    Article  Google Scholar 

  2. Lyu, H., Huang, W., Mahdianpari, M.: A meta-analysis of sea ice monitoring using spaceborne polarimetric SAR: advances in the last decade. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 15, 6158–6179 (2022)

    Google Scholar 

  3. **e, T., Perrie, W., Wei, C., Zhao, L.: Discrimination of open water from sea ice in the Labrador sea using quad-polarized synthetic aperture radar. Remote Sens. Environ. 247, 111948 (2020)

    Article  Google Scholar 

  4. Karvonen, J.A.: Baltic sea ice SAR segmentation and classification using modified pulse-coupled neural networks. IEEE Trans. Geosci. Remote Sens. 42(7), 1566–1574 (2004)

    Article  Google Scholar 

  5. Ochilov, S., Clausi, D.A.: Operational SAR sea-ice image classification. IEEE Trans. Geosci. Remote Sens. 50(11), 4397–4408 (2012)

    Article  Google Scholar 

  6. Leigh, S., Wang, Z., Clausi, D.A.: Automated ice-water classification using dual polarization SAR satellite imagery. IEEE Trans. Geosci. Remote Sens. 52(9), 5529–5539 (2013)

    Article  Google Scholar 

  7. Zakhvatkina, N., Korosov, A., Muckenhuber, S., Sandven, S., Babiker, M.: Operational algorithm for ice-water classification on dual-polarized RADARSAT-2 images. Cryosphere 11(1), 33–46 (2017)

    Article  Google Scholar 

  8. Tan, W., Li, J., Xu, L., Chapman, M.A.: Semiautomated segmentation of Sentinel-1 SAR imagery for map** sea ice in Labrador coast. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 11(5), 1419–1432 (2018)

    Google Scholar 

  9. Zhang, Y., et al.: Sea ice and water classification on dual-polarized sentinel-1 imagery during melting season. Cryosphere Discuss. 1–26 (2021)

    Google Scholar 

  10. Boulze, H., Korosov, A., Brajard, J.: Classification of sea ice types in Sentinel-1 SAR data using convolutional neural networks. Remote Sens. 12(13), 2165 (2020)

    Article  Google Scholar 

  11. Ren, Y., Li, X., Yang, X., Xu, H.: Development of a dual-attention U-Net model for sea ice and open water classification on SAR images. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2021)

    Google Scholar 

  12. Wang, Y.-R., Li, X.-M.: Arctic sea ice cover data from spaceborne synthetic aperture radar by deep learning. Earth Syst. Sci. Data 13(6), 2723–2742 (2021)

    Article  Google Scholar 

  13. Lyu, H., Huang, W., Mahdianpari, M.: Eastern arctic sea ice sensing: first results from the RADARSAT constellation mission data. Remote Sens. 14(5), 1165 (2022)

    Article  Google Scholar 

  14. Jiang, M., Xu, L., Clausi, D.A.: Sea ice-water classification of RADARSAT-2 imagery based on residual neural networks (ResNet) with regional pooling. Remote Sens. 14(13), 3025 (2022)

    Article  Google Scholar 

  15. Abdar, M., et al.: A review of uncertainty quantification in deep learning: techniques, applications and challenges. Inf. Fusion 76, 243–297 (2021)

    Article  Google Scholar 

  16. Hüllermeier, E., Waegeman, W.: Aleatoric and epistemic uncertainty in machine learning: An introduction to concepts and methods. Mach. Learn. 110(3), 457–506 (2021)

    Article  MathSciNet  MATH  Google Scholar 

  17. Asadi, N., Scott, K.A., Komarov, A.S., Buehner, M., Clausi, D.A.: Evaluation of a neural network with uncertainty for detection of ice and water in SAR imagery. IEEE Trans. Geosci. Remote Sens. 59(1), 247–259 (2020)

    Article  Google Scholar 

  18. Li, F., Clausi, D.A., Wang, L., Xu, L.: A semi-supervised approach for ice-water classification using dual-polarization SAR satellite imagery. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 28–35 (2015)

    Google Scholar 

  19. Wang, L., Scott, K.A., Xu, L., Clausi, D.A.: Sea ice concentration estimation during melt from dual-pol SAR scenes using deep convolutional neural networks: a case study. IEEE Trans. Geosci. Remote Sens. 54(8), 4524–4533 (2016)

    Article  Google Scholar 

  20. Graves, A.: Practical variational inference for neural networks. Adv. Neural Inf. Process. Syst. 24 (2011)

    Google Scholar 

  21. Kingma, D.P., Salimans, T., Welling, M.: Variational dropout and the local reparameterization trick. Adv. Neural Inf. Process. Syst. 28 (2015)

    Google Scholar 

  22. Gal, Y., Ghahramani, Z.: Bayesian convolutional neural networks with bernoulli approximate variational inference, ar**v preprint ar**v:1506.02158 (2016)

  23. Shridhar, K., Laumann, F., Liwicki, M.: A comprehensive guide to bayesian convolutional neural network with variational inference, ar**v preprint ar**v:1901.02731 (2019)

  24. Blundell, C., Cornebise, J., Kavukcuoglu, K., Wierstra, D.: Weight uncertainty in neural network. In: Proceedings of Machine Learning Research, PMLR, pp. 1613–1622 (2015)

    Google Scholar 

  25. Shridhar, K., Laumann, F., Liwicki, M.: Uncertainty estimations by softplus normalization in bayesian convolutional neural networks with variational inference, ar**v preprint ar**v:1806.05978 (2018)

  26. Kingma, D.P., Welling, M.: Auto-encoding variational bayes, ar**v preprint ar**v:1312.6114 (2014)

  27. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25 (2012)

    Google Scholar 

  28. Kwon, Y., Won, J.-H., Kim, B.J., Paik, M.C.: Uncertainty quantification using bayesian neural networks in classification: application to biomedical image segmentation. Comput. Stat. Data Anal. 142, 106816 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  29. Ghanbari, M., Clausi, D.A., Xu, L., Jiang, M.: Contextual classification of sea-ice types using compact polarimetric SAR data. IEEE Trans. Geosci. Remote Sens. 57(10), 7476–7491 (2019)

    Article  Google Scholar 

  30. Yu, Q., Clausi, D.A.: IRGS: image segmentation using edge penalties and region growing. IEEE Trans. Pattern Anal. Mach. Intell. 30(12), 2126–2139 (2008)

    Article  Google Scholar 

  31. Vincent, L., Soille, P.: Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. 13(06), 583–598 (1991)

    Article  Google Scholar 

  32. Clausi, D., Qin, A., Chowdhury, M., Yu, P., Maillard, P.: Magic: map-guided ice classification system. Can. J. Remote Sens. 36(sup1), S13–S25 (2010)

    Article  Google Scholar 

  33. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization, ar**v preprint ar**v:1412.6980 (2014)

  34. Kendall, A., Gal, Y.: What uncertainties do we need in bayesian deep learning for computer vision? Adv. Neural Inf. Process. Syst. 30 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to **nwei Chen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chen, X., Scott, K.A., Clausi, D.A. (2023). Uncertainty Analysis of Sea Ice and Open Water Classification on SAR Imagery Using a Bayesian CNN. In: Rousseau, JJ., Kapralos, B. (eds) Pattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges. ICPR 2022. Lecture Notes in Computer Science, vol 13645. Springer, Cham. https://doi.org/10.1007/978-3-031-37731-0_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-37731-0_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-37730-3

  • Online ISBN: 978-3-031-37731-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation