SpringerLink
Log in

Hybrid Method: Automatic Crack Detection of Asphalt Pavement Images Using Learning-Based and Density-Based Techniques

  • Original Research Paper
  • Published:
International Journal of Pavement Research and Technology Aims and scope Submit manuscript

Abstract

Pavement distress is a major contributor to overall road quality degradation. Maintaining roadways with the use of a Pavement Management System requires an extensive and up-to-date inventory of the many types of roadway distress. Such inventory for a road network can be labor-intensive and time-consuming to create. This study introduces a novel method, called Hybrid Method, to detect asphalt pavement surface cracks based on 2D images. Hybrid Method consists of two separate techniques, proposed by this study, which are combined to detect cracks. The first is a supervised learning-based technique which requires annotated images. This approach utilizes the Local Binary Pattern (LBP) as a texture descriptor algorithm to encode image data. Random Forest is the classifier, employed to learn from the extracted LBP features and predict new observations. The second, density-based technique, relies primarily on thresholding. This technique searches for crack objects iteratively while considering their spatial and geometric properties. These techniques were merged to create a hybrid crack detection method that was found to be effective for detecting pavement surface cracks. Four datasets were analyzed using the proposed Hybrid Method, which resulted in an average precision, recall, and F1 scores of 90%, 78%, and 84%, respectively. The results suggest that the Hybrid Method performed well in challenging situations, such as images with shadows, road markings, and oil stains. Its performance on images of different resolutions, pavement textures, and lighting conditions was remarkable as well.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Huang, Y. H. (2004). Pavement analysis and design, 2nd ed. Prentice Hall. [Online]. Available: https://books.google.co.uk/books?id=OjRSAAAAMAAJ.

  2. Shahin, M. Y. (2005). Pavement management for airports, roads, and parking lots (2nd ed.). Springer. https://doi.org/10.1007/b101538

    Book  Google Scholar 

  3. Amhaz, R., Chambon, S., Idier, J., & Baltazart, V. (2016). Automatic crack detection on two-dimensional pavement images: An algorithm based on minimal path selection. IEEE Transactions on Intelligent Transportation Systems, 17(10), 2718–2729. https://doi.org/10.1109/TITS.2015.2477675

    Article  Google Scholar 

  4. Cui, L., Qi, Z., Chen, Z., Meng, F., & Shi, Y. ()2015). Pavement distress detection using random decision forests. In: Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 9208, pp 95–102. https://doi.org/10.1007/978-3-319-24474-7_14.

  5. Kapela, R. et al. (2015). Asphalt surfaced pavement cracks detection based on histograms of oriented gradients. In: Proc. 22nd Int. Conf. Mix. Des. Integr. Circuits Syst. Mix. 2015, pp. 579–584, https://doi.org/10.1109/MIXDES.2015.7208590.

  6. Oliveira, H., & Correia, P. L. (2013). Automatic road crack detection and characterization. IEEE Transactions on Intelligent Transportation Systems, 14(1), 155–168. https://doi.org/10.1109/TITS.2012.2208630

    Article  Google Scholar 

  7. Shi, Y., Cui, L., Qi, Z., Meng, F., & Chen, Z. (2016). Automatic road crack detection using random structured forests. IEEE Transactions on Intelligent Transportation Systems, 17(12), 3434–3445. https://doi.org/10.1109/TITS.2016.2552248

    Article  Google Scholar 

  8. Zou, Q., Cao, Y., Li, Q., Mao, Q., & Wang, S. (2012). CrackTree: Automatic crack detection from pavement images. Pattern Recognition Letters., 33(3), 227–238. https://doi.org/10.1016/j.patrec.2011.11.004

    Article  Google Scholar 

  9. Chacra, D. B. A., & Zelek, J. S. (2018). Fully automated road defect detection using street view images. In: Proc. - 2017 14th Conf. Comput. Robot Vision, CRV 2017, vol. 2018-Janua, pp. 353–360, https://doi.org/10.1109/CRV.2017.50.

  10. Oliveira, H., & Correia, P. L. (2014). CrackIT—An image processing toolbox for crack detection and characterization. In: 2014 IEEE Int. Conf. Image Process. ICIP 2014, pp. 798–802, https://doi.org/10.1109/ICIP.2014.7025160.

  11. Othman, C. P., Mushairry, M., & Tung-Chai, L. (2007). Automated pavement imaging program (APIP) for pavement cracks classification and quantification. Malaysian Journal of Civil Engineering., 19(1), 6.

    Google Scholar 

  12. Fernandes, K., & Ciobanu, L. (2014). Pavement pathologies classification using graph-based features. In: 2014 IEEE Int. Conf. Image Process. ICIP 2014, pp. 793–797, https://doi.org/10.1109/ICIP.2014.7025159.

  13. Hoang, N.-D., Nguyen, Q.-L., & Tien-Bui, D. (2018). Image processing-based classification of asphalt pavement cracks using support vector machine optimized by artificial bee colony. Journal of Computing in Civil Engineering., 32(5), 04018037. https://doi.org/10.1061/(asce)cp.1943-5487.0000781

    Article  Google Scholar 

  14. Lee, B. J., & Lee, H. D. (2004). Position-invariant neural network for digital pavement crack analysis. Computer‐Aided Civil and Infrastructure Engineering., 19(2), 105–118. https://doi.org/10.1111/j.1467-8667.2004.00341.x

    Article  Google Scholar 

  15. **g, L., & Aiqin, Z. (2010). Pavement crack distress detection based on image analysis. In: 2010 Int. Conf. Mach. Vis. Human-Machine Interface, MVHI 2010, pp. 576–579, https://doi.org/10.1109/MVHI.2010.10.

  16. Oliveira, H., & Correia, P. L. (2010). Automatic crack detection on road imagery using anisotropic diffusion and region linkage. In: Eur. Signal Process. Conf., pp. 274–278.

  17. Li, P., Wang, C., Li, S., & Feng, B. (2016). Research on crack detection method of airport runway based on twice-threshold segmentation. In: Proc. - 5th Int. Conf. Instrum. Meas. Comput. Commun. Control. IMCCC 2015, pp. 1716–1720, https://doi.org/10.1109/IMCCC.2015.364.

  18. Otsu, N. (1979). A threshold selection method from Gray-level histograms. IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-9, NO., (1): 62–66, 1979, [Online]. http://web.ics.purdue.edu/~kim497/ece661/OTSU_paper.pdf.

  19. Kun, X., Na, W., & Ronggui, M. (2013). Pavement crack image detection algorithm under nonuniform illuminance. IEEE.

  20. Tang, J., & Gu, Y. (2013). Automatic crack detection and segmentation using a hybrid algorithm for road distress analysis. In: Proc. - 2013 IEEE Int. Conf. Syst. Man, Cybern. SMC 2013, pp. 3026–3030, https://doi.org/10.1109/SMC.2013.516.

  21. Subirats, P., Fabre, O., Dumoulin, J., Legeay, V., & Barba, D. (2015). A combined wavelet-based image processing method for emergent crack detection on pavement surface images. In: Eur. Signal Process. Conf., vol. 06-10-Sept, pp. 257–260.

  22. Subirats, P., Dumoulin, J., Legeay, V., & Barba, D. (2006). Automation of pavement surface crack detection using the continuous wavelet transform. In: Proc. - Int. Conf. Image Process. ICIP, pp. 3037–3040, https://doi.org/10.1109/ICIP.2006.313007.

  23. Zhou, J. (2006). Wavelet-based pavement distress detection and evaluation. Optical Engineering., 45(2), 027007. https://doi.org/10.1117/1.2172917

    Article  Google Scholar 

  24. Wu, G., Sun, X., Zhou, L., Zhang, H., & Pu, J. (2015). Research on crack detection algorithm of asphalt pavement. In: 2015 IEEE Int. Conf. Inf. Autom. ICIA 2015 - conjunction with 2015 IEEE Int. Conf. Autom. Logist., pp. 647–652, https://doi.org/10.1109/ICInfA.2015.7279366.

  25. Witten, I. H., Frank, E., Hall, M. A., & Pal, C. J. (2016). Data Mining: Practical Machine Learning Tools and Techniques (pp. 1–621). Elsevier. https://doi.org/10.1016/c2009-0-19715-5

    Book  Google Scholar 

  26. Breiman, L. (1996). Bagging predictors. Machine Learning, 24(2), 123–140. https://doi.org/10.1007/bf00058655

    Article  MATH  Google Scholar 

  27. Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324

    Article  MATH  Google Scholar 

  28. Zuiderveld, K. (1994). Contrast limited adaptive histogram equalization. Graph Gems (pp. 474–485). Elsevier. https://doi.org/10.1016/b978-0-12-336156-1.50061-6

    Chapter  Google Scholar 

  29. Ojala, T., Pietikäinen, M., & Harwood, D. (1996). A comparative study of texture measures with classification based on feature distributions. Pattern Recognition., 29(1), 51–59. https://doi.org/10.1016/0031-3203(95)00067-4

    Article  Google Scholar 

  30. Ojala, T., Pietikäinen, M., & Mäenpää, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7), 971–987. https://doi.org/10.1109/TPAMI.2002.1017623

    Article  MATH  Google Scholar 

  31. Zhang, L., Yang, F., Daniel Zhang, Y., & Zhu, Y. J. (2016). Road crack detection using deep convolutional neural network. In: Proc. - Int. Conf. Image Process. ICIP, vol. 2016-Augus, pp. 3708–3712, https://doi.org/10.1109/ICIP.2016.7533052.

  32. Yang, F., Zhang, L., Yu, S., Prokhorov, D., Mei, X., & Ling, H. (2019). Feature pyramid and hierarchical boosting network for pavement crack detection. ar**v.

  33. Yu, J., Kim, D. Y., Lee, Y., & Jeon, M. (2020). Unsupervised pixel-level road defect detection via adversarial image-to-frequency transform. In: IEEE Intell. Veh. Symp. Proc., pp. 1708–1713, https://doi.org/10.1109/IV47402.2020.9304843.

Download references

Funding

No funding was received for conducting this study.

Author information

Authors and Affiliations

  1. Department of Civil Engineering, Sharif University of Technology, Tehran, Iran

    Mohammadreza Sabouri & Mohsen Mohammadi

Authors
  1. Mohammadreza Sabouri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohsen Mohammadi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammadreza Sabouri.

Ethics declarations

Conflict of Interest

The authors have no competing interests to declare that are relevant to the content of this article.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sabouri, M., Mohammadi, M. Hybrid Method: Automatic Crack Detection of Asphalt Pavement Images Using Learning-Based and Density-Based Techniques. Int. J. Pavement Res. Technol. (2023). https://doi.org/10.1007/s42947-023-00356-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42947-023-00356-1

Keywords

Search

Navigation