Skip to main content

Implementing textural features on GPUs for improved real-time pavement distress detection

Journal of Real-Time Image Processing volume 16, pages 1383–1394 (2019)Cite this article

Abstract

The condition of municipal roads has deteriorated considerably in recent years, leading to large scale pavement distress such as cracks or potholes. In order to enable road maintenance, pavement distress should be timely detected. However, manual investigation, which is still the most widely applied approach toward pavement assessment, puts maintenance personnel at risk and is time-consuming. During the last decade, several efforts have been made to automatically assess the condition of the municipal roads without any human intervention. Vehicles are equipped with sensors and cameras in order to collect data related to pavement distress and record videos of the pavement surface. Yet, this data are usually not processed while driving, but instead it is recorded and later analyzed off-line. As a result, a vast amount of memory is required to store the data and the available memory may not be sufficient. To reduce the amount of saved data, the authors have previously proposed a graphics processing units (GPU)-enabled pavement distress detection approach based on the wavelet transform of pavement images. The GPU implementation enables pavement distress detection in real time. Although the method used in the approach provides very good results, the method can still be improved by incorporating pavement surface texture characteristics. This paper presents an implementation of textural features on GPUs for pavement distress detection. Textural features are based on gray-tone spatial dependencies in an image and characterize the image texture. To evaluate the computational efficiency of the GPU implementation, performance tests are carried out. The results show that the speedup achieved by implementing the textural features on the GPU is sufficient to enable real-time detection of pavement distress. In addition, classification results obtained by applying the approach on 16,601 pavement images are compared to the results without integrating textural features. There results demonstrate that an improvement of 27% is achieved by incorporating pavement surface texture characteristics.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

References

  1. AMD: Opencl™ optimization case study: simple reductions. http://developer.amd.com/resources/documentation-articles/articles-whitepapers/opencl-optimization-case-study-simple-reductions/ (2014). Accessed 09 Nov 2015

  2. Banger, R., Bhattacharyya, K.: OpenCL Programming by Example. Packt Publishing Ltd., Birmingham (2013)

    Google Scholar 

  3. Cafiso, S., Graziano, A.D., Battiato, S.: Evaluation of pavement surface distress using digital image collection and analysis. In: Seventh International Congress on Advances in Civil Engineering (2006)

  4. Fang, C., Zhe, L., Li, Y.: Images crack detection technology based on improved k means algorithm. J. Multimed. 9, 822–828 (2014)

    Article  Google Scholar 

  5. Georgieva, K., Koch, C., König, M.: Wavelet transform on multi-GPU for real-time pavement distress detection, In: Proceedings of the 2015 ASCE International Workshop on Computing in Civil Engineering’, Austin, USA (2015)

  6. Haralick, R., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 3(6), 610–621 (1973)

    Article  Google Scholar 

  7. Harris, M.: Optimizing parallel reduction in CUDA. https://docs.nvidia.com/cuda/samples/6_Advanced/reduction/doc/reduction (2007). Accessed 09 Nov 2015

  8. Huang, Y., Xu, B.: Automatic inspection of pavement cracking distress. J. Electron. Imaging 15(1), 013017 (2006)

    Article  Google Scholar 

  9. Intel Corporation: Intel® SDK for OpenCL* Applications 2013 R2 Optimization Guide, Document Number: 326542-003US (2013)

  10. Jain, R., Kasturi, R., Schunck, B.: Machine Vision. McGraw-Hill, New York (1995)

    Google Scholar 

  11. Khronos OpenCL Working Group: The opencl specification, version: 2.0. document revision 19 (2013)

  12. Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., Fieguth, P.: A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv. Eng. Inform. 29(196), 210 (2015)

    Google Scholar 

  13. Li, L., Sun, L., Ning, G., Tan, S.: Automatic pavement crack recognition based on bp neural network. PROMET-Traffic & Transp. 26(1), 11–22 (2014)

    Article  Google Scholar 

  14. Moussa, G., Hussain, K.: A new technique for automatic detection and parameters estimation of pavement crack. In: 4th International Multi-Conference on Engineering Technology Innovation (IMETI 2011) (2011)

  15. NVIDIA Corporation: NVIDIA’s Next Generation CUDA Compute Architecture: Kepler GK110/210, Whitepaper, V. 1.1. http://international.download.nvidia.com/pdf/kepler/NVIDIA-Kepler-GK110-GK210-Architecture-Whitepaper (2014)

  16. NVIDIA Corporation: CUDA zone. https://developer.nvidia.com/cuda-zone (2015). Accessed 11 June 2015

  17. Oliveira, H., Correia, P.: Automatic road crack detection and characterization. IEEE Trans. Intell. Transp. Syst. 14, 155–168 (2013)

    Article  Google Scholar 

  18. Owens, J.D., Luebke, D., Govindaraju, N., Harris, M., Krüger, J., Lefohn, A.E., Purcell, T.J.: A survey of general-purpose computation on graphics hardware. Technical report, Eurographics, State of the Art Reports, pp. 21–51 (2005)

  19. Pearson, K.: Contributions to the mathematical theory of evolution. ii. Skew variation in homogeneous material. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 186, 343414 (1895)

    Article  Google Scholar 

  20. Podlozhnyuk, V.: Histogram calculation in CUDA. http://developer.download.nvidia.com/compute/cuda/1.1-Beta/x86_website/projects/histogram64/doc/histogram (2007). Accessed 07 Dec 2015

  21. Quinlan, J.R.: C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA (1993)

  22. Radopoulou, S., Brilakis, I.: Improving patch distress detection using vision tracking on video data. In: Proceedings of the 21st International Workshop on Intelligent Computing in Engineering, Cardiff, UK (2014)

  23. Rodriguez, J.J., Kuncheva, L.I.: Rotation forest: a new classifier ensemble method. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1619–1630 (2006)

    Article  Google Scholar 

  24. Salman, M., Mathavan, S. Kamal, K., Rahman, M.: Pavement crack detection using the Gabor filter. In: 16th International IEEE Conference on Intelligence Transportation System (ITSC 2013), pp. 2039–2044 (2013)

  25. Scarpino, M.: OpenCL in Action. Manning Publications, Shelter Island (2012)

    Google Scholar 

  26. Subirats, P., Dumoulin, J., Legeay, V., Barba, D.: Automation of pavement surface crack detection using the continuous wavelet transform. In: International Conference on Image Processing, Atlanta, USA (2006)

  27. Tanaka, N., Uematsu, K.: A crack detection method in road surface images using morphology. In: IAPR Workshop on Machine Vision Applications, Makuhari, Japan (1998)

  28. Tay, R.: OpenCL Parallel Programming Development Cookbook. Packt Publishing Ltd., Birmingham (2013)

    Google Scholar 

  29. Varadharajan, S., Jose, S., Sharma, K., Wander, L., Mertz, C.: Vision for road inspection. In: Proceedings of WACV 2014: IEEE Winter Conference on Applications of Computer Vision (2014)

  30. Vivekanandreddy, N.D., Kammar, A., Sowmyashree, B.: Hough transforms to detect and classify road cracks. Int. J. Eng. Res. & Tech. 3(6) (2014)

  31. Witten, I.H., Frank, E., Hall, M.A.: Data Mining: Practical Machine Learning Tools and Techniques, 3rd edn. Elsevier, Amsterdam (2011)

    Google Scholar 

  32. Yu, X., Salari, E.: Pavement pothole detection and severity measurement using laser imaging. In: IEEE International Conference on Electro/Information Technology (EIT), Mankato, USA (2001)

  33. Zhou, J., Huang, P., Chiang, F.-P.: Wavelet-based pavement distress detection and evaluation. Opt. Eng. 45(2). doi:10.1117/1.2172917 (2006)

  34. Zou, Q., Cao, Y., Li, Q., Mao, Q., Wang, S.: CrackTree: automatic crack detection from pavement images. Pattern Recognit. Lett. 33, 227238 (2012)

    Article  Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge the support of this ongoing project by the German Research Foundation (DFG) under Grant KO4311/2-1.

Author information

Authors and Affiliations

  1. Ruhr-University Bochum, Universitaetsstr. 150, Gebaeude IC 6-69, 44780, Bochum, Germany

    Kristina Doycheva & Markus König

  2. University of Nottingham, Room B67 Coates Building, University Park, Nottingham, NG7 2RD, UK

    Christian Koch

Authors
  1. Kristina Doycheva
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christian Koch
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Markus König
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kristina Doycheva.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Doycheva, K., Koch, C. & König, M. Implementing textural features on GPUs for improved real-time pavement distress detection. J Real-Time Image Proc 16, 1383–1394 (2019). https://doi.org/10.1007/s11554-016-0648-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-016-0648-1

Keywords

  • Pavement distress detection
  • Textural features
  • Haralick features
  • Graphics processing units