Skip to main content
Log in

Image Fusion for Improved Detection of Near-Surface Defects in NDT-CE Using Unsupervised Clustering Methods

  • Published:
Journal of Nondestructive Evaluation Aims and scope Submit manuscript

Abstract

The capabilities of non-destructive testing (NDT) methods for defect detection in civil engineering are characterized by their different penetration depth, resolution and sensitivity to material properties. Therefore, in many cases multi-sensor NDT has to be performed, producing large data sets that require an efficient data evaluation framework. In this work an image fusion methodology is proposed based on unsupervised clustering methods. Their performance is evaluated on ground penetrating radar and infrared thermography data from laboratory concrete specimens with different simulated near-surface defects. It is shown that clustering could effectively partition the data for further feature level-based data fusion by improving the detectability of defects simulating delamination, voids and localized water. A comparison with supervised symbol level fusion shows that clustering-based fusion outperforms this, especially in situations with very limited knowledge about the material properties and depths of the defects. Additionally, clustering is successfully applied in a case study where a multi-sensor NDT data set was automatically collected by a self-navigating mobile robot system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. McCann, D.M., Forde, M.C.: Review of NDT methods in the assessment of concrete and masonry structures. NDT E Int. 34, 71–84 (2001)

    Article  Google Scholar 

  2. Beutel, R., Reinhardt, H.W., Grosse, C.U., Glaubitt, A., Krause, M., Maierhofer, C., et al.: Comparative performance tests and validation of NDT methods for concrete testing. J. Nondestruct. Eval. 27, 59–65 (2008)

    Article  Google Scholar 

  3. Shokouhi, P., Wiggenhauser, H.: Multi-probe ultrasonic testing for detection of delamination in concrete bridge decks. TRB Annual Meeting Online (AMOnline). http://amonline.trb.org/1sl7d2/1 (2011). Accessed 5 January 2013

  4. Maierhofer, C., Arndt, R., Röllig, M., Rieck, C., Walther, A., Scheel, H., et al.: Application of impulse-thermography for non-destructive assessment of concrete structures. Cem. Concr. Compos. 28, 393–401 (2006)

    Article  Google Scholar 

  5. Cotič, P., Jagličić Z, Bosiljkov, V.: Validation of non-destructive characterization of the structure and seismic damage propagation of plaster and texture in multi-leaf stone masonry walls of cultural-artistic value. J. Cult. Herit. (2013). doi:10.1016/j.culher.2013.11.004

  6. Cotic, P., Jaglicic, Z., Niederleithinger, E., Effner, U., Kruschwitz, S., Trela, C., et al.: Effect of moisture on the reliability of void detection in brickwork masonry using radar, ultrasonic and complex resistivity tomography. Mater. Struct. 46, 1723–1735 (2013). doi:10.1617/s11527-012-0011-3

    Article  Google Scholar 

  7. Maierhofer, C., Wöstmann, J.: Investigation of dielectric properties of brick materials as a function of moisture and salt content using a microwave impulse technique at very high frequencies. NDT E Int. 31(4), 259–263 (1998)

    Article  Google Scholar 

  8. Maierhofer, C., Zacher, G., Kohl, C., Wöstmann, J.: Evaluation of radar and complementary echo methods for NDT of concrete elements. J. Nondestruct. Eval. 27, 47–57 (2008)

    Article  Google Scholar 

  9. Wiggenhauser, H.: Advanced NDT methods for quality assurance of concrete structures. In: Proceedings NDTCE’09, Non-destructive testing in civil engineering. LCPC, Paris (2009)

  10. Gros, X.E., Bousigue, J., Takahashi, K.: NDT data fusion at pixel level. NDT E Int. 32, 283–292 (1999)

    Article  Google Scholar 

  11. Gros, X.E., Liu, Z., Tsukada, K., Hanasaki, K.: Experimenting with pixel-level NDT data fusion techniques. IEEE T Instrum. Meas. 49(5), 1083–1090 (2000)

    Article  Google Scholar 

  12. Liu, Z., Forsyth, D.S., Safizadeh, M.S., Fahr, A.: A data-fusion scheme for quantitative image analysis by using locally weighted regression and Dempster–Shafer theory. IEEE T Instrum. Meas. 57(11), 2554–2560 (2008)

    Article  Google Scholar 

  13. Balakrishnan, S., Cacciola, M., Udpa, L., Rao, B.P., Jayakumar, T., Raj, B.: Development of image fusion methodology using discrete wavelet transform for eddy current images. NDT E Int. 51, 51–57 (2012)

    Article  Google Scholar 

  14. Kohl, C., Krause, M., Maierhofer, C., Wöstmann, J.: 2D-and 3D-visualisation of NDT-data using data fusion technique. Mater. Struct. 38, 817–826 (2005)

    Article  Google Scholar 

  15. Cui, J., Huston, D.R., Arndt, R., Jalinoos, F.: Data fusion techniques of multiple sensors nondestructive evaluation of a concrete bridge deck. TRB Annual Meeting Online (AMOnline). http://amonline.trb.org/2vdh1b/2vdh1b/1 (2010). Accessed 11 February 2012

  16. Bensaid, A.M., Hall, L.O., Bezdek, J.C., Clarke, L.P., Silbiger, M.L., Arrington, J.A., et al.: Validity-guided (re)clustering with applications to image segmentation. IEEE T Fuzzy Syst. 4(2), 112–123 (1996)

    Article  Google Scholar 

  17. Santoro, M., Prevete, R., Cavallo, L., Catanzariti, E.: Mass detection in mammograms using gabor filters and fuzzy clustering. In: Bloch, I., Petrosino, A., Tettamanzi, A.G.B. (eds.) Fuzzy logic and applications. WILF 2005: Proceedings of the 6th international workshop, pp. 334–343. Springer, Berlin (2006)

  18. Cotič, P., Niederleithinger, E., Wilsch, G.: Unsupervised clustering of spatially acquired laser-induced breakdown spectroscopy data from concrete. Cem. Concr. Res. (submitted)

  19. Cotič, P., Niederleithinger, E., Bosiljkov, V., Jagličić, Z.: NDT data fusion for the enhancement of defect visualization in concrete. Key Eng. Mater. 569–570, 175–182 (2013)

    Google Scholar 

  20. Liu, Z., Forsyth, D.S., Komorowski, J.P., Hanasaki, K., Kirubarajan, T.: Survey: state of the art in NDE data fusion techniques. IEEE T Instrum. Meas. 56, 2435–2451 (2007)

    Article  Google Scholar 

  21. Kaftandjian, V., Zhu, Y.M., Dupuis, O., Babot, D.: The combined use of the evidence theory and fuzzy logic for improving multimodal nondestructive testing systems. IEEE T Instrum. Meas. 54(5), 1968–1977 (2005)

    Article  Google Scholar 

  22. Bogaerta, P., Fasbender, D.: Bayesian data fusion in a spatial prediction context: a general formulation. Stoch Environ. Res. Risk Assess. 21, 695–709 (2007)

    Article  MathSciNet  Google Scholar 

  23. Li, G., Huang, P., Chen, P., Hou, D., Zhang, G., Zhou, Z. Application of multi-sensor data fusion in defects evaluation based on Dempster–Shafer theory. IEEE Xplore Digital Library. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=5944335 (2011). Accessed 13 February 2012

  24. Höppner, F., Klawonn, F., Kruse, R., Runkler, T.: Fuzzy cluster analysis: methods for classification, data analysis and image recognition, 1st edn. Wiley, Chichester (1999)

    MATH  Google Scholar 

  25. MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. Proceedings of the 5th Berkeley symposium on mathematical statistics and probability, vol 1: Statistics, pp. 281–297. University of California Press, Berkeley (1967)

    Google Scholar 

  26. Bezdek, J.Z.: Pattern recognition with fuzzy objective function algorithms. Plenum Press, New York (1981)

    Book  MATH  Google Scholar 

  27. Gustafson, D., Kessel, W.: Fuzzy clustering with a fuzzy covariance matrix. Proceedings of the 1978 IEEE conference on decision and control including the 17th Symposium on adaptive processes, pp. 761–766. IEEE Control Systems Society, San Diego (1979)

    Google Scholar 

  28. Dave, R.N.: Use of the adaptive fuzzy clustering algorithm to detect lines in digital images. In: Casasent, D.P. (ed.) Intelligent robots and computer vision VIII: algorithms and techniques, vol 1192. SPIE, pp. 600–611 (1990)

  29. Krishnapuram, R., Kim, J.: A note on the Gustafson-Kessel and adaptive fuzzy clustering algorithms. IEEE T Fuzzy Syst. 7(4), 453–461 (1999)

    Article  Google Scholar 

  30. Babuška, R., van der Veen, P.J., Kaymak, U.: Improved covariance estimation for Gustafson-Kessel clustering. In: Proceedings of the 2002 IEEE international conference on fuzzy systems, vol 2. IEEE, pp. 1081–1085 (2002)

  31. Kruse, R., Döring, C., Lesot, M.J.: Fundamentals of fuzzy clustering. In: Oliveira, J.V., Pedrycz, W. (eds.) Advances in fuzzy clustering and its applications, pp. 3–30. Wiley, Chichester (2007)

    Google Scholar 

  32. Dave, R.N.: Characterization and detection of noise in clustering. Pattern Recogn. Lett. 12(11), 657–664 (1991)

    Article  Google Scholar 

  33. Krishnapuram, R., Keller, J.M.: The possibilistic c-means algorithm: insights and recommendations. IEEE Trans. Fuzzy Syst. 4(3), 385–393 (1996)

    Article  Google Scholar 

  34. Pal, N.R., Pal, K., Bezdek, J.C.: A mixed c-means clustering model. In: Proceedings of the 6th IEEE international conference on fuzzy systems, vol 1. IEEE, pp. 11–21 (1997)

  35. Timm, H., Borgelt, C., Kruse, R.: Fuzzy cluster analysis with cluster repulsion. CiteSeer\(^{X}_{\beta }\). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.100.9787 (2001). Accessed 16 November 2012

  36. Pal, N.R., Pal, K., Keller, J.M., Bezdek, J.C.: A possibilistic fuzzy c-means clustering algorithm. IEEE T Fuzzy Syst. 13(4), 517–530 (2005)

    Article  MathSciNet  Google Scholar 

  37. Daniels, J.D. (ed.): Ground-penetrating radar, 2nd edn. The Institution of Electrical Engineers, London (2004)

    Google Scholar 

  38. Jol, H. (ed.): Ground penetrating radar: theory and applications, 1st edn. Elsevier Science, Amsterdam, Oxford (2009)

    Google Scholar 

  39. Maierhofer, C., Röllig, M.: Application of active thermography to the detection of safety relevant defects in civil engineering structures. In: Proceedings OPTO 2009 & IRS\(^{2}\) 2009. AMA, pp. 215–220 (2009)

  40. Maldague, X.P., Marinetti, S.: Pulse phase infrared thermography. J. Appl. Phys. 79, 2694–2698 (1996)

    Google Scholar 

  41. Arndt, R.: Square pulse thermography in frequency domain. SPIE Digital Library. http://proceedings.spiedigitallibrary.org/proceeding.aspx?articleid=834339 (2008). Accessed 13 September 2012

  42. Vavilov, V., Burleigh, D.: Heat transfer. In: Maldague, X., Moore, P.O. (eds.) Nondestructive handbook, infrared and thermal testing, vol. 3, 3rd edn. ASNT Press, Columbus (2001)

    Google Scholar 

  43. Weritz, F., Arndt, R., Röllig, M., Maierhofer, C., Wiggenhauser, H.: Investigation of concrete structures with pulse phase thermography. Mater. Struct. 38, 843–849 (2005)

    Google Scholar 

  44. Altman, D.G., Bland, J.M.: Statistics notes: diagnostic tests 1: sensitivity and specificity. BMJ 308, 1552 (1994)

    Article  Google Scholar 

  45. Cotič, P., Jagličić, Z., Bosiljkov, V., Niederleithinger, E.: GPR and IR thermography for near-surface defect detection in building structures. In: Grum, J. (ed.) Proceedings of the 12th international conference of the Slovenian society for non-destructive testing, Application of Contemporary Non-Destructive Testing in Engineering. Slovenian Society for Nondestructive testing, Ljubljana (2013)

  46. Shafer, G.: A mathematical theory of evidence. Princeton University Press, Princeton (1976)

    MATH  Google Scholar 

  47. Stoppel, M., Taffe, A., Wiggenhauser, H., Kurz, J.H., Boller, C.: Automated multi-sensor systems in civil engineering for condition assessment of concrete structures. In: Grantham, M. (ed.) Proceedings of the 4th International Conference on Concrete Repair, pp. 397–403. CRC Press, Boca Raton (2011)

    Google Scholar 

  48. Krause, H.J., Rath, E., Sawade, G., Dumat, F.: Radar-Magnet-Betontest: Eine neue Methode zur Bestimmung der Feuchte und des Chloridgehalts von Brückenfahrbahnplatten aus Beton. Beton- und Stahlbetonbau 102(12), 825–834 (2007)

    Article  Google Scholar 

  49. Reichling, K., Raupach, M., Wiggenhauser, H., Stoppel, M., Dobmann, G., Kurz, J.: BETOSCAN: an instrumented mobile robot system for the diagnosis of reinforced concrete floors. Restor. Build. Monum. 15(4), 277–286 (2009)

    Google Scholar 

Download references

Acknowledgments

The first author acknowledges the financial support of the Slovenian Research Agency through grant 1000-10-310156 and the Slovene Human Resources and Scholarship Fund through grant 11012-13/2012. The authors wish to thank Dr. Hans-Joachim Krause and colleagues for the radar-magnetic data set. Contributions and support from Assoc. Prof. Violeta Bokan Bosiljkov, Primož Murn and Dr. Parisa Shokouhi are acknowledged.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Patricia Cotič.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cotič, P., Jagličić, Z., Niederleithinger, E. et al. Image Fusion for Improved Detection of Near-Surface Defects in NDT-CE Using Unsupervised Clustering Methods. J Nondestruct Eval 33, 384–397 (2014). https://doi.org/10.1007/s10921-014-0232-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10921-014-0232-1

Keywords

Navigation