Abstract
The capabilities of non-destructive testing (NDT) methods for defect detection in civil engineering are characterized by their different penetration depth, resolution and sensitivity to material properties. Therefore, in many cases multi-sensor NDT has to be performed, producing large data sets that require an efficient data evaluation framework. In this work an image fusion methodology is proposed based on unsupervised clustering methods. Their performance is evaluated on ground penetrating radar and infrared thermography data from laboratory concrete specimens with different simulated near-surface defects. It is shown that clustering could effectively partition the data for further feature level-based data fusion by improving the detectability of defects simulating delamination, voids and localized water. A comparison with supervised symbol level fusion shows that clustering-based fusion outperforms this, especially in situations with very limited knowledge about the material properties and depths of the defects. Additionally, clustering is successfully applied in a case study where a multi-sensor NDT data set was automatically collected by a self-navigating mobile robot system.
Similar content being viewed by others
References
McCann, D.M., Forde, M.C.: Review of NDT methods in the assessment of concrete and masonry structures. NDT E Int. 34, 71–84 (2001)
Beutel, R., Reinhardt, H.W., Grosse, C.U., Glaubitt, A., Krause, M., Maierhofer, C., et al.: Comparative performance tests and validation of NDT methods for concrete testing. J. Nondestruct. Eval. 27, 59–65 (2008)
Shokouhi, P., Wiggenhauser, H.: Multi-probe ultrasonic testing for detection of delamination in concrete bridge decks. TRB Annual Meeting Online (AMOnline). http://amonline.trb.org/1sl7d2/1 (2011). Accessed 5 January 2013
Maierhofer, C., Arndt, R., Röllig, M., Rieck, C., Walther, A., Scheel, H., et al.: Application of impulse-thermography for non-destructive assessment of concrete structures. Cem. Concr. Compos. 28, 393–401 (2006)
Cotič, P., Jagličić Z, Bosiljkov, V.: Validation of non-destructive characterization of the structure and seismic damage propagation of plaster and texture in multi-leaf stone masonry walls of cultural-artistic value. J. Cult. Herit. (2013). doi:10.1016/j.culher.2013.11.004
Cotic, P., Jaglicic, Z., Niederleithinger, E., Effner, U., Kruschwitz, S., Trela, C., et al.: Effect of moisture on the reliability of void detection in brickwork masonry using radar, ultrasonic and complex resistivity tomography. Mater. Struct. 46, 1723–1735 (2013). doi:10.1617/s11527-012-0011-3
Maierhofer, C., Wöstmann, J.: Investigation of dielectric properties of brick materials as a function of moisture and salt content using a microwave impulse technique at very high frequencies. NDT E Int. 31(4), 259–263 (1998)
Maierhofer, C., Zacher, G., Kohl, C., Wöstmann, J.: Evaluation of radar and complementary echo methods for NDT of concrete elements. J. Nondestruct. Eval. 27, 47–57 (2008)
Wiggenhauser, H.: Advanced NDT methods for quality assurance of concrete structures. In: Proceedings NDTCE’09, Non-destructive testing in civil engineering. LCPC, Paris (2009)
Gros, X.E., Bousigue, J., Takahashi, K.: NDT data fusion at pixel level. NDT E Int. 32, 283–292 (1999)
Gros, X.E., Liu, Z., Tsukada, K., Hanasaki, K.: Experimenting with pixel-level NDT data fusion techniques. IEEE T Instrum. Meas. 49(5), 1083–1090 (2000)
Liu, Z., Forsyth, D.S., Safizadeh, M.S., Fahr, A.: A data-fusion scheme for quantitative image analysis by using locally weighted regression and Dempster–Shafer theory. IEEE T Instrum. Meas. 57(11), 2554–2560 (2008)
Balakrishnan, S., Cacciola, M., Udpa, L., Rao, B.P., Jayakumar, T., Raj, B.: Development of image fusion methodology using discrete wavelet transform for eddy current images. NDT E Int. 51, 51–57 (2012)
Kohl, C., Krause, M., Maierhofer, C., Wöstmann, J.: 2D-and 3D-visualisation of NDT-data using data fusion technique. Mater. Struct. 38, 817–826 (2005)
Cui, J., Huston, D.R., Arndt, R., Jalinoos, F.: Data fusion techniques of multiple sensors nondestructive evaluation of a concrete bridge deck. TRB Annual Meeting Online (AMOnline). http://amonline.trb.org/2vdh1b/2vdh1b/1 (2010). Accessed 11 February 2012
Bensaid, A.M., Hall, L.O., Bezdek, J.C., Clarke, L.P., Silbiger, M.L., Arrington, J.A., et al.: Validity-guided (re)clustering with applications to image segmentation. IEEE T Fuzzy Syst. 4(2), 112–123 (1996)
Santoro, M., Prevete, R., Cavallo, L., Catanzariti, E.: Mass detection in mammograms using gabor filters and fuzzy clustering. In: Bloch, I., Petrosino, A., Tettamanzi, A.G.B. (eds.) Fuzzy logic and applications. WILF 2005: Proceedings of the 6th international workshop, pp. 334–343. Springer, Berlin (2006)
Cotič, P., Niederleithinger, E., Wilsch, G.: Unsupervised clustering of spatially acquired laser-induced breakdown spectroscopy data from concrete. Cem. Concr. Res. (submitted)
Cotič, P., Niederleithinger, E., Bosiljkov, V., Jagličić, Z.: NDT data fusion for the enhancement of defect visualization in concrete. Key Eng. Mater. 569–570, 175–182 (2013)
Liu, Z., Forsyth, D.S., Komorowski, J.P., Hanasaki, K., Kirubarajan, T.: Survey: state of the art in NDE data fusion techniques. IEEE T Instrum. Meas. 56, 2435–2451 (2007)
Kaftandjian, V., Zhu, Y.M., Dupuis, O., Babot, D.: The combined use of the evidence theory and fuzzy logic for improving multimodal nondestructive testing systems. IEEE T Instrum. Meas. 54(5), 1968–1977 (2005)
Bogaerta, P., Fasbender, D.: Bayesian data fusion in a spatial prediction context: a general formulation. Stoch Environ. Res. Risk Assess. 21, 695–709 (2007)
Li, G., Huang, P., Chen, P., Hou, D., Zhang, G., Zhou, Z. Application of multi-sensor data fusion in defects evaluation based on Dempster–Shafer theory. IEEE Xplore Digital Library. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=5944335 (2011). Accessed 13 February 2012
Höppner, F., Klawonn, F., Kruse, R., Runkler, T.: Fuzzy cluster analysis: methods for classification, data analysis and image recognition, 1st edn. Wiley, Chichester (1999)
MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. Proceedings of the 5th Berkeley symposium on mathematical statistics and probability, vol 1: Statistics, pp. 281–297. University of California Press, Berkeley (1967)
Bezdek, J.Z.: Pattern recognition with fuzzy objective function algorithms. Plenum Press, New York (1981)
Gustafson, D., Kessel, W.: Fuzzy clustering with a fuzzy covariance matrix. Proceedings of the 1978 IEEE conference on decision and control including the 17th Symposium on adaptive processes, pp. 761–766. IEEE Control Systems Society, San Diego (1979)
Dave, R.N.: Use of the adaptive fuzzy clustering algorithm to detect lines in digital images. In: Casasent, D.P. (ed.) Intelligent robots and computer vision VIII: algorithms and techniques, vol 1192. SPIE, pp. 600–611 (1990)
Krishnapuram, R., Kim, J.: A note on the Gustafson-Kessel and adaptive fuzzy clustering algorithms. IEEE T Fuzzy Syst. 7(4), 453–461 (1999)
Babuška, R., van der Veen, P.J., Kaymak, U.: Improved covariance estimation for Gustafson-Kessel clustering. In: Proceedings of the 2002 IEEE international conference on fuzzy systems, vol 2. IEEE, pp. 1081–1085 (2002)
Kruse, R., Döring, C., Lesot, M.J.: Fundamentals of fuzzy clustering. In: Oliveira, J.V., Pedrycz, W. (eds.) Advances in fuzzy clustering and its applications, pp. 3–30. Wiley, Chichester (2007)
Dave, R.N.: Characterization and detection of noise in clustering. Pattern Recogn. Lett. 12(11), 657–664 (1991)
Krishnapuram, R., Keller, J.M.: The possibilistic c-means algorithm: insights and recommendations. IEEE Trans. Fuzzy Syst. 4(3), 385–393 (1996)
Pal, N.R., Pal, K., Bezdek, J.C.: A mixed c-means clustering model. In: Proceedings of the 6th IEEE international conference on fuzzy systems, vol 1. IEEE, pp. 11–21 (1997)
Timm, H., Borgelt, C., Kruse, R.: Fuzzy cluster analysis with cluster repulsion. CiteSeer\(^{X}_{\beta }\). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.100.9787 (2001). Accessed 16 November 2012
Pal, N.R., Pal, K., Keller, J.M., Bezdek, J.C.: A possibilistic fuzzy c-means clustering algorithm. IEEE T Fuzzy Syst. 13(4), 517–530 (2005)
Daniels, J.D. (ed.): Ground-penetrating radar, 2nd edn. The Institution of Electrical Engineers, London (2004)
Jol, H. (ed.): Ground penetrating radar: theory and applications, 1st edn. Elsevier Science, Amsterdam, Oxford (2009)
Maierhofer, C., Röllig, M.: Application of active thermography to the detection of safety relevant defects in civil engineering structures. In: Proceedings OPTO 2009 & IRS\(^{2}\) 2009. AMA, pp. 215–220 (2009)
Maldague, X.P., Marinetti, S.: Pulse phase infrared thermography. J. Appl. Phys. 79, 2694–2698 (1996)
Arndt, R.: Square pulse thermography in frequency domain. SPIE Digital Library. http://proceedings.spiedigitallibrary.org/proceeding.aspx?articleid=834339 (2008). Accessed 13 September 2012
Vavilov, V., Burleigh, D.: Heat transfer. In: Maldague, X., Moore, P.O. (eds.) Nondestructive handbook, infrared and thermal testing, vol. 3, 3rd edn. ASNT Press, Columbus (2001)
Weritz, F., Arndt, R., Röllig, M., Maierhofer, C., Wiggenhauser, H.: Investigation of concrete structures with pulse phase thermography. Mater. Struct. 38, 843–849 (2005)
Altman, D.G., Bland, J.M.: Statistics notes: diagnostic tests 1: sensitivity and specificity. BMJ 308, 1552 (1994)
Cotič, P., Jagličić, Z., Bosiljkov, V., Niederleithinger, E.: GPR and IR thermography for near-surface defect detection in building structures. In: Grum, J. (ed.) Proceedings of the 12th international conference of the Slovenian society for non-destructive testing, Application of Contemporary Non-Destructive Testing in Engineering. Slovenian Society for Nondestructive testing, Ljubljana (2013)
Shafer, G.: A mathematical theory of evidence. Princeton University Press, Princeton (1976)
Stoppel, M., Taffe, A., Wiggenhauser, H., Kurz, J.H., Boller, C.: Automated multi-sensor systems in civil engineering for condition assessment of concrete structures. In: Grantham, M. (ed.) Proceedings of the 4th International Conference on Concrete Repair, pp. 397–403. CRC Press, Boca Raton (2011)
Krause, H.J., Rath, E., Sawade, G., Dumat, F.: Radar-Magnet-Betontest: Eine neue Methode zur Bestimmung der Feuchte und des Chloridgehalts von Brückenfahrbahnplatten aus Beton. Beton- und Stahlbetonbau 102(12), 825–834 (2007)
Reichling, K., Raupach, M., Wiggenhauser, H., Stoppel, M., Dobmann, G., Kurz, J.: BETOSCAN: an instrumented mobile robot system for the diagnosis of reinforced concrete floors. Restor. Build. Monum. 15(4), 277–286 (2009)
Acknowledgments
The first author acknowledges the financial support of the Slovenian Research Agency through grant 1000-10-310156 and the Slovene Human Resources and Scholarship Fund through grant 11012-13/2012. The authors wish to thank Dr. Hans-Joachim Krause and colleagues for the radar-magnetic data set. Contributions and support from Assoc. Prof. Violeta Bokan Bosiljkov, Primož Murn and Dr. Parisa Shokouhi are acknowledged.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cotič, P., Jagličić, Z., Niederleithinger, E. et al. Image Fusion for Improved Detection of Near-Surface Defects in NDT-CE Using Unsupervised Clustering Methods. J Nondestruct Eval 33, 384–397 (2014). https://doi.org/10.1007/s10921-014-0232-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10921-014-0232-1