Abstract
Aerospace, civil, energy, and mechanical engineering structures continue to be used despite reaching their design lifetime. Developing sensing and data analytics to assess the structural condition of the targeted systems is crucial. Traditional contact-based techniques may produce inconsistent results and are labor-intensive to be considered a valid alternative for monitoring large-scale structures such as bridges, large buildings, and wind turbines. Advancements in image-processing algorithms made techniques such as three-dimensional digital image correlation (3D-DIC), infrared thermography (IRT), motion magnification (MM), and structure from motion (SfM) appealing tools for structural health monitoring and non-destructive testing. Besides, as those techniques are implemented within unmanned aerial vehicles (UAVs), the measurement process is expedited while reducing interference with the targeted structure. This paper summarizes the research experience performed at the University of Massachusetts Lowell. The results of these activities show that the combination of autonomous flight with 3D-DIC, IRT, and SfM can provide precious insights into the structural conditions of the inspected systems while reducing downtime and costs. The study includes future research directions to make those approaches suitable for real-world applications.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sohn, H., Farrar, C.R., Hemez, F.M., Czarnecki, J.J.: A Review of Structural Health Review of Structural Health Monitoring Literature 1996–2001. Report. No. LA-UR-02-2095 (2002)
Gholizadeh, S., Leman, Z., Baharudin, B.T.H.: A review of the application of acoustic emission technique in engineering. Struct. Eng. Mech. 54(6), 1075 (2015)
Feng, D., Feng, M.Q.: Computer vision for SHM of civil infrastructure: from dynamic response measurement to damage detection–a review. Eng. Struct. 156, 105–117 (2018)
Niezrecki, C., Baqersad, J., Sabato, A.: Digital image correlation techniques for non-destructive evaluation and structural health monitoring. Handb. Adv. Non-Destructive Eval. 46, 1–46 (2018)
Dong, C.Z., Catbas, F.N.: A review of computer vision–based structural health monitoring at local and global levels. Struct. Health Monit. 20(2), 692–743 (2021)
Byg, R.: Structural Health Monitoring and Management with Unmanned Aerial Vehicles. Structural Health Monitoring (2021)
Sutton, M.A., Wolters, W.J., Peters, W.H., Ranson, W.F., McNeill, S.R.: Determination of displacements using an improved digital correlation method. Image Vis. Comput. 1(3), 133–139 (1983)
Sutton, M.A., Orteu, J.J., Schreier, H.: Image Correlation for Shape, Motion and Deformation Measurements: Basic Concepts, Theory and Applications. Springer, Heidelberg (2009)
Bianco, S., Ciocca, G., Marelli, D.: Evaluating the performance of structure from motion pipelines. J. Imaging 4(8), 1–18 (2018)
Zhao, S., Kang, F., Li, J., Ma, C.: Structural health monitoring and inspection of dams based on UAV photogrammetry with image 3D reconstruction. Autom. Constr. 130, 103832 (2021)
Khaloo, A., Lattanzi, D., Jachimowicz, A., Devaney, C.: Utilizing UAV and 3D computer vision for visual inspection of a large gravity dam. Front. Built Environ. 4, 31 (2018)
Khaloo, A., Lattanzi, D., Cunningham, K., Dell’Andrea, R., Riley, M.: Unmanned aerial vehicle inspection of the Placer River Trail Bridge through image-based 3D modelling. Struct. Infrastruct. Eng. 14(1), 124–136 (2018)
Hu, F., Zhao, J., Huang, Y., Li, H.: Structure-aware 3D reconstruction for cable-stayed bridges: a learning-based method. Comput. Civ. Infrastruct. Eng. 36(1), 89–108 (2021)
Bagavathiappan, S., Lahiri, B.B., Saravanan, T., Philip, J., Jayakumar, T.: Infrared thermography for condition monitoring - a review. Infrared Phys. Technol. 60, 35–55 (2013)
Janků, M., Březina, I., Grošek, J.: Use of infrared thermography to detect defects on concrete bridges. Procedia Eng. 190, 62–69 (2017)
Montaggioli, G., Puliti, M., Sabato, A.: Automated Damage Detection of Bridge’s Sub-Surface Defects from Infrared Images Using Machine Learning, p. 75 (2021)
Martin, R.W., Sabato, A., Schoenberg, A., Giles, R.H., Niezrecki, C.: Comparison of nondestructive testing techniques for the inspection of wind turbine blades’ spar caps. Wind Energy 21(11), 980–996 (2018)
Rajic, N.: Principal component thermography for flaw contrast enhancement and flaw depth characterisation in composite structures. Compos. Struct. 58(4), 521–528 (2002)
Milovanović, B., Gaši, M., Gumbarević, S.: Principal component thermography for defect detection in concrete. Sensors (Switzerland) 20(14), 1–21 (2020)
Yousefi, B., Sfarra, S., Sarasini, F., Castanedo, C.I., Maldague, X.P.V.: Low-rank sparse principal component thermography (Sparse-PCT): comparative assessment on detection of subsurface defects. Infrared Phys. Technol. 98, 278–284 (2019)
Valente, N.A., do Cabo, C.T., Mao, Z., Niezrecki, C.: Quantification of phase-based magnified motion using image enhancement and optical flow techniques. Measurement 189, 110508 (2022)
Puliti, M., Montaggioli, G., Sabato, A.: Automation in construction automated subsurface defects detection using point cloud reconstruction from infrared images. Autom. Constr. 129, 103829 (2021)
Poozesh, P., Sabato, A., Sarrafi, A., Niezrecki, C., Avitabile, P., Yarala, R.: Multicamera measurement system to evaluate the dynamic response of utility-scale wind turbine blades. Wind Energy 23(7), 1619–1639 (2020)
Feng, W., et al.: Inertial measurement unit aided extrinsic parameters calibration for stereo vision systems. Opt. Lasers Eng. 134, 106252 (2020). https://doi.org/10.1016/j.optlaseng.2020.106252
Sabato, A., Valente, N.A., Niezrecki, C.: Development of a camera localization system for three-dimensional digital image correlation camera triangulation. IEEE Sens. J. 20(19), 11518–11526 (2020). https://doi.org/10.1109/jsen.2020.2997774
Kumar, D., Chiang, C.-H., Lin, Y.-C.: Experimental vibration analysis of large structures using 3D DIC technique with a novel calibration method. J. Civil Struct. Health Monit. (2022). https://doi.org/10.1007/s13349-022-00549-5
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sabato, A., Niezrecki, C., Dabetwar, S., Kulkarni, N.N., Bottalico, F., Nieduzak, T. (2023). Advancements in Structural Health Monitoring Using Combined Computer-Vision and Unmanned Aerial Vehicles Approaches. In: Rizzo, P., Milazzo, A. (eds) European Workshop on Structural Health Monitoring. EWSHM 2022. Lecture Notes in Civil Engineering, vol 254. Springer, Cham. https://doi.org/10.1007/978-3-031-07258-1_43
Download citation
DOI: https://doi.org/10.1007/978-3-031-07258-1_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-07257-4
Online ISBN: 978-3-031-07258-1
eBook Packages: EngineeringEngineering (R0)