Abstract
Computer vision (CV) methods for measurement of structural vibration are less expensive, and their application is more straightforward than methods based on sensors that measure physical quantities at particular points of a structure. However, CV methods produce significantly more measurement errors. Thus, computer vision-based structural health monitoring (CVSHM) requires appropriate methods of damage assessment that are robust with respect to highly contaminated measurement data. In this paper a complete CVSHM framework is proposed, and three damage assessment methods are tested. The first is the augmented inverse estimate (AIE), proposed by Peng et al. in 2021. This method is designed to work with highly contaminated measurement data, but it fails with a large noise provided by CV measurement. The second method, as proposed in this paper, is based on the AIE, but it introduces a weighting matrix that enhances the conditioning of the problem. The third method, also proposed in this paper, introduces additional constraints in the optimization process; these constraints ensure that the stiff ness of structural elements can only decrease. Both proposed methods perform better than the original AIE. The latter of the two proposed methods gives the best results, and it is robust with respect to the selected coefficients, as required by the algorithm.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Change history
15 August 2023
An Erratum to this paper has been published: https://doi.org/10.1007/s11803-023-2203-y
References
Adhikari G, Sahani SK, Chauhan MS and Das BK (2016), “Fast Real Time Object Tracking Based on Normalized Cross Correlation and Importance of Thresholding Segmentation,” 2016 International Conference on Recent Trends in Information Technology (ICRTIT), 1–5. https://doi.org/10.1109/ICRTIT.2016.7569517
Bernal D (2002), “Load Vectors for Damage Localization,” Journal of Engineering Mechanics,” 128(1): 7–14. https://doi.org/10.1061/(ASCE)0733-9399(2002)128:1(7)
Bernal D (2006), “Flexibility-Based Damage Localization from Stochastic Realization Results,” Journal of Engineering Mechanics, 132(6): 651–658. https://doi.org/10.1061/(ASCE)0733-9399(2006)132:6(651)
Blachowski B (2019), “Modal Sensitivity Based Sensor Placement for Damage Identification Under Sparsity Constraint,” Periodica Polytechnica Civil Engineering, 63(2): 432–445. https://doi.org/10.3311/PPci.13888
Blachowski B, An YH, Spencer BF and Ou JP (2017), “Axial Strain Accelerations Approach for Damage Localization in Statically Determinate Truss Structures,” Computer-Aided Civil and Infrastructure Engineering, 32(4): 304–318. https://doi.org/10.1111/mice.12258
Blachowski B, Ostrowski M, Zarski M, Wojcik B, Tauzowski P and Jankowski L (2023), “An Efficient Computer Vision-Based Method for Estimation of Dynamic Displacements in Spatial Truss Structures,” in P. Rizzo and A. Milazzo (eds) European Workshop on Structural Health Monitoring, Cham: Springer International Publishing, 474–484. https://doi.org/10.1007/978-3-031-07258-1_49
Blachowski B, Swiercz A, Gutkiewicz P, Szelążek J and Gutkowski W (2016), “Structural Damage Detectability Using Modal and Ultrasonic Approaches,” Measurement, 85: 10–221. https://doi.org/10.1016/j.measurement.2016.02.033
Bose B, Wang X and Grimson E (2007), “Multi-class Object Tracking Algorithm That Handles Fragmentation and Grouping,” 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. https://doi.org/10.1109/CVPR.2007.383175
Breitenstein MD, Reichlin F, Leibe B, et al. (2009), “Robust Tracking-by-Detection Using a Detector Confidence Particle Filter,” 2009 IEEE 12th International Conference on Computer Vision, 1515–1522. https://doi.org/10.1109/ICCV.2009.5459278
Curadelli RO, Riera JD, Ambrosini D and Amani MG (2008), “Damage Detection by Means of Structural Damping Identification,” Engineering Structures, 30(12): 3497–3504. https://doi.org/10.1016/j.engstruct.2008.05.024
Feng D and Feng M (2021), Computer Vision for Structural Dynamics and Health Monitoring. John Wiley and Sons Ltd and ASME Press. https://doi.org/10.1002/9781119566557
Feng D and Feng MQ (2018), “Computer Vision for SHM of Civil Infrastructure: From Dynamic Response Measurement to Damage Detection — A review,” Engineering Structures, 156: 105–117. https://doi.org/10.1016/j.engstruct.2017.11.018
Feng D, Feng MQ, Ozer E and Fukuda Y (2015), “A Vision-Based Sensor for Noncontact Structural Displacement Measurement,” Sensors, 15(7): 16557–16575. https://doi.org/10.3390/s150716557
Fox RL and Kapoor MP (1968), “Rates of Change of Eigenvalues and Eigenvectors,” AIAA Journal, 6(12): 2426–2429. https://doi.org/10.2514/3.5008
Friswell M and Mottershead JE (1995), Finite Element Model Updating in Structural Dynamics, Springer, Dordrecht. https://doi.org/10.1007/978-94-015-8508-8
Gomez F, Narazaki Y, Hoskere V, Spencer BF and Smith MD (2022), “Bayesian Inference of Dense Structural Response Using Vision-based Measurements,” Engineering Structures, 256: 113970. https://doi.org/10.1016/j.engstruct.2022.113970
Harris C and Stephens M (1988), “A Combined Corner and Edge Detector,” Proceedings of the Alvey Vision Conference, Alvety Vision Club, 23.1–23.6. https://doi.org/10.5244/C.2.23
Henriques JF, Caseiro R and Batista J (2011), “Globally Optimal Solution to Multi-object Tracking with Merged Measurements,” 2011 International Conference on Computer Vision, 2470–2477. https://doi.org/10.1109/ICCV.2011.6126532
Hii A, Hann CE, Chase JG and Houten E (2006), “Fast Normalized Cross Correlation for Motion Tracking Using Basis Functions,” Computer Methods and Programs in Biomedicine, 82(2): 144–156. https://doi.org/10.1016/J.CMPB.2006.02.007
Hoskere V, Narazaki Y and Spencer BF (2019), “Learning to Detect Important Visual Changes for Structural Inspections Using Physics-based Graphics Models,” 9th International Conference on Structural Health Monitoring of Intelligent Infrastructure: Transferring Research into Practice, SHMII 2019 — Conference Proceedings, pp. 1484–1490. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85090588897&partnerID=40&md5=ec168a32fe27ea515d23671178a4f3dc
Hu W, Li X, Luo W, Zhang X, Maybank S and Zhang Z (2012), “Single and Multiple Object Tracking Using Log-euclidean Riemannian Subspace and Block-division Appearance Model,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(12): pp. 2420–2440. https://doi.org/10.1109/TPAMI.2012.42
Huang C, Wu B and Nevatia R (2008), “Robust Object Tracking by Hierarchical Association of Detection Responses,” in D. Forsyth, P. Torr, and A. Zisserman (eds) Computer Vision ECCV 2008, Berlin, Heidelberg: Springer, Berlin, Heidelberg, pp. 788–801. https://doi.org/10.1007/978-3-540-88688-4_58
Iezzi F, Spina D and Valente C (2015), “Damage Assessment Through Changes in Mode Shapes Due to Non-proportional Damping,” Journal of Physics: Conference Series, 628: 12019. https://doi.org/10.1088/1742-6596/628/1/012019
Li Shuai, Pan Jianwen, Luo Guangheng and Wang Jinting (2020), “Automatic Modal Parameter Identification of High Arch Dams: Feasibility Verification,” Earthquake Engineering and Engineering Vibration, 19(4): 953–965. https://doi.org/10.1007/s11803-020-0606-6
Liu S, Liu D, Srivastava G, et al. (2021), “Overview and Methods of Correlation Filter Algorithms in Object Tracking,” Complex & Intelligent Systems, 7(4): 1895–1917. https://doi.org/10.1007/s40747-020-00161-4
Luo W, Xing J, Milan A, Zhang X, Liu W and Kim TK (2021), “Multiple Object Tracking: A Literature review,” Artificial Intelligence, 293: 103448. https://doi.org/10.1016/j.artint.2020.103448
Mottershead JE, Link M and Friswell MI (2011), “The Sensitivity Method in Finite Element Model Updating: A Tutorial,” Mechanical Systems and Signal Processing, 25(7): 2275–2296. https://doi.org/10.10167/j.ymssp.2010.10.012
Narazaki Y,Gomez F, et al. (2021), “EfficientDevelopment of Vision-based Dense Three-dimensional Displacement Measurement Algorithms Using Physics-based Graphics Models,” Structural Health Monitoring, 20(4): 1841–1863. https://doi.org/10.1177/1475921720939522
Narazaki Y, Hoskere V, et al. (2021), “Synthetic Environments for Vision-based Structural Condition Assessment of Japanese High-speed Railway Viaducts,” Mechanical Systems and Signal Processing, 160: 107850. https://doi.org/10.1016/j.ymssp.2021.107850
Nelson RB (1976), “Simplified Calculation of Eigenvector Derivatives,” AIAA Journal, 14(9): 1201–1205. https://doi.org/10.2514/3.7211
Peeters B (2000), “System Identification and Damage Detection in Civil Engineering,” https://limo.libis.be/primo-explore/fulldisplay?docid=LIRIAS1725571&context=L&vid=Lirias&search_scope=Lirias&tab=default_tab&lang=en_US&fromSitemap=1
Peng X, Qi FJ, Yang QW and Chen H (2021), “A Robust Estimate Method for Damage Detection of Concrete Structures Using Contaminated Data,” Advances in Civil Engineering, Edited by A. Palmeri, 2021, 6669958. https://doi.org/10.1155/2021/6669958
Shi J and Tomasi (1994), “Good Features to Track,” 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 593–600. https://doi.org/10.1109/CVPR.1994.323794
Spencer BF, Hoskere V and Narazaki Y (2019), “Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring,” Engineering, 5(2): 199–222. https://doi.org/10.1016/j.eng.2018.11.030
Suwala G and Jankowski L (2012), “A Model-free Method for Identification of Mass Modifications,” Structural Control and Health Monitoring, 19(2): 216–230. https://doi.org/10.1002/stc.417
Tomasi C and Kanade T (1991), Detection and Tracking of Point Features.https://cecas.clemson.edu/~stb/klt/tomasi-kanade-techreport-1991.pdf (Accessed: 12 January 2022)
Trainotti F, Slimak T and Rixen D (2022), “Towards Full-field Frequency Based Substructuring: An Application Case,” Proceedings of International Conference on Noise and Vibration Engineering and International Conference on Uncertainty in Structural Dynamics (ISMA 2022 — USD 2022), Lauven, Belgium
Xiang Y, Alahi A and Savarese S (2015), “Learning to Track: Online Multi-object Tracking by Decision Making,” 2015 IEEE International Conference on Computer Vision (ICCV), 4705–4713. https://doi.org/10.1109/ICCV.2015.534
Yuen KV (2010), Bayesian Methods for Structural Dynamics and Civil Engineering, John Wiley & Sons, Ltd. https://doi.org/10.1002/9780470824566
Yuen KV, Beck JL and Katafygiotis LS (2006), “Efficient Model Updating and Health Monitoring Methodology Using Incomplete Modal Data without Mode Matching,” Structural Control and Health Monitoring, 13(1): 91–107. https://doi.org/10.1002/stc.144
Zarski M, Wójcik B, Miszczak JA, Blachowski B and Ostrowski M (2022), “Computer Vision Based Inspection on Post-Earthquake with UAV Synthetic Dataset,” IEEE Access, 10, pp. 108134–108144. https://doi.org/10.1109/ACCESS.2022.3212918
Zhang L and van der Maaten L (2014), “Preserving Structure in Model-Free Tracking,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(4): 756–769. https://doi.org/10.1109/TPAMI.2013.221
Acknowledgement
The authors gratefully acknowledge the support of the National Science Centre, Poland, granted through the Project 2020/39/B/ST8/02615.
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by: National Science Centre, Poland Granted Through the Project 2020/39/B/ST8/02615
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article′s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article′s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ostrowski, M., Blachowski, B., Wójcik, B. et al. A framework for computer vision-based health monitoring of a truss structure subjected to unknown excitations. Earthq. Eng. Eng. Vib. 22, 1–17 (2023). https://doi.org/10.1007/s11803-023-2154-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11803-023-2154-3