Skip to main content
SpringerLink
Log in

Framework for Automated UAV-Based Inspection of External Building Façades

  • Chapter
  • First Online:
Automating Cities

Part of the book series: Advances in 21st Century Human Settlements ((ACHS))

Abstract

Aging defective building façades pose potential hazards to both public property and personnel safety. The current inspection regime for building facades involves large investments of labour, time and cost, with significant safety concerns when accessing areas at height. Hence, there is urgent need to explore and automate the current inspection process for building façades by incorporating assistive intelligent technologies. Unmanned aerial vehicles (UAVs) equipped with remote sensing technologies provide an opportunity to automate the inspection process and transform it to become less labour-dependent by incorporating building diagnostics technology. This chapter presents a framework for an automated vision-based building façade diagnosis approach using UAV. The typical challenges of building condition assessment are identified based on a comprehensive review of literature that address this topic. A case study of applying the framework on a real building façade inspection is further conducted to present coherently the detailed steps involved in the workflow, including UAV path planning and data acquisition, image-based 3D reconstruction and defects identification. The presented study serves as a critical reference for adopting automation in a large facade inspection process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Abdel-Qader I, Abudayyeh O, Kelly ME (2003) Analysis of edge-detection techniques for crack identification in bridges. J Comput Civil Eng 17:255–263

    Article  Google Scholar 

  • Adhikari RS, Moselhi O, Bagchi A (2014) Image-based retrieval of concrete crack properties for bridge inspection. Autom Constr 39:180–194

    Article  Google Scholar 

  • Aguilar WG, Rodríguez GA, Álvarez L, Sandoval S, Quisaguano F, Limaico A (2017) Visual SLAM with a RGB-D camera on a quadrotor UAV using on-board processing. In: International work-conference on artificial neural networks. Springer, pp 596–606

    Google Scholar 

  • Bailey T, Durrant-Whyte H (2006) Simultaneous localization and mapping (SLAM): Part II. IEEE Robot Autom Mag 13:108–117

    Article  Google Scholar 

  • Cetin O, Zagli I, Yilmaz G (2013) Establishing obstacle and collision free communication relay for UAVs with artificial potential fields. J Intell Rob Syst 69:361–372

    Article  Google Scholar 

  • Chen Y-B, Luo G-C, Mei Y-S, Yu J-Q, Su X-L (2016) UAV path planning using artificial potential field method updated by optimal control theory. Int J Syst Sci 47:1407–1420

    Article  MathSciNet  Google Scholar 

  • Chiabrando F, Lingua A, Maschio P, Losè LT (2017) The influence of flight planning and camera orientation in UAVs photogrammetry. A test in the area of Rocca San Silvestro (LI), TUSCANY. Int Arch Photogrammetry, Remote Sens Spat Inform Sci 42:163

    Google Scholar 

  • Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248–255

    Google Scholar 

  • Di Franco C, Buttazzo G (2015) Energy-aware coverage path planning of UAVs. In: 2015 IEEE international conference on autonomous robot systems and competitions. IEEE, pp 111–117

    Google Scholar 

  • Dong Z, Chen Z, Zhou R, Zhang R (2011) A hybrid approach of virtual force and A∗ search algorithm for UAV path re-planning. In: 2011 6th IEEE conference on industrial electronics and applications. IEEE, pp 1140–1145

    Google Scholar 

  • Durrant-Whyte H, Bailey T (2006) Simultaneous localization and mapping: part I. IEEE Robot Autom Mag 13:99–110

    Article  Google Scholar 

  • Ellenberg A, Branco L, Krick A, Bartoli I, Kontsos A (2015) Use of unmanned aerial vehicle for quantitative infrastructure evaluation. J Infrastruct Syst 21

    Google Scholar 

  • Eschmann C, Kuo C-M, Kuo C-H, Boller C (2012) Unmanned aircraft systems for remote building inspection and monitoring. In: Proceedings of the 6th European workshop on structural health monitoring, Dresden, Germany

    Google Scholar 

  • Eschmann C, Wundsam T (2017) Web-based georeferenced 3D inspection and monitoring of bridges with unmanned aircraft systems. J Surv Eng 143

    Google Scholar 

  • Feng C, Liu M-Y, Kao C-C, Lee T-Y (2017) Deep active learning for civil infrastructure defect detection and classification. Comput Civil Eng

    Google Scholar 

  • Feng D, Feng MQ (2018) Computer vision for SHM of civil infrastructure: from dynamic response measurement to damage detection—a review. Eng Struct 156:105–117

    Article  Google Scholar 

  • Fernandez Galarreta J, Kerle N, Gerke M (2015) UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning. Nat Hazards Earth Syst Sci 15:1087–1101

    Google Scholar 

  • Freimuth H, König M (2015) Generation of waypoints for UAV-assisted progress monitoring and acceptance of construction work. In:15th international conference on construction applications of virtual reality (CONVR), pp 77–86

    Google Scholar 

  • Fuentes-Pacheco J, Ruiz-Ascencio J, Rendón-Mancha JM (2015) Visual simultaneous localization and mapping: a survey. Artif Intell Rev 43:55–81

    Article  Google Scholar 

  • Fujita Y, Hamamoto Y (2010) A robust automatic crack detection method from noisy concrete surfaces. Mach Vis Appl 22:245–254

    Article  Google Scholar 

  • Gautam SA, Verma N (2014) Path planning for unmanned aerial vehicle based on genetic algorithm & artificial neural network in 3D. In: 2014 international conference on data mining and intelligent computing (ICDMIC). IEEE, pp 1–5

    Google Scholar 

  • Gee T, James J, van der Mark W, Delmas P, Gimel'farb G (2016) Lidar guided stereo simultaneous localization and mapping (SLAM) for UAV outdoor 3-D scene reconstruction. In: 2016 international conference on image and vision computing New Zealand (IVCNZ). IEEE, pp 1–6

    Google Scholar 

  • González-Aguilera D, Lagüela S, Rodríguez-Gonzálvez P, Hernández-López D (2013) Image-based thermographic modeling for assessing energy efficiency of buildings façades. Energy Build 65:29–36

    Article  Google Scholar 

  • Gopalakrishnan K, Khaitan SK, Choudhary A, Agrawal A (2017) Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Constr Build Mater 157:322–330

    Article  Google Scholar 

  • Khan A, Yanmaz E, Rinner B (2014) Information merging in multi-UAV cooperative search. In: 2014 IEEE international conference on robotics and automation (ICRA). IEEE, pp 3122–3129

    Google Scholar 

  • Lagüela S, Díaz L, Roca D, Lorenzo H (2015) Aerial thermography from low-cost UAV for the generation of thermographic digital terrain models. Opto-Electron Rev 23:78–84

    Article  Google Scholar 

  • Lattanzi D, Miller GR (2014) Robust automated concrete damage detection algorithms for field applications. J Comput in Civil Eng 28:253–262

    Article  Google Scholar 

  • Liu Y, Yeoh JK (2020) Vision-based semi-supervised learning method for concrete crack detection. In: Construction Research Congress 2020 Arizona

    Google Scholar 

  • Liu Y, Yeoh JK, Chua DK (2020) Deep learning based enhancement of motion blurred UAV concrete crack images. J Comput Civil Eng

    Google Scholar 

  • Lizarazo I, Angulo V, Rodríguez J (2017) Automatic mapping of land surface elevation changes from UAV-based imagery. Int J Remote Sens 38:2603–2622

    Article  Google Scholar 

  • Lu Y, Xue Z, Xia G-S, Zhang L (2018) A survey on vision-based UAV navigation. Geo-Spatial Information Science 21:21–32

    Article  Google Scholar 

  • Manyoky M, Theiler P, Steudler D, Eisenbeiss H (2011) Unmanned aerial vehicle in cadastral applications. In: Proceedings of the international conference on unmanned aerial vehicle in geomatics (UAV-G) 2011, Copernicus, pp 57–62

    Google Scholar 

  • Michael N, Shen S, Mohta K, Mulgaonkar Y, Kumar V, Nagatani K, Okada Y, Kiribayashi S, Otake K, Yoshida K (2012) Collaborative mapping of an earthquake-damaged building via ground and aerial robots. J Field Robot 29:832–841

    Article  Google Scholar 

  • Min J, Jeong Y, Kweon IS (2010) Robust visual lock-on and simultaneous localization for an unmanned aerial vehicle. In: 2010 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 93–100

    Google Scholar 

  • Montiel O, Sepúlveda R, Orozco-Rosas U (2015) Optimal path planning generation for mobile robots using parallel evolutionary artificial potential field. J Intell Rob Syst 79:237–257

    Article  Google Scholar 

  • Murtiyoso A, Grussenmeyer P (2017) Documentation of heritage buildings using close-range UAV images: dense matching issues, comparison and case studies. Photogram Rec 32:206–229

    Article  Google Scholar 

  • Nex F, Remondino F (2014) UAV for 3D mapping applications: a review. Appl Geomat 6:1–15

    Article  Google Scholar 

  • Nguyen H-N, Kam T-Y, Cheng P-Y (2013) An automatic approach for accurate edge detection of concrete crack utilizing 2D geometric features of crack. J Signal Process Syst 77:221–240

    Article  Google Scholar 

  • Park HS, Oh BK (2018) Real-time structural health monitoring of a supertall building under construction based on visual modal identification strategy. Autom Constr 85:273–289

    Article  Google Scholar 

  • Pehlivanoglu YV (2012) A new vibrational genetic algorithm enhanced with a Voronoi diagram for path planning of autonomous UAV. Aerosp Sci Technol 16:47–55

    Google Scholar 

  • Qi Z, Shao Z, Ping YS, Hiot LM, Leong YK (2010) An improved heuristic algorithm for UAV path planning in 3D environment. In: 2010 second international conference on intelligent human-machine systems and cybernetics. IEEE, pp 258–261

    Google Scholar 

  • Ragi S, Chong EK (2013) UAV path planning in a dynamic environment via partially observable Markov decision process. IEEE Trans Aerosp Electron Syst 49:2397–2412

    Article  Google Scholar 

  • Roberge V, Tarbouchi M, Labonté G (2012) Comparison of parallel genetic algorithm and particle swarm optimization for real-time UAV path planning. IEEE Trans Industr Inf 9:132–141

    Article  Google Scholar 

  • Roberts JF, Zufferey J-C, Floreano D (2008) Energy management for indoor hovering robots. In: 2008 IEEE/RSJ international conference on intelligent robots and systems. IEEE, 1pp 242–1247

    Google Scholar 

  • Roca D, Lagüela S, Díaz-Vilariño L, Armesto J, Arias P (2013) Low-cost aerial unit for outdoor inspection of building façades. Autom Constr 36:128–135

    Article  Google Scholar 

  • Schonberger JL, Frahm J-M (2016) Structure-from-motion revisited. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4104–4113

    Google Scholar 

  • Seitz SM, Curless B, Diebel J, Scharstein D, Szeliski R (2006) A comparison and evaluation of multi-view stereo reconstruction algorithms. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06). IEEE, pp 519–528

    Google Scholar 

  • Siebert S, Teizer J (2014) Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system. Autom Constr 41:1–14

    Article  Google Scholar 

  • Steffen R, Förstner W (2008) On visual real time mapping for unmanned aerial vehicles. In: 21st congress of the international society for photogrammetry and remote sensIng (ISPRS), pp 57–62

    Google Scholar 

  • Stek TD (2016) Drones over Mediterranean landscapes. The potential of small UAV's (drones) for site detection and heritage management in archaeological survey projects: a case study from Le Pianelle in the Tappino Valley, Molise (Italy). J Cult Heritage 22:1066–1071

    Google Scholar 

  • Tahar K (2012) Aerial terrain mapping using unmanned aerial vehicle approach. Int Arch Photogrammetry Remote Sens Spat Inform Sci 39:B7

    Google Scholar 

  • Vu H-H, Labatut P, Pons J-P, Keriven R (2011) High accuracy and visibility-consistent dense multiview stereo. IEEE Trans Pattern Anal Mach Intell 34:889–901

    Article  Google Scholar 

  • Yamaguchi T, Hashimoto S (2010) Fast crack detection method for large-size concrete surface images using percolation-based image processing. Mach Vis Appl 21:797–809

    Article  Google Scholar 

  • Ye XW, Dong CZ, Liu T (2016) A review of machine vision-based structural health monitoring: methodologies and applications. J Sens 2016:1–10

    Google Scholar 

  • Zhang K, Cheng HD, Zhang B (2018) Unified approach to pavement crack and sealed crack detection using preclassification based on transfer learning. J Comput Civil Eng 32

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National University of Singapore, Singapore, Singapore

    Yiqing Liu, Yuehan Lin, Justin K. W. Yeoh, David K. H. Chua, Lawrence W. C. Wong, Marcelo H. Ang Jr., W. L. Lee & Michael Y. L. Chew

Authors
  1. Yiqing Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuehan Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Justin K. W. Yeoh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David K. H. Chua
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lawrence W. C. Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marcelo H. Ang Jr.
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. W. L. Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Michael Y. L. Chew
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yiqing Liu .

Editor information

Editors and Affiliations

  1. Queensland University of Technology, Brisbane, QLD, Australia

    Brydon T. Wang

  2. School of Civil Engineering, The University of Queensland, St. Lucia, QLD, Australia

    C. M. Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Liu, Y. et al. (2021). Framework for Automated UAV-Based Inspection of External Building Façades. In: Wang, B.T., Wang, C.M. (eds) Automating Cities. Advances in 21st Century Human Settlements. Springer, Singapore. https://doi.org/10.1007/978-981-15-8670-5_7

Download citation

Publish with us

Policies and ethics

Search

Navigation