Abstract
Accounting for around 40% of total energy consumption, buildings in industrialized countries are a particular focus for saving energy. Especially digital twins and building information modeling (BIM) can serve as a mean to improve operational processes, detect faulty ventilation and air conditioning (HVAC) components which lead to an increased energy consumption and evaluate future renovation possibilities during a buildings life cycle. To enable these advantages a transition from existing HVAC diagrams to a machine-readable representation including spatial and functional interrelationship of all components as well as their semantic relationship is necessary. Especially in retrofit cases the manual transition is a time-intensive and an error prone process. The present work aims to develop a procedure for the (partially) automated recognition of HVAC diagrams and extraction of information about their intercorrelation. In order to achieve the desired results, we use multiple approaches of computer vision, both conventional as well as more recent ones using artificial intelligence such as “Faster R-CNN”. The developed pipeline consists of three basic steps: Find symbols of components, find connecting lines, combine the extracted information into a machine-readable representation. Due to privacy issues, only very few real diagrams are available. To evaluate our approach we developed a data generator to train and test our pipeline. The obtained results show that to a large extend it is already possible to transfer relevant information from technical diagrams into a machine-readable format in order to reduce the effort of creating and validating digital twins and BIM for retrofits.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Skeleton network. https://github.com/Image-Py/sknw
Angles, R., Gutierrez, C.: Survey of graph database models. ACM Comput. Surv. 40(1), 1–39 (2008). https://doi.org/10.1145/1322432.1322433
Bradski, G.: The openCV library. Dr. Dobb’s J. Softw. Tools Prof. Program. 25(11), 120–123 (2000)
Chen, X., Gupta, A.: An implementation of faster RCNN with study for region sampling. arXiv preprint arXiv:1702.02138 (2017)
Gilani, S., Quinn, C., McArthur, J.J.: A review of ontologies for smart and continuous commissioning. arXiv preprint arXiv:2205.07636 (2022)
Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, David, Pajdla, Tomas, Schiele, Bernt, Tuytelaars, Tinne (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48
Ren, S., He, K., Girshick, R., Sun, J.: Faster r-CNN: towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst. 28 (2015). https://doi.org/10.48550/ARXIV.1506.01497
Stinner, F., Wiecek, M., Baranski, M., Kümpel, A., Müller, D.: Automatic digital twin data model generation of building energy systems from piping and instrumentation diagrams. arXiv preprint arXiv:2108.13912 (2021)
Sun, Y., Mao, X., Hong, S., Xu, W., Gui, G.: Template matching-based method for intelligent invoice information identification. IEEE Access 7, 28392–28401 (2019). https://doi.org/10.1109/ACCESS.2019.2901943
Thomas, L.S.V., Gehrig, J.: Multi-template matching: a versatile tool for object-localization in microscopy images. BMC Bioinform. 21(1), 1–8 (2020). https://doi.org/10.1186/s12859-020-3363-7
Vanlande, R., Nicolle, C., Cruz, C.: IFC and building lifecycle management. Autom. Constr. 18(1), 70–78 (2008). https://doi.org/10.1016/j.autcon.2008.05.001
Volk, R., Stengel, J., Schultmann, F.: Building information modeling (BIM) for existing buildings—literature review and future needs. Autom. Constr. 38, 109–127 (2014). https://doi.org/10.1016/j.autcon.2013.10.023
Acknowledgements
Supported by: BMWi (Federal Ministry for Economic Affairs and Energy), promotional reference 03ET1567A.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 IFIP International Federation for Information Processing
About this paper
Cite this paper
Mertens, N., Wohlfahrt, T., Hartmann, N., Reddy, C.B.V. (2023). Automatic Transformation of HVAC Diagrams into Machine-Readable Format. In: Noël, F., Nyffenegger, F., Rivest, L., Bouras, A. (eds) Product Lifecycle Management. PLM in Transition Times: The Place of Humans and Transformative Technologies. PLM 2022. IFIP Advances in Information and Communication Technology, vol 667. Springer, Cham. https://doi.org/10.1007/978-3-031-25182-5_40
Download citation
DOI: https://doi.org/10.1007/978-3-031-25182-5_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-25181-8
Online ISBN: 978-3-031-25182-5
eBook Packages: Computer ScienceComputer Science (R0)