Abstract
The statistical modeling of extraordinary loads on buildings has been stagnant for decades due to the laborious and error-prone nature of existing survey methods, such as questionnaires and verbal inquiries. This study proposes a new vision-based survey method for collecting extraordinary load data by automatically analyzing surveillance videos. For this purpose, a crowd head tracking framework is developed that integrates crowd head detection and reidentification models based on convolutional neural networks to obtain head trajectories of the crowd in the survey area. The crowd head trajectories are then analyzed to extract crowd quantity and velocities, which are the essential factors for extraordinary loads. For survey areas with frequent crowd movements during temporary events, the equivalent dynamic load factor can be further estimated using crowd velocity to consider dynamic effects. A crowd quantity investigation experiment and a crowd walking experiment are conducted to validate the proposed survey method. The experimental results prove that the proposed survey method is effective and accurate in collecting load data and reasonable in considering dynamic effects during extraordinary events. The proposed survey method is easy to deploy and has the potential to collect substantial and reliable extraordinary load data for determining design load on buildings.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Peir J. A stochastic live load model for buildings. Dissertation for the Doctoral Degree. Cambridge: Massachusetts Institute of Technology, 1972
Peir J C, Cornell C A. Spatial and temporal variability of live loads. Journal of the Structural Division, 1973, 99(5): 903–922
McGuire R K, Cornell C A. Live load effects in office buildings. Journal of the Structural Division, 1974, 100(7): 1351–1366
Mitchell G R, Woodgate R W. Floor Loadings in Office Buildings: The Results of A Survey. Watford: Building Research Station, 1971
Culver C G. Live-load survey results for office buildings. Journal of the Structural Division, 1976, 102(12): 2269–2284
Jin X Y, Zhao J D. Development of the design code for building structures in China. Journal of the International Association for Bridge and Structural Engineering, 2012, 22(2): 195–201
Andam K A. Floor live loads for office buildings. Building and Environment, 1986, 21(3–4): 211–219
Choi E C C. Live load in office buildings point-in-time load intensity of rooms. Proceedings of the Institution of Civil Engineers. Structures and Buildings, 1992, 94(3): 299–306
Kumar S. Live loads in office buildings: Point-in-time load intensity. Building and Environment, 2002, 37(1): 79–89
Ellingwood B, Culver C. Analysis of live loads in office buildings. Journal of the Structural Division, 1977, 103(8): 1551–1560
Chalk P L, Corotis R B. Probability model for design live loads. Journal of the Structural Division, 1980, 106(10): 2017–2033
Harris M E, Bova C J, Corotis R B. Area-dependent processes for structural live loads. Journal of the Structural Division, 1981, 107(5): 857–872
Paloheimo E, Ollila M. Research in the Live Loads in Persons. Finland: Ministry of Domestic Affairs, 1973
Choi E C C. Live load for office buildings: Effect of occupancy and code comparison. Journal of Structural Engineering, 1990, 116(11): 3162–3174
Choi E C C. Extraordinary live load in office buildings. Journal of Structural Engineering, 1991, 117(11): 3216–3227
Andam K A. Variability in stochastic sustained and extraordinary load processes. Building and Environment, 1990, 25(4): 389–396
Kumar S. Live loads in office buildings: Lifetime maximum load. Building and Environment, 2002, 37(1): 91–99
Corotis R B, Jaria V A. Stochastic nature of building live loads. Journal of the Structural Division, 1979, 105(3): 493–510
Sentler L. A Live Load Survey in Domestic Houses. Lund: Division of Building Technology, Lund Institute of Technology, 1974
Issen L A. A literature review of fire and live load surveys in residences. Final Report National Bureau of Standards, 1978
Ho L V, Trinh T T, de Roeck G, Bui-Tien T, Nguyen-Ngoc L, Abdel Wahab M. An efficient stochastic-based coupled model for damage identification in plate structures. Engineering Failure Analysis, 2022, 131: 105866
Tran V T, Nguyen T K, Nguyen-Xuan H, Abdel Wahab M. Vibration and buckling optimization of functionally graded porous microplates using BCMO-ANN algorithm. Thin-walled Structures, 2023, 182: 110267
Dang B L, Nguyen-Xuan H, Wahab M A. An effective approach for VARANS-VOF modelling interactions of wave and perforated breakwater using gradient boosting decision tree algorithm. Ocean Engineering, 2023, 268: 113398
Cha Y J, Choi W, Büyüköztürk O. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(5): 361–378
Wojke N, Bewley A, Paulus D. Simple online and realtime tracking with a deep association metric. In: Proceedings of 2017 IEEE International Conference on Image Processing. Beijing: IEEE; 2017, 3645–3649
Ren S Q, He K M, Girshick R, Sun J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137–1149
He K M, Zhang X Y, Ren S Q, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV: IEEE, 2016, 770–778
Xu Y, Bao Y Q, Chen J H, Zuo W M, Li H. Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images. Structural Health Monitoring, 2019, 18(3): 653–674
Ghosh Mondal T, Jahanshahi M R, Wu R T, Wu Z Y. Deep learning-based multi-class damage detection for autonomous post-disaster reconnaissance. Structural Control and Health Monitoring, 2020, 27(4): e2507
Nguyen D H, Wahab M A. Damage detection in slab structures based on two-dimensional curvature mode shape method and Faster R-CNN. Advances in Engineering Software, 2023, 176: 103371
Nath N D, Behzadan A H, Paal S G. Deep learning for site safety: Real-time detection of personal protective equipment. Automation in Construction, 2020, 112: 103085
Li Y, Chen J. Computer vision-based counting model for dense steel pipe on construction sites. Journal of Construction Engineering and Management, 2022, 148(1): 4021178
Luo X C, Li H, Wang H, Wu Z Z, Dai F, Cao D P. Vision-based detection and visualization of dynamic workspaces. Automation in Construction, 2019, 104: 1–13
Xiao B, Xiao H R, Wang J W, Chen Y. Vision-based method for tracking workers by integrating deep learning instance segmentation in off-site construction. Automation in Construction, 2022, 136: 104148
Xiao B, Kang S C. Vision-based method integrating deep learning detection for tracking multiple construction machines. Journal of Computing in Civil Engineering, 2021, 35(2): 4020071
He K M, Gkioxari G, Dollár P, Girshick R. Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision. Venice: IEEE, 2017, 2961–2969
Wang Z C, Zhang Q L, Yang B, Wu T K, Lei K, Zhang B H, Fang T W. Vision-based framework for automatic progress monitoring of precast walls by using surveillance videos during the construction phase. Journal of Computing in Civil Engineering, 2021, 35(1): 4020056
Jocher G, Stoken A, Chaurasia A, Borovec J. Yolov5: v6.0. 2021. Available at the website of GitHub
Liu S, Qi L, Qin H F, Shi J, Jia J Y. Path aggregation network for instance segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018, 8759–8768
Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning. Lille: JMLR, 2015, 448–456
Elfwing S, Uchibe E, Doya K. Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural Networks, 2018, 107: 3–11
Wang C Y, Liao H M, Wu Y H, Chen P Y, Hsieh J W, Yeh I H. CSPNet: A new backbone that can enhance learning capability of CNN. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Seattle: IEEE, 2020, 390–391
He K M, Zhang X Y, Ren S Q, Sun J. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(9): 1904–1916
Lin T Y, Dollár P, Girshick R, He K M, Hariharan B, Belongie S. Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017, 2117–2125
Kalman R E. A new approach to linear filtering and prediction problems. Journal of Basic Engineering, 1960, 82(1): 35–45
Kuhn H W. The Hungarian method for the assignment problem. Naval Research Logistics Quarterly, 1955, 2(1–2): 83–97
Ding X H, Zhang X Y, Ma N N, Han J G, Ding G G, Sun J. Repvgg: Making vgg-style convnets great again. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville: IEEE, 2021, 13733–13742
Wang J P, Chen J. A comparative study on different walking load models. Structural Engineering and Mechanics, 2017, 63(6): 847–856
Tubino F, Piccardo G. Serviceability assessment of footbridges in unrestricted pedestrian traffic conditions. Structure and Infrastructure Engineering, 2016, 12(12): 1650–1660
Chen J, Wang H Q, Peng Y X. Experimental investigation on Fourier-series model of walking load and its coefficients. Journal of Vibration and Shock, 2014, 33(8): 11–15 (in Chinese)
Zhao D S, Chen J. Tests for correlation and modeling of individual 3-D continuous walking load. Journal of Vibration and Shock, 2019, 38(11): 166–172 (in Chinese)
Wang J P, Chen J, Yokoyama Y, Xiong J C. Spectral model for crowd walking load. Journal of Structural Engineering, 2020, 146(3): 04019220
Peng D Z, Sun Z K, Chen Z R, Cai Z R, Xie L L, Jin L W. Detecting heads using feature refine net and cascaded multi-scale architecture. In: Proceedings of 2018 24th International Conference on Pattern Recognition. Beijing: IEEE, 2018, 2528–2533
Lin T Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick C L. Microsoft COCO: Common objects in context. In: Proceedings of Computer Vision—ECCV 2014: 13th European Conference. Zurich: Springer, 2014, 740–755
Kingma D P, Ba J. Adam: A method for stochastic optimization. 2014, arXiv: 14126980
Goyal P, Dollár P, Girshick R, Noordhuis P, Wesolowski L, Kyrola A, Tulloch A, Jia Y Q, He K M. Accurate, large minibatch sgd: Training imagenet in 1 hour. 2017, arXiv: 170602677
Loshchilov I, Hutter F. Sgdr: Stochastic gradient descent with warm restarts. 2016, arXiv: 160803983
Everingham M, Van Gool L, Williams C K I, Winn J, Zisserman A. The pascal visual object classes (VOC) challenge. International Journal of Computer Vision, 2010, 88(2): 303–338
Zhou K Y, Yang Y X, Cavallaro A, Xiang T. Omni-scale feature learning for person re-identification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019, 3702–3712
Ma N N, Zhang X Y, Zheng H T, Sun J. Shufflenet v2: Practical guidelines for efficient CNN architecture design. In: Proceedings of the European Conference on Computer Vision. Munich: Springer, 2018, 116–131
Iandola F N, Han S, Moskewicz M W, Ashraf K, Dally W J, Keutzer K. SqueezeNet: AlexNet-level accuracy with 50× fewer parameters and < 0.5 MB model size. 2016, arXiv: 160207360
Howard A, Sandler M, Chu G, Chen L C, Chen B, Tan M X, Wang W J, Zhu Y K, Pang R M, Vasudevan V, Le Q V, Adam H. Searching for mobilenetv3. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019, 1314–1324
Deng J, Dong W, Socher R, Li L J, Li K, Li F F. Imagenet: A large-scale hierarchical image database. In: Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami: IEEE, 2009, 248–255
Wang X G, Doretto G, Sebastian T, Rittscher J, Tu P. Shape and appearance context modeling. In: Proceedings of 2007 IEEE 11th International Conference on Computer Vision. Rio de Janeiro: IEEE, 2007, 1–8
Zheng L, Shen L Y, Tian L, Wang S J, Wang J D, Tian Q. Scalable person re-identification: A benchmark. In: Proceedings of the IEEE International Conference on Computer Vision. Santiago: IEEE, 2015, 1116–1124
Acknowledgements
The authors acknowledge the financial support provided by the National Natural Science Foundation of China (Grant No. 52178151). The helpful suggestions provided by Dr. Jinping Wang are greatly appreciated.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests The authors declare that they have no competing interests.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Li, Y., Chen, J. & Wang, P. Vision-based survey method for extraordinary loads on buildings. Front. Struct. Civ. Eng. 18, 815–831 (2024). https://doi.org/10.1007/s11709-024-1029-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11709-024-1029-7