Abstract
The performance of data-driven fault detection and diagnostics (FDD) is heavily dependent on sensors. However, sensor inaccuracy and sensor faults are pervasive in building operation: inaccurate and missing sensor readings deteriorate FDD performance; sensor inaccuracy will also affect the selection of sensor for data-driven FDD in the model training process, which is another key factor of data-driven FDD performance. Sensor accuracy and sensor selection individually are well-studied research topics in this field, but the impact of sensor accuracy on sensor selection and its further impact on FDD performance has not been evaluated and quantified. In this paper, we developed a novel analysis methodology that comprehensively evaluates sensor fault on sensor selection and FDD accuracy. Monte Carlo simulation is applied to deal with multiple stochastic sensor inaccuracy and provide probabilistic analysis results of the impact of sensor inaccuracy on sensor selection and FDD accuracy. This methodology focuses on the net impact of fault states across a full sensor set. The developed methodology can be used for the early-stage sensor design and operation-stage sensor maintenance. A case study is conducted to demonstrate the analysis methodology using a commercial building model crated to Flexible Research Platform located at Oak Ridge National Laboratory, USA.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Amritha C, Banu US (2013). Detection of bias, drift, freeze and abrupt sensor failure using intelligent dedicated observer based fault detection and isolation for three interacting tank process. International Journal of Computer Science and Network, 2: 2277–5420.
Biau G, Scornet E (2016). A random forest guided tour. TEST, 25: 197–227.
Breiman L (2001). Random forests. Machine Learning, 45: 5–32.
Chen Y, Lan L (2010). Fault detection, diagnosis and data recovery for a real building heating/cooling billing system. Energy Conversion and Management, 51: 1015–1024.
Dai X, Gao Z (2013). From model, signal to knowledge: A data-driven perspective of fault detection and diagnosis. IEEE Transactions on Industrial Informatics, 9: 2226–2238.
DOE (2013). EnergyPlus Energy Simulation Software, Version 8.1. Washington, DC: U.S. Department of Energy (DOE).
Du Z, Fan B, Jin X, et al. (2014). Fault detection and diagnosis for buildings and HVAC systems using combined neural networks and subtractive clustering analysis. Building and Environment, 73: 1–11.
Frank S, Heaney M, Jin X, et al. (2016). Hybrid model-based and data-driven fault detection and diagnostics for commercial buildings. In: Proceedings of the 2016 ACEEE Summer Study on Energy Efficiency in Building, Pacific Grove, CA, USA.
Frank SM, Lin G, Jin X, et al. (2019). Metrics and methods to assess building fault detection and diagnosis tools. Golden, CO, USA: National Renewable Energy Lab (NREL).
Goldwasser D, Ball BL, Farthing AD, et al. (2018). Advances in calibration of building energy models to time series data: Preprint. Golden, CO, USA: National Renewable Energy Lab (NREL).
Han H, Gu B, Wang T, et al. (2011). Important sensors for chiller fault detection and diagnosis (FDD) from the perspective of feature selection and machine learning. International Journal of Refrigeration, 34: 586–599.
Im P, Bhandari MS, New JR (2016). ORNL/TM-2016/286. Multiyear plan for validation of EnergyPlus multi-zone HVAC system modeling using ORNL’s Flexible Research Platform. Oak Ridge, TN, USA: Oak Ridge National Lab (ORNL).
Katipamula S, Brambley M (2005). Review article: Methods for fault detection, diagnostics, and prognostics for building systems—A review, part I. HVAC&R Research, 11: 3–25.
Kim J, Frank S, Braun JE, et al. (2019a). Representing small commercial building faults in EnergyPlus, part I: Model development. Buildings, 9: 233.
Kim J, Frank S, Im P, et al. (2019b). Representing small commercial building faults in EnergyPlus, part II: Model validation. Buildings, 9: 239.
Li D, Zhou Y, Hu G, et al. (2016). Fault detection and diagnosis for building cooling system with a tree-structured learning method. Energy and Buildings, 127: 540–551.
Lin G, Kramer H, Granderson J (2020). Building fault detection and diagnostics: Achieved savings, and methods to evaluate algorithm performance. Building and Environment, 168: 106505.
Pedregosa F, Varoquaux G, Gramfort A, et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12: 2825–2830.
Wang S, Zhou Q, Xiao F (2010). A system-level fault detection and diagnosis strategy for HVAC systems involving sensor faults. Energy and Buildings, 42: 477–490.
Yuwono M, Guo Y, Wall J, et al. (2015). Unsupervised feature selection using swarm intelligence and consensus clustering for automatic fault detection and diagnosis in heating ventilation and air conditioning systems. Applied Soft Computing, 34: 402–425.
Zhang L, Wen J (2019). A systematic feature selection procedure for short-term data-driven building energy forecasting model development. Energy and Buildings, 183: 428–442.
Zhang L, Frank S, Kim J, et al. (2020). A systematic feature extraction and selection framework for data-driven whole-building automated fault detection and diagnostics in commercial buildings. Building and Environment, 186: 107338.
Zhang L, Wen J, Li Y, et al. (2021). A review of machine learning in building load prediction. Applied Energy, 285: 116452.
Zhao Y, Wang S, Xiao F (2013). Pattern recognition-based chillers fault detection method using support vector data description (SVDD). Applied Energy, 112: 1041–1048.
Acknowledgements
This work was authored by the National Renewable Energy Laboratory, operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided by U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Building Technologies. The views expressed in the article do not necessarily represent the views of the DOE or the U.S. Government. The U.S. Government retains and the publisher, by accepting the article for publication, acknowledges that the U.S. Government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this work or allow others to do so, for U.S. Government purposes.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, L., Leach, M. Evaluate the impact of sensor accuracy on model performance in data-driven building fault detection and diagnostics using Monte Carlo simulation. Build. Simul. 15, 769–778 (2022). https://doi.org/10.1007/s12273-021-0833-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12273-021-0833-4