Skip to main content
Log in

Probabilistic graphical models in energy systems: A review

  • Review Article
  • Published:
Building Simulation Aims and scope Submit manuscript

Abstract

Probabilistic graphical models (PGMs) can effectively deal with the problems of energy consumption and occupancy prediction, fault detection and diagnosis, reliability analysis, and optimization in energy systems. Compared with the black-box models, PGMs show advantages in model interpretability, scalability and reliability. They have great potential to realize the true artificial intelligence in energy systems of the next generation. This paper intends to provide a comprehensive review of the PGM-based approaches published in the last decades. It reveals the advantages, limitations and potential future research directions of the PGM-based approaches for energy systems. Two types of PGMs are summarized in this review, including static models (SPGMs) and dynamic models (DPGMs). SPGMs can conduct probabilistic inference based on incomplete, uncertain or even conflicting information. SPGM-based approaches are proposed to deal with various management tasks in energy systems. They show outstanding performance in fault detection and diagnosis of energy systems. DPGMs can represent a dynamic and stochastic process by describing how its state changes with time. DPGM-based approaches have high accuracy in predicting the energy consumption, occupancy and failures of energy systems. In the future, a unified framework is suggested to fuse the knowledge-driven and data-driven PGMs for achieving better performances. Universal PGM-based approaches are needed that can be adapted to various energy systems. Hybrid algorithms would outperform the basic PGMs by integrating advanced techniques such as deep learning and first-order logic.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Abbreviations

AI:

artificial intelligence

AHU:

air handling unit

DPGM:

dynamic probabilistic graphical model

HVAC:

heating, ventilation and air conditioning

PGM:

probabilistic graphical model

PV:

photovoltaic

SPGM:

static probabilistic graphical model

VAV:

variable air volume

References

  • Adamopoulou AA, Tryferidis AM, Tzovaras DK (2016). A context-aware method for building occupancy prediction. Energy and Buildings, 110: 229–244.

    Article  Google Scholar 

  • Adams G, Ferrante F (2007). Markov modeling application to a redundant safety system. In: Proceedings of ASME 2007 Power Conference, San Antonio, TX, USA.

  • Aguila-Leon J, Chiñas-Palacios C, Garcia EXM, et al. (2020). A multimicrogrid energy management model implementing an evolutionary game-theoretic approach. International Transactions on Electrical Energy Systems, 30(11): e12617.

    Article  Google Scholar 

  • Ai B, Fan Z, Gao RX (2014). Occupancy estimation for smart buildings by an auto-regressive hidden Markov model. In: Proceedings of 2014 American Control Conference, Portland, OR, USA.

  • Aiad M, Lee PH (2018). Modelling and power estimation of continuously varying residential loads using a quantized continuous-state hidden Markov model. In: Proceedings of the 2nd International Conference on Machine Learning and Soft Computing (ICMLSC’18), Phu Quoc Island, Viet Nam.

  • Andersen PD, Iversen A, Madsen H, et al. (2014). Dynamic modeling of presence of occupants using inhomogeneous Markov chains. Energy and Buildings, 69: 213–223.

    Article  Google Scholar 

  • Ardakanian O, Keshav S, Rosenberg C (2011). Markovian models for home electricity consumption. In: Proceedings of the 2nd ACM SIGCOMM Workshop on Green Networking (GreenNets’11), Toronto, Canada.

  • Arroyo-Figueroa G, Sucar LE, Villavicencio A (1998). Probabilistic temporal reasoning and its application to fossil power plant operation. Expert Systems with Applications, 15: 317–324.

    Article  Google Scholar 

  • Arroyo-Figueroa G, Alvarez Y, Sucar L (2000). SEDRET—An intelligent system for the diagnosis and prediction of events in power plants. Expert Systems with Applications, 18: 75–86.

    Article  Google Scholar 

  • Baik H-S, Jeong HS, Abraham DM (2006). Estimating transition probabilities in Markov chain-based deterioration models for management of wastewater systems. Journal of Water Resources Planning and Management, 132: 15–24.

    Article  Google Scholar 

  • Balekelayi N, Tesfamariam S (2019). Graph-theoretic surrogate measure to analyze reliability of water distribution system using Bayesian belief network-based data fusion technique. Journal of Water Resources Planning and Management, 145: 04019028.

    Article  Google Scholar 

  • Bassamzadeh N, Ghanem R (2017). Multiscale stochastic prediction of electricity demand in smart grids using Bayesian networks. Applied Energy, 193: 369–380.

    Article  Google Scholar 

  • Bazine H, Mabrouki M (2017). Prediction of photovoltaic production for smart grid energy management using hidden Markov model: A study case. In: Proceedings of 2017 International Renewable and Sustainable Energy Conference (IRSEC), Tangier, Morocco.

  • Beltran A, Cerpa AE (2014). Optimal HVAC building control with occupancy prediction. In: Proceedings of the 1st ACM Conference on Embedded Systems for Energy-Efficient Buildings, Memphis TN, USA.

  • Bevrani H, Daneshfar F, Hiyama T (2012). A new intelligent agent-based AGC design with real-time application. IEEE Transactions on Systems, Man, and Cybernetics, Part C, 42: 994–1002.

    Article  Google Scholar 

  • Bigaud D, Charki A, Caucheteux A, et al. (2019). Detection of faults and drifts in the energy performance of a building using Bayesian networks. Journal of Dynamic Systems, Measurement, and Control, 141(10): 101011.

    Article  Google Scholar 

  • Bondu A, Dachraoui A (2015). Realistic and very fast simulation of individual electricity consumptions. In: Proceedings of 2015 International Joint Conference on Neural Networks (IJCNN), Killarney, Ireland.

  • Borunda M, Jaramillo OA, Reyes A, et al. (2016). Bayesian networks in renewable energy systems: A bibliographical survey. Renewable and Sustainable Energy Reviews, 62: 32–45.

    Article  Google Scholar 

  • Cai B, Liu Y, Fan Q, et al. (2014). Multi-source information fusion based fault diagnosis of ground-source heat pump using Bayesian network. Applied Energy, 114: 1–9.

    Article  Google Scholar 

  • Cai B, Huang L, Xie M (2017). Bayesian networks in fault diagnosis. IEEE Transactions on Industrial Informatics, 13: 2227–2240.

    Article  Google Scholar 

  • Cai B, Liu Y, Liu Z, et al. (2020). A framework for the reliability evaluation of grid-connected photovoltaic systems in the presence of intermittent faults. In: Bayesian Networks for Reliability Engineering. Singapore: Springer.

    Chapter  Google Scholar 

  • Candanedo LM, Feldheim V, Deramaix D (2017). A methodology based on Hidden Markov Models for occupancy detection and a case study in a low energy residential building. Energy and Buildings, 148: 327–341.

    Article  Google Scholar 

  • Carta JA, Velázquez S, Matías JM (2011). Use of Bayesian networks classifiers for long-term mean wind turbine energy output estimation at a potential wind energy conversion site. Energy Conversion and Management, 52: 1137–1149.

    Article  Google Scholar 

  • Chang Y, Zhang C, Shi J, et al. (2019). Dynamic Bayesian network based approach for risk analysis of hydrogen generation unit leakage. International Journal of Hydrogen Energy, 44: 26665–26678.

    Article  Google Scholar 

  • Chen J, Hao G (2011). Research on the fault diagnosis of wind turbine gearbox based on Bayesian networks. In: Wang Y, Li T (eds), Practical Applications of Intelligent Systems. Berlin: Springer.

    Google Scholar 

  • Chen Z, Xu J, Soh YC (2015). Modeling regular occupancy in commercial buildings using stochastic models. Energy and Buildings, 103: 216–223.

    Article  Google Scholar 

  • Cheng Q, Wang S, Yan C (2016). Robust optimal design of chilled water systems in buildings with quantified uncertainty and reliability for minimized life-cycle cost. Energy and Buildings, 126: 159–169.

    Article  Google Scholar 

  • Chen Z, Zhu Q, Masood MK, et al. (2017). Environmental sensors-based occupancy estimation in buildings via IHMM-MLR. IEEE Transactions on Industrial Informatics, 13: 2184–2193.

    Article  Google Scholar 

  • Chen Y, Wen J, Chen T, et al. (2018). Bayesian networks for whole building level fault diagnosis and isolation. In: Proceedings of International High Performance Buildings Conference.

  • Choi K-S, Yang B-W (2016). ZigBee-based real-time energy disaggregation system using factorial hidden Markov model. In: Proceedings of International Conference on Environment, Climate Change and Sustainable Development (ECCSD 2016), Beijing, China.

  • Codetta-Raiteri D, Bobbio A, Montani S, et al. (2012). A dynamic Bayesian network based framework to evaluate cascading effects in a power grid. Engineering Applications of Artificial Intelligence, 25: 683–697.

    Article  Google Scholar 

  • D’Amico G, Petroni F, Prattico F (2013). Reliability measures of second-order semi-Markov chain applied to wind energy production. Journal of Renewable Energy, 2013: 1–6.

    Article  MATH  Google Scholar 

  • D’Amico G, Petroni F, Prattico F (2015). Reliability measures for indexed semi-Markov chains applied to wind energy production. Reliability Engineering & System Safety, 144: 170–177.

    Article  MATH  Google Scholar 

  • D’Angelo MFSV, Palhares RM, Cosme LB, et al. (2014). Fault detection in dynamic systems by a Fuzzy/Bayesian network formulation. Applied Soft Computing, 21: 647–653.

    Article  Google Scholar 

  • de Bessa IV, Palhares RM, D’Angelo MFSV, et al. (2016). Data-driven fault detection and isolation scheme for a wind turbine benchmark. Renewable Energy, 87: 634–645.

    Article  Google Scholar 

  • De Caro F, Vaccaro A, Villacci D (2019). A Markov chain-based model for wind power prediction in congested electrical grids. The Journal of Engineering, 2019: 4961–4964.

    Article  Google Scholar 

  • Deb S, Patra S (2016). A new methodology for severity analysis of power system network by using Bayesian network. MAYFEB Journal of Electrical and Computer Engineering, 1: 1–6.

    Google Scholar 

  • Dey D, Dong B (2016). A probabilistic approach to diagnose faults of air handling units in buildings. Energy and Buildings, 130: 177–187.

    Article  Google Scholar 

  • Dhople SV, Dominguez-Garcia AD (2012). Estimation of photovoltaic system reliability and performance metrics. IEEE Transactions on Power Systems, 27: 554–563.

    Article  Google Scholar 

  • Ding W, Meng F (2020). Point and interval forecasting for wind speed based on linear component extraction. Applied Soft Computing, 93: 106350.

    Article  Google Scholar 

  • Dinwoodie I, McMillan D, Revie M, et al. (2013). Development of a combined operational and strategic decision support model for offshore wind. Energy Procedia, 35: 157–166.

    Article  Google Scholar 

  • Divya D, Sathiyasekar K (2016). Modern real time electric meter for efficient energy management using Markov chain algorithm. In: Proceedings of 2016 International Conference on Advanced Communication Control and Computing Technologies (ICACCCT), Ramanathapuram, India.

  • Dobbs JR, Hencey BM (2014). Predictive HVAC control using a Markov occupancy model. In: Proceedings of 2014 American Control Conference, Portland, OR, USA.

  • Dong B, Andrews B (2009). Sensor-based occupancy behavioral pattern recognition for energy and comfort management in intelligent buildings. In: Proceedings of the 11th International IBPSA Building Simulation Conference, Glasgow, UK.

  • Dong B, Lam KP (2014). A real-time model predictive control for building heating and cooling systems based on the occupancy behavior pattern detection and local weather forecasting. Building Simulation, 7: 89–106.

    Article  Google Scholar 

  • Duhirwe PN, Hwang JK, Ngarambe J, et al. (2021). A novel deep learning-based integrated photovoltaic, energy storage system and electric heat pump system: Optimising energy usage and costs. International Journal of Energy Research, 45: 9306–9325.

    Article  Google Scholar 

  • Duong TV, Phung DQ, Bui HH, et al. (2006). Human behavior recognition with generic exponential family duration modeling in the hidden semi-Markov model. In: Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.

  • Ebrahimi A, Daemi T (2009). A novel method for constructing the Bayesian network for detailed reliability assessment of power systems. In: Proceedings of International Conference on Electric Power & Energy Conversion Systems (EPECS 2009), Sharjah, United Arab Emirates.

  • Elgharbi S, Esghir M, Ibrihich O, et al. (2020). Grey-Markov model for the prediction of the electricity production and consumption. In: Farhaoui Y (ed), Big Data and Networks Technologies. Cham, Switzerland: Springer. pp. 206–219.

    Chapter  Google Scholar 

  • Eniola V, Suriwong T, Sirisamphanwong C, et al. (2019). Hour-ahead forecasting of photovoltaic power output based on hidden Markov model and genetic algorithm. International Journal of Renewable Energy Research, 9: 933–943.

    Google Scholar 

  • Erickson VL, Cerpa AE (2010). Occupancy based demand response HVAC control strategy. In: Proceedings of the 2nd ACM Workshop on Embedded Sensing Systems for Energy-Efficiency in Building (BuildSys’10), Zurich, Switzerland.

  • Erickson VL, Carreira-Perpiñán MÁ, Cerpa AE (2011). OBSERVE: Occupancy-based system for efficient reduction of HVAC energy. In: Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks, Chicago, IL, USA.

  • Fan C, Wang J, Gang W, et al. (2019). Assessment of deep recurrent neural network-based strategies for short-term building energy predictions. Applied Energy, 236: 700–710.

    Article  Google Scholar 

  • Fan H, Zhang X, Mei S, et al. (2021). A Markov regime switching model for ultra-short-term wind power prediction based on toeplitz inverse covariance clustering. Frontiers in Energy Research, 9: 638797.

    Article  Google Scholar 

  • Fleming KN (2004). Markov models for evaluating risk-informed in-service inspection strategies for nuclear power plant piping systems. Reliability Engineering & System Safety, 83: 27–45.

    Article  Google Scholar 

  • Frenkel I, Khvatskin L, Lisnianski A (2006). Markov Reward Models for reliability assessment of air conditioning systems. In: Proceedings of the European Safety and Reliability Conference 2006 (ESREL 2006), Estoril, Portugal.

  • Frenkel I, Lisnianski A, Khvatskin L (2009). Markov reward model for performance deficiency calculation of refrigeration system. In: Bris R, Soares CG, Martorell S (eds), Reliability, Risk and Safety: Theory and Applications. London: CRC Press.

    MATH  Google Scholar 

  • Fu Z, Chen Q, Zhang L, et al. (2021). Research on energy management strategy of fuel cell power generation system based on Grey-Markov chain power prediction. Energy Reports, 7: 319–325.

    Article  Google Scholar 

  • Fürnkranz J, Chan PK, Craw S, et al. (2011). Markov network. In: Sammut C, Webb GI (eds), Encyclopedia of Machine Learning. Boston, MA, USA: Springer.

    Google Scholar 

  • Futakuchi M, Takayama S, Ishigame A (2021). Scheduled operation of wind farm with battery system using deep reinforcement learning. IEEJ Transactions on Electrical and Electronic Engineering, 16: 687–695.

    Article  Google Scholar 

  • Gang W, Wang S, Xiao F, et al. (2015). Robust optimal design of building cooling systems considering cooling load uncertainty and equipment reliability. Applied Energy, 159: 265–275.

    Article  Google Scholar 

  • Ghasvarian Jahromi K, Gharavian D, Mahdiani H (2020). A novel method for day-ahead solar power prediction based on hidden Markov model and cosine similarity. Soft Computing, 24: 4991–5004.

    Article  Google Scholar 

  • Gu Y-K, Xu B, Huang H, et al. (2020). A fuzzy performance evaluation model for a gearbox system using hidden Markov model. IEEE Access, 8: 30400–30409.

    Article  Google Scholar 

  • Gunduz H, Jayaweera D (2018). Reliability assessment of a power system with cyber-physical interactive operation of photovoltaic systems. International Journal of Electrical Power & Energy Systems, 101: 371–384.

    Article  Google Scholar 

  • Guo Y, Tan Z, Chen H, et al. (2018). Deep learning-based fault diagnosis of variable refrigerant flow air-conditioning system for building energy saving. Applied Energy, 225: 732–745.

    Article  Google Scholar 

  • Hamza Z, Abdallah T (2015). Mapping Fault Tree into Bayesian Network in safety analysis of process system. In: Proceedings of the 4th International Conference on Electrical Engineering (ICEE), Boumerdes, Algeria.

  • Han P, Zhang D, Zhou L, et al. (2007). Steam turbine fault diagnosis method based on rough set theory and Bayesian network. In: Proceedings of the 4th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007), Haikou, China.

  • He S, Wang Z, Wang Z, et al. (2016). Fault detection and diagnosis of chiller using Bayesian network classifier with probabilistic boundary. Applied Thermal Engineering, 107: 37–47.

    Article  Google Scholar 

  • Hong Y-Y, Chang W-C, Chang Y-R, et al. (2017). Optimal sizing of renewable energy generations in a community microgrid using Markov model. Energy, 135: 68–74.

    Article  Google Scholar 

  • Hong Y-Y, Wu M-Y (2019). Markov model-based energy storage system planning in power systems. IEEE Systems Journal, 13: 4313–4323.

  • Hou K, Jia H, Xu X, et al. (2016). A continuous time Markov chain based sequential analytical approach for composite power system reliability assessment. IEEE Transactions on Power Systems, 31: 738–748.

    Article  Google Scholar 

  • Hu M, Chen H, Shen L, et al. (2018). A machine learning Bayesian network for refrigerant charge faults of variable refrigerant flow air conditioning system. Energy and Buildings, 158: 668–676.

    Article  Google Scholar 

  • Huang L, Hou C, Wang H, et al. (2009). Assessment of distribution system reliability based on Bayesian network and time sequence simulation. In: Proceedings of the 6th International Conference on Fuzzy Systems and Knowledge Discovery, Tianjin, China.

  • Huang S, Zuo W, Sohn MD (2016). A Bayesian network model for prediction the cooling load of educational facilities. In: Proceedings of the ASHRAE and IBPSA-USA SimBuild 2016: Building Performance Modeling Conference, Salt Lake City, UT, USA.

  • Huang S, Malara ACL, Zuo W, et al. (2018a). A Bayesian network model for the optimization of a chiller plant’s condenser water set point. Journal of Building Performance Simulation, 11: 36–47.

    Article  Google Scholar 

  • Huang S, Zuo W, Sohn MD (2018b). A Bayesian network model for predicting cooling load of commercial buildings. Building Simulation, 11: 87–101.

    Article  Google Scholar 

  • Ji Y, Wang J, Yan S, et al. (2015). Optimal microgrid energy management integrating intermittent renewable energy and stochastic load. In: Proceedings of 2015 IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China

  • Jun H-B, Kim D (2017). A Bayesian network-based approach for fault analysis. Expert Systems with Applications, 81: 332–348.

    Article  Google Scholar 

  • Kazmi H, Amayri M, Ploix S (2018). Estimating occupancy in residential context using Bayesian networks for energy management. In: Proceedings of the 20th International Conference on Machine Learning for Prediction and Control (ICMLPC).

  • Kim WS, Eom H, Kwon Y (2021). Optimal design of photovoltaic connected energy storage system using Markov chain models. Sustainability, 13: 3837.

    Article  Google Scholar 

  • Kobayashi K, Hiraishi K (2015). Algorithm for optimal real-time pricing based on switched Markov chain models. In: Proceedings of 2015 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), Washington, D.C., USA.

  • Koch S, Mathieu J, Callaway D (2011). Modeling and control of aggregated heterogeneous thermostatically controlled loads for ancillary services. In: Proceedings of 17th Power Systems Computation Conference, Stockholm, Sweden.

  • Kouadri A, Hajji M, Harkat M-F, et al. (2020). Hidden Markov model based principal component analysis for intelligent fault diagnosis of wind energy converter systems. Renewable Energy, 150: 598–606.

    Article  Google Scholar 

  • Krishnan V (2006). Probability and Random Processes. Hoboken NJ, USA: John Wiley & Sons.

    Book  MATH  Google Scholar 

  • Kulikov GG, Arkov V, Abdulnagimov AI (2010). Markov modelling for energy efficient control of gas turbine power plant. IFAC Proceedings Volumes, 43: 63–67.

    Article  Google Scholar 

  • Kumar ES, Behera DK, Sarkar A (2012). Markov chain modeling of performance degradation of photovoltaic system. IJCSMS International Journal of Computer Science and Management Studies, 12: 39–44.

    Google Scholar 

  • Lakehal A, Ghemari Z (2015). Availability assessment of electric power based on switch reliability modelling with dynamic Bayesian networks: Case study of electrical distribution networks. Journal of Mathematics and System Science, 5: 289–295.

    Google Scholar 

  • Li Y-Z, He L, Nie R-Q (2009). Short-term forecast of power generation for grid-connected photovoltaic system based on advanced Grey-Markov Chain. In: Proceedings of 2009 International Conference on Energy and Environment Technology, Guilin, China.

  • Li D, Jayaweera SK, Abdallah CT (2012). Uncertainty modeling and stochastic control design for smart grid with distributed renewables. In: Proceedings of 2012 IEEE Green Technologies Conference, Tulsa, OK, USA.

  • Li S, Chen Y, Liu Y, et al. (2018). Dynamic Bayesian network based reliability evaluation of supervision and control system in smart grids. In: Proceedings of the 2nd IEEE Conference on Energy Internet and Energy System Integration (EI2), Beijing, China.

  • Li B, Roche R (2020). Optimal scheduling of multiple multi-energy supply microgrids considering future prediction impacts based on model predictive control. Energy, 197: 117180.

    Article  Google Scholar 

  • Li T, Zhao Y, Zhang C, et al. (2021a). A knowledge-guided and data-driven method for building HVAC systems fault diagnosis. Building and Environment, 198: 107850.

    Article  Google Scholar 

  • Li W, Jia X, Li X, et al. (2021b). A Markov model for short term wind speed prediction by integrating the wind acceleration information. Renewable Energy, 164: 242–253.

    Article  Google Scholar 

  • Lisnianski A, Elmakias D, Laredo D, et al. (2012). A multi-state Markov model for a short-term reliability analysis of a power generating unit. Reliability Engineering & System Safety, 98: 1–6.

    Article  Google Scholar 

  • Liu Z, Liu Y, Cai B (2014). Reliability analysis of the electrical control system of subsea blowout preventers using Markov models. PLoS ONE, 9: e113525.

    Article  Google Scholar 

  • Liu Y, Cai B (2015). A reliability analysis framework based on time-varying dynamic Bayesian network. In: Proceedings of 2015 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), Singapore.

  • Liu Z, Liu Y, Shan H, et al. (2015a). A fault diagnosis methodology for gear pump based on EEMD and Bayesian network. PLoS ONE, 10: e0125703.

    Article  Google Scholar 

  • Liu Z, Liu Y, Zhang D, et al. (2015b). Fault diagnosis for a solar assisted heat pump system under incomplete data and expert knowledge. Energy, 87: 41–48.

    Article  Google Scholar 

  • Loeliger H (2004). An Introduction to factor graphs. IEEE Signal Processing Magazine, 21: 28–41.

    Article  Google Scholar 

  • Lou C, Li X, Atoui MA (2020). Bayesian network based on an adaptive threshold scheme for fault detection and classification. Industrial & Engineering Chemistry Research, 59: 15155–15164.

    Article  Google Scholar 

  • Mady AE-D, Provan GM, Ryan C, et al. (2011). Stochastic model predictive controller for the integration of building use and temperature regulation. In: Proceedings of the 25th AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.

  • Mahani K, Liang Z, Parlikad AK, et al. (2019). Joint optimization of operation and maintenance policies for solar-powered microgrids. IEEE Transactions on Sustainable Energy, 10: 833–842.

    Article  Google Scholar 

  • Malara ACL, Huang S, Zuo W, et al. (2015). Optimal control of chiller plants using Bayesian network. In: Proceedings of the 14th International IBPSA Building Simulation Conference, Hyderabad, India.

  • Manna C, Fay D, Brown KN, et al. (2013). Learning occupancy in single person offices with mixtures of multi-lag Markov chains. In: Proceedings of 2013 IEEE 25th International Conference on Tools with Artificial Intelligence, Herndon, VA, USA.

  • Mantelli L, Zaccaria V, Kyprianidis K, et al. (2020). A degradation diagnosis method for gas turbine-fuel cell hybrid systems using Bayesian networks. In: Proceedings of ASME Turbo Expo 2020: Turbomachinery Technical Conference and Exposition.

  • Martins MR, Schleder AM, Droguett EL (2014). A methodology for risk analysis based on hybrid Bayesian networks: Application to the regasification system of liquefied natural gas onboard a floating storage and regasification unit. Risk Analysis, 34: 2098–2120.

    Article  Google Scholar 

  • Mathieu JL, Koch S, Callaway DS (2013). State estimation and control of electric loads to manage real-time energy imbalance. IEEE Transactions on Power Systems, 28: 430–440.

    Article  Google Scholar 

  • Melani AHA (2020). System fault diagnosis based on Bayesian networks and SysML. PhD Thesis, Polytechnic School of the University of São Paulo, Brazil.

    Google Scholar 

  • Micevski T, Kuczera G, Coombes P (2002). Markov model for storm water pipe deterioration. Journal of Infrastructure Systems, 8: 49–56.

    Article  Google Scholar 

  • Moya C, Zhang W, Lian J, et al. (2014). A hierarchical framework for demand-side frequency control. In: Proceedings of 2014 American Control Conference, Portland, OR, USA.

  • Muralidharan V, Sugumaran V (2012). A comparative study of Naïve Bayes classifier and Bayes net classifier for fault diagnosis of monoblock centrifugal pump using wavelet analysis. Applied Soft Computing, 12: 2023–2029.

    Article  Google Scholar 

  • Muratori M, Roberts MC, Sioshansi R, et al. (2013). A highly resolved modeling technique to simulate residential power demand. Applied Energy, 107: 465–473.

    Article  Google Scholar 

  • Murphy KP (2002). Dynamic Bayesian networks: Representation, inference and learning. PhD Thesis, University of California, Berkeley, USA.

    Google Scholar 

  • Nademi H, Vanfretti L, Pretlove J (2020). Fault detection method in subsea power distribution systems using statistical optimisation. IET Energy Systems Integration, 2: 144–150.

    Article  Google Scholar 

  • Nagaraja HN (2006). Inference in hidden Markov models. Technometrics, 48: 574–575.

    Article  Google Scholar 

  • Najafi M, Auslander DM, Bartlett PL, et al. (2012). Application of machine learning in the fault diagnostics of air handling units. Applied Energy, 96: 347–358.

    Article  Google Scholar 

  • Nanda R, Saguna S, Mitra K, et al. (2016). BayesForSG: A Bayesian model for forecasting thermal load in smart grids. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing (SAC’16), Pisa, Italy.

  • Nasir A, Soong B-H, Ramachandran S (2010). Framework of WSN based human centric cyber physical in-pipe water monitoring system. In: Proceedings of the 11th International Conference on Control Automation Robotics & Vision, Singapore.

  • Nemati HM, Sant’Anna A, Nowaczyk S (2016). Bayesian network representation of meaningful patterns in electricity distribution grids. In: Proceedings of 2016 IEEE International Energy Conference (ENERGYCON), Leuven, Belgium.

  • O’Neill Z, O’Neill C (2016). Development of a probabilistic graphical model for predicting building energy performance. Applied Energy, 164: 650–658.

    Article  Google Scholar 

  • Ouyang T, Zha X, Qin L, et al. (2019). Prediction of wind power ramp events based on residual correction. Renewable Energy, 136: 781–792.

    Article  Google Scholar 

  • Ozer I, Efe SB, Ozbay H (2021). A combined deep learning application for short term load forecasting. Alexandria Engineering Journal, 60: 3807–3818.

    Article  Google Scholar 

  • Page J, Robinson D, Morel N, et al. (2008). A generalised stochastic model for the simulation of occupant presence. Energy and Buildings, 40: 83–98.

    Article  Google Scholar 

  • Pearl J (1985). Bayesian networks: A model of self-activated memory for evidential reasoning. In: Proceedings of the 7th Conference of the Cognitive Science Society, Irvine, CA, USA.

  • Plumley CE, Wilson GK, Kenyon AD (2012). Diagnostics and prognostics utilising dynamic Bayesian networks applied to a wind turbine gearbox. In: Proceedings of International Conference on Condition Monitoring and Machine Failure Prevention Technologies, London, UK.

  • Radaideh A, Vaidya U, Ajjarapu V (2019). Sequential set-point control for heterogeneous thermostatically controlled loads through an extended Markov chain abstraction. IEEE Transactions on Smart Grid, 10: 116–127.

    Article  Google Scholar 

  • Ramírez PAP, Utne IB (2015). Use of dynamic Bayesian networks for life extension assessment of ageing systems. Reliability Engineering & System Safety, 133: 119–136.

    Article  Google Scholar 

  • Raykov YP, Ozer E, Dasika G, et al. (2016). Predicting room occupancy with a single passive infrared (PIR) sensor through behavior extraction. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.

  • Reffas O, Sahraoui Y, Nahal M, et al. (2020). Reactive energy compensator effect on the reliability of a complex electrical system using Bayesian networks. Eksploatacja i Niezawodnosc — Maintenance and Reliability, 22: 684–693.

    Article  Google Scholar 

  • Regnier A, Wen J (2016). Automated fault diagnostics for AHU-VAV systems: A Bayesian network approach. In: Proceedings of the International High Performance Buildings Conference.

  • Roje T, Marín LG, Sáez D, et al. (2017). Consumption modeling based on Markov chains and Bayesian networks for a demand side management design of isolated microgrids. International Journal of Energy Research, 41: 365–376.

    Article  Google Scholar 

  • Rousan T (2016). Distribution automation reliability analysis using Markov models. In: Proceedings of 2016 IEEE Power and Energy Conference at Illinois (PECI), Urbana, IL, USA.

  • Salimi S, Liu Z, Hammad A (2019). Occupancy prediction model for open-plan offices using real-time location system and inhomogeneous Markov chain. Building and Environment, 152: 1–16.

    Article  Google Scholar 

  • Sandels C, Widen J, Nordstrom L (2015). Simulating occupancy in office buildings with non-homogeneous Markov chains for Demand Response analysis. In: Proceedings of 2015 IEEE Power & Energy Society General Meeting, Denver, CO, USA.

  • Sanjari MJ, Gooi HB, Nair N-KC (2020). Power generation forecast of hybrid PV-wind system. IEEE Transactions on Sustainable Energy, 11: 703–712.

    Article  Google Scholar 

  • Shahnazari H, Mhaskar P, House JM, et al. (2019). Modeling and fault diagnosis design for HVAC systems using recurrent neural networks. Computers & Chemical Engineering, 126: 189–203.

    Article  Google Scholar 

  • Shariatkhah M-H, Haghifam M-R, Parsa-Moghaddam M, et al. (2015). Modeling the reliability of multi-carrier energy systems considering dynamic behavior of thermal loads. Energy and Buildings, 103: 375–383.

    Article  Google Scholar 

  • Shelat S, Daamen W, Kaag B, et al. (2020). A Markov-chain activity-based model for pedestrians in office buildings. Collective Dynamics, 5: A78.

    Article  Google Scholar 

  • Shi Z, O’Brien W, Gunay HB (2018). Development of a distributed building fault detection, diagnostic, and evaluation system. ASHRAE Transactions, 124(2), 23–37.

    Google Scholar 

  • Shirbhate IM, Barve SS (2018). Time-series energy prediction using hidden Markov model for smart solar system. In: Proceedings of the 3rd International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India.

  • Shoji T, Hirohashi W, Fujimoto Y, et al. (2014). Home energy management based on Bayesian network considering resident convenience. In: Proceedings of 2014 International Conference on Probabilistic Methods Applied to Power Systems (PMAPS), Durham, UK.

  • Sindhu S, Nehra V, Malik SC (2017). Reliability estimation of photovoltaic system using Markov process and dynamic programming approach. International Journal of Reliability and Safety, 11: 132.

    Article  Google Scholar 

  • Šnipas M, Radziukynas V, Valakevičius E (2017). Modeling reliability of power systems substations by using stochastic automata networks. Reliability Engineering & System Safety, 157: 13–22.

    Article  Google Scholar 

  • Sobolewski RA (2015). Wind farm reliability modelling using Bayesian networks and semi-Markov processes. Acta Energetica, 3: 71–76.

    Article  Google Scholar 

  • Song J, Bozchalui MC, Kwasinski A, et al. (2012). Microgrids availability evaluation using a Markov chain energy storage model: A comparison study in system architectures. In: Proceedings of IEEE/PES Transmission and Distribution Conference and Exposition (T&D), Orlando, FL, USA.

  • Song Y, Hu W (2017). Research on fault diagnosis method based on Temporal Bayesian Network. In: Proceedings of the the 5th International Conference on Mechatronics, Materials, Chemistry and Computer Engineering (ICMMCCE 2017), Chongqing, China.

  • Soudari M, Srinivasan S, Balasubramanian S, et al. (2016). Learning based personalized energy management systems for residential buildings. Energy and Buildings, 127: 953–968.

    Article  Google Scholar 

  • Sykora M, Marková J, Diamantidis D (2018). Bayesian network application for the risk assessment of existing energy production units. Reliability Engineering & System Safety, 169: 312–320.

    Article  Google Scholar 

  • Taal A, Itard L (2020). P&ID-based symptom detection for automated energy performance diagnosis in HVAC systems. Automation in Construction, 119: 103344.

    Article  Google Scholar 

  • Taal A, Itard L, Zeiler W (2018). A reference architecture for the integration of automated energy performance fault diagnosis into HVAC systems. Energy and Buildings, 179: 144–155.

    Article  Google Scholar 

  • Taheri S, Jooshaki M, Moeini-Aghtaie M (2021). Long-term planning of integrated local energy systems using deep learning algorithms. International Journal of Electrical Power & Energy Systems, 129: 106855.

    Article  Google Scholar 

  • Tang J, Bao Y, Wang L, et al. (2013). A Bayesian network approach for human reliability analysis of power system. In: Proceedings of 2013 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC), Hong Kong, China.

  • Tanimoto J, Hagishima A (2005). State transition probability for the Markov Model dealing with on/off cooling schedule in dwellings. Energy and Buildings, 37: 181–187.

    Article  Google Scholar 

  • Tarlow D, Peterman A, Schwegler BR, et al. (2009). Automatically calibrating a probabilistic graohical model of building energy consumption. In: Proceedings of the 11th International IBPSA Building Simulation Conference, Glasgow, UK.

  • Tchangani AP, Noyes D (2006). Modeling dynamic reliability using dynamic Bayesian networks. Journal Européen Des Systèmes Automatisés, 40: 915–935.

    Article  Google Scholar 

  • Theristis M, Papazoglou IA (2014). Markovian reliability analysis of standalone photovoltaic systems incorporating repairs. IEEE Journal of Photovoltaics, 4: 414–422.

    Article  Google Scholar 

  • Torres-Toledano JG, Sucar LE (1998). Bayesian networks for reliability analysis of complex systems. In: Coelho H (ed), Progress in Artificial Intelligence—IBERAMIA 98. Berlin: Springer.

    Google Scholar 

  • Tsuji H, Kojoma M, Takahashi A, et al. (2008). Preference mining for future home energy consumption. In: Proceedings of 2008 IEEE International Conference on Systems, Man and Cybernetics, Singapore.

  • Ullah I, Ahmad R, Kim D (2018). A prediction mechanism of energy consumption in residential buildings using hidden Markov model. Energies, 11: 358.

    Article  Google Scholar 

  • Ulmeanu AP, Barbu VS, Tanasiev V, et al. (2017). Hidden Markov Models revealing the household thermal profiling from smart meter data. Energy and Buildings, 154: 127–140.

    Article  Google Scholar 

  • Veeramany A, Pandey MD (2011a). Reliability analysis of nuclear piping system using semi-Markov process model. Annals of Nuclear Energy, 38: 1133–1139.

    Article  Google Scholar 

  • Veeramany A, Pandey MD (2011b). Reliability analysis of nuclear component cooling water system using semi-Markov process model. Nuclear Engineering and Design, 241: 1799–1806.

    Article  Google Scholar 

  • Veeramany A, Pandey MD (2011c). Reliability analysis of digital feedwater regulating valve controller system using a semi-Markov process model. International Journal of Nuclear Energy Science and Technology, 6: 298.

    Article  Google Scholar 

  • Verbert K, Babuška R, de Schutter B (2017). Combining knowledge and historical data for system-level fault diagnosis of HVAC systems. Engineering Applications of Artificial Intelligence, 59: 260–273.

    Article  Google Scholar 

  • Wall J, Guo Y, Li J, et al. (2011). A dynamic machine learning-based technique for automated fault detection in HVAC systems. ASHRAE Transactions, 117(2): 449–456.

    Google Scholar 

  • Wang C, Yan D, Jiang Y (2011). A novel approach for building occupancy simulation. Building Simulation, 4: 149–167.

    Article  Google Scholar 

  • Wang Y, Han X, Ding Y (2012). Power system operational reliability equivalent modeling and analysis based on the Markov chain. In: Proceedings of 2012 IEEE International Conference on Power System Technology (POWERCON), Auckland, New Zealand.

  • Wang B, Wang Y, Chen X (2013a). Research on wind turbine generator dynamic reliability test system based on feature recognition. Research Journal of Applied Sciences, Engineering and Technology, 6: 3065–3071.

    Article  Google Scholar 

  • Wang J-J, Fu C, Yang K, et al. (2013b). Reliability and availability analysis of redundant BCHP (building cooling, heating and power) system. Energy, 61: 531–540.

    Article  Google Scholar 

  • Wang W, Lin Z, Chen J (2017a). Promoting energy efficiency of HVAC operation in large office spaces with a Wi-Fi probe enabled Markov time window occupancy detection approach. Energy Procedia, 143: 204–209.

    Article  Google Scholar 

  • Wang Z, Wang Z, He S, et al. (2017b). Fault detection and diagnosis of chillers using Bayesian network merged distance rejection and multi-source non-sensor information. Applied Energy, 188: 200–214.

    Article  Google Scholar 

  • Wang J, Sun Y, Zhai S, et al. (2018a). Stochastic modeling and stability analysis of wind power system based on Markov theory. In: Proceedings of the 37th Chinese Control Conference (CCC), Wuhan, China.

  • Wang Z, Wang L, Liang K, et al. (2018b). Enhanced chiller fault detection using Bayesian network and principal component analysis. Applied Thermal Engineering, 141: 898–905.

    Article  Google Scholar 

  • Wang Z, Wang Z, Gu X, et al. (2018c). Feature selection based on Bayesian network for chiller fault diagnosis from the perspective of field applications. Applied Thermal Engineering, 129: 674–683.

    Article  Google Scholar 

  • Wang X, Wang J, Shi D, et al. (2018d). A factorial hidden Markov model for energy disaggregation based on human behavior analysis. In: Proceedings of 2018 IEEE Power & Energy Society General Meeting (PESGM), Portland, OR, USA.

  • Wang J, Zhang Q, Yoon S, et al. (2019). Reliability and availability analysis of a hybrid cooling system with water-side economizer in data center. Building and Environment, 148: 405–416.

    Article  Google Scholar 

  • Wang Y, Kong Y, Tang X, et al. (2020a). Short-term industrial load forecasting based on ensemble hidden Markov model. IEEE Access, 8: 160858–160870.

    Article  Google Scholar 

  • Wang Z, Dong Y, Liu W, et al. (2020b). A novel fault diagnosis approach for chillers based on 1-D convolutional neural network and gated recurrent unit. Sensors, 20: 2458.

    Article  Google Scholar 

  • Wang Z, Wang L, Tan Y, et al. (2021a). Fault detection based on Bayesian network and missing data imputation for building energy systems. Applied Thermal Engineering, 182: 116051.

    Article  Google Scholar 

  • Wang Z, Wang L, Tan Y, et al. (2021b). Fault diagnosis using fused reference model and Bayesian network for building energy systems. Journal of Building Engineering, 34: 101957.

    Article  Google Scholar 

  • West SR, Guo Y, Wang XR, et al. (2011). Automated fault detection and diagnosis of HVAC subsystems using statistical machine learning. In: Proceedings of the 12th International IBPSA Building Simulation Conference, Sydney, Australia.

  • Widarsson B, Karlsson C, Dahlquist E (2004). Bayesian network for decision support on soot blowing superheaters in a biomass fuelled boiler. In: Proceedings of the 8th International Conference on Probabilistic Methods Applied to Power Systems, Ames, IA, USA.

  • Wolf S, Møller JK, Bitsch MA, et al. (2019). A Markov-Switching model for building occupant activity estimation. Energy and Buildings, 183: 672–683.

    Article  Google Scholar 

  • Wu G, Tong J, Zhang L, et al. (2018). Framework for fault diagnosis with multi-source sensor nodes in nuclear power plants based on a Bayesian network. Annals of Nuclear Energy, 122: 297–308.

    Article  Google Scholar 

  • Wu K, Wang H, Zou B (2019). Optimal sizing and placement of distributed generation using genetic algorithm based on Bayesian network. In: Proceedings of 2019 IEEE 3rd International Conference on Green Energy and Applications (ICGEA), Taiyuan, China.

  • Wu Z, Liu T, Li G, et al. (2020). A fault diagnosis system for power grid based on multi-source information fusion. In: Proceedings of the 5th International Conference on Energy Science and Applied Technology (ESAT 2019), Yichang City, China.

  • Xiao F, Zhao Y, Wen J, et al. (2014). Bayesian network based FDD strategy for variable air volume terminals. Automation in Construction, 41: 106–118.

    Article  Google Scholar 

  • Xu B, Li H, Pang W, et al. (2019). Bayesian network approach to fault diagnosis of a hydroelectric generation system. Energy Science & Engineering, 7: 1669–1677.

    Article  Google Scholar 

  • Xu C, Chen H (2020). Abnormal energy consumption detection for GSHP system based on ensemble deep learning and statistical modeling method. International Journal of Refrigeration, 114: 106–117.

    Article  Google Scholar 

  • Yan Y, Luh PB, Pattipati KR (2015a). A fault diagnosis method for HVAC Air Handling Units considering fault propagation. In: Proceedings of 2015 IEEE International Conference on Automation Science and Engineering (CASE), Gothenburg, Sweden.

  • Yan Y, Luh PB, Pattipati KR (2015b). Chiller plant fault diagnosis considering fault propagation. In: Proceedings of 2015 International Conference on Complex Systems Engineering (ICCSE), Storrs, CT, USA.

  • Yan Y, Luh PB, Pattipati KR (2017). Fault diagnosis of HVAC air-handling systems considering fault propagation impacts among components. IEEE Transactions on Automation Science and Engineering, 14: 705–717.

    Article  Google Scholar 

  • Yan Y (2018). Fault detection, diagnosis and prognosis in HVAC air handling systems. PhD Thesis, University of Connecticut, USA.

    Google Scholar 

  • Yan Y, Cai J, Li T, et al. (2021). Fault prognosis of HVAC air handling unit and its components using hidden-semi Markov model and statistical process control. Energy and Buildings, 240: 110875.

    Article  Google Scholar 

  • Yang X, Cui J (2015). Application of Bayesian network to reliability assessment of PV systems. In: Proceedings of International Conference on Renewable Power Generation (RPG 2015), Beijing, China.

  • Yang L, He M, Zhang J, et al. (2015). Support-vector-machine-enhanced Markov model for short-term wind power forecast. IEEE Transactions on Sustainable Energy, 6: 791–799.

    Article  Google Scholar 

  • Ye Y, Grossmann IE, Pinto JM, et al. (2019). Modeling for reliability optimization of system design and maintenance based on Markov chain theory. Computers & Chemical Engineering, 124: 381–404.

    Article  Google Scholar 

  • Youngblood GM, Cook DJ (2007). Data mining for hierarchical model creation. IEEE Transactions on Systems, Man, and Cybernetics, Part C, 37: 561–572.

    Article  Google Scholar 

  • Yu DC, Nguyen TC, Haddawy P (1999). Bayesian network model for reliability assessment of power systems. IEEE Transactions on Power Systems, 14: 426–432.

    Article  Google Scholar 

  • Yun P, Ren Y, Xue Y (2018). Energy-storage optimization strategy for reducing wind power fluctuation via Markov prediction and PSO method. Energies, 11: 3393.

    Article  Google Scholar 

  • Zeng Z, Fang Y-P, Zhai Q, et al. (2021). A Markov reward process-based framework for resilience analysis of multistate energy systems under the threat of extreme events. Reliability Engineering & System Safety, 209: 107443.

    Article  Google Scholar 

  • Zhai C (2019). A robust optimization approach for terminating the cascading failure of power systems. https://arxiv.org/abs/1907.13452. Accessed 12 May 2020.

  • Zhai S, Sun Y, Cui H, et al. (2020). Adjustable loads control and stochastic stability analysis for multi-energy generation system based on Markov model. Neural Computing and Applications, 32: 1517–1529.

    Article  Google Scholar 

  • Zhang Y, Qi W (2009). Interval forecasting for heating load using support vector regression and error correcting Markov chains. In: Proceedings of 2009 International Conference on Machine Learning and Cybernetics, Baoding, China.

  • Zhang X, Jiang H (2021). Automated optimal control in energy systems: the reinforcement learning approach. In: Jiang H, Zhang Y, Muljadi E (eds), New Technologies for Power System Operation and Analysis. London: Academic Press. pp. 275–318.

    Chapter  Google Scholar 

  • Zhao Y, Xiao F, Wang S (2013). An intelligent chiller fault detection and diagnosis methodology using Bayesian belief network. Energy and Buildings, 57: 278–288.

    Article  Google Scholar 

  • Zhao Y, Wen J, Wang S (2015). Diagnostic Bayesian networks for diagnosing air handling units faults—Part II: Faults in coils and sensors. Applied Thermal Engineering, 90: 145–157.

    Article  Google Scholar 

  • Zhao Y, Wen J, Xiao F, et al. (2017). Diagnostic Bayesian networks for diagnosing air handling units faults—part I: Faults in dampers, fans, filters and sensors. Applied Thermal Engineering, 111: 1272–1286.

    Article  Google Scholar 

  • Zhao B, Zhang P, Cheng Y (2019a). A semi-Markov model for the control of thermostatically controlled load. https://arXiv:1911.10307. Accessed May 12 2020.

  • Zhao Y, Li T, Zhang X, et al. (2019b). Artificial intelligence-based fault detection and diagnosis methods for building energy systems: Advantages, challenges and the future. Renewable and Sustainable Energy Reviews, 109: 85–101.

    Article  Google Scholar 

  • Zhao Y, Zhang C, Zhang Y, et al. (2020). A review of data mining technologies in building energy systems: Load prediction, pattern identification, fault detection and diagnosis. Energy and Built Environment, 1: 149–164.

    Article  Google Scholar 

  • Zhou Y, Shi Y (2016). Scenario-based stochastic model predictive control for wind energy conversion system. In: Proceedings of 2016 Chinese Control and Decision Conference (CCDC), Yinchuan, China.

  • Zia T, Bruckner D, Zaidi A (2011). A hidden Markov model based procedure for identifying household electric loads. In: Proceedings of the 37th Annual Conference of the IEEE Industrial Electronics Society (IECON 2011), Melbourne, Australia.

  • Zoha A, Gluhak A, Nati M, et al. (2013). Low-power appliance monitoring using factorial hidden Markov models. In: Proceedings of 2013 IEEE 8th International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), Melbourne, Australia.

Download references

Acknowledgements

This work was supported by the National Key Research and Development Program of China (No. 2018YFE0116300]; and the National Natural Science Foundation of China (No. 51978601).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yang Zhao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, T., Zhao, Y., Yan, K. et al. Probabilistic graphical models in energy systems: A review. Build. Simul. 15, 699–728 (2022). https://doi.org/10.1007/s12273-021-0849-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12273-021-0849-9

Keywords

Navigation