Skip to main content
SpringerLink
Log in

Applications of thermostatically controlled loads for demand response with the proliferation of variable renewable energy

  • Review Article
  • Published:
Frontiers in Energy Aims and scope Submit manuscript

Abstract

More flexibility is desirable with the proliferation of variable renewable resources for balancing supply and demand in power systems. Thermostatically controlled loads (TCLs) attract tremendous attentions because of their specific thermal inertia capability in demand response (DR) programs. To effectively manage numerous and distributed TCLs, intermediate coordinators, e.g., aggregators, as a bridge between end users and dispatch operators are required to model and control TCLs for serving the grid. Specifically, intermediate coordinators get the access to fundamental models and response modes of TCLs, make control strategies, and distribute control signals to TCLs according the requirements of dispatch operators. On the other hand, intermediate coordinators also provide dispatch models that characterize the external characteristics of TCLs to dispatch operators for scheduling different resources. In this paper, the bottom-up key technologies of TCLs in DR programs based on the current research have been reviewed and compared, including fundamental models, response modes, control strategies, dispatch models and dispatch strategies of TCLs, as well as challenges and opportunities in future work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Wu H, Shahidehpour M, Alabdulwahab A, et al. Demand response exchange in the stochastic day-ahead scheduling with variable renewable generation. IEEE Transactions on Sustainable Energy, 2015, 6(2): 516–525

    Article  Google Scholar 

  2. Sajjad I, Chicco G, Napoli R. Definitions of demand flexibility for aggregate residential loads. IEEE Transactions on Smart Grid, 2016, 7(6): 2633–2643

    Article  Google Scholar 

  3. Radaideh A, Vaidya U, Ajjarapu V. Sequential set-point control for heterogeneous thermostatically controlled loads through an extended Markov chain abstraction. IEEE Transactions on Smart Grid, 2019, 10(1): 116–127

    Article  Google Scholar 

  4. Kohlhepp P, Harb H, Wolisz H, et al. Large-scale grid integration of residential thermal energy storages as demand-side flexibility resource: a review of international field studies. Renewable & Sustainable Energy Reviews, 2019, 101: 527–547

    Article  Google Scholar 

  5. Xu X, Yan Z, Shahidehpour M, et al. Data-driven risk-averse two-stage optimal stochastic scheduling of energy and reserve with correlated wind power. IEEE Transactions on Sustainable Energy, 2020, 11(1): 436–147

    Article  Google Scholar 

  6. Erdinc O, Tascikaraoglu A, Paterakis N, et al. End-user comfort oriented day-ahead planning for responsive residential HVAC demand aggregation considering weather forecasts. IEEE Transactions on Smart Grid, 2017, 8(1): 362–372

    Article  Google Scholar 

  7. Kim Y J, Norford L K, Kirtley J L. Modeling and analysis of a variable speed heat pump for frequency regulation through direct load control. IEEE Transactions on Power Systems, 2015, 30(1): 397–408

    Article  Google Scholar 

  8. Song M, Gao C, Yan H, et al. Thermal battery modeling of inverter air conditioning for demand response. IEEE Transactions on Smart Grid, 2018, 9(6): 5522–5534

    Article  Google Scholar 

  9. Hao H, Wu D, Lian J, et al. Optimal coordination of building loads and energy storage for power grid and end user services. IEEE Transactions on Smart Grid, 2018, 9(5): 4335–4345

    Article  Google Scholar 

  10. Pahwa A, Brice C W. Modeling and system identification of residential air conditionning load. IEEE Transactions on Power Apparatus and Systems, 1985, 104(6): 1418–1425

    Article  Google Scholar 

  11. Song M, Gao C, Su W. Modeling and controlling of air-conditioning load for demand response applications. Automation of Electric Power Systems, 2016, 40(14): 158–167 (in Chinese)

    Google Scholar 

  12. Molina A, Gabaldon A, Fuentes J A, et al. Implementation and assessment of physically based electrical load models: application to direct load control residential programmes. IEE Proceedings. Generation, Transmission and Distribution, 2003, 150(1): 61–66

    Article  Google Scholar 

  13. Iacovella S, Ruelens F, Vingerhoets P, et al. Cluster control of heterogeneous thermostatically controlled loads using tracer devices. IEEE Transactions on Smart Grid, 2017, 8(2): 528–536

    Google Scholar 

  14. Hao H, Corbin C D, Kalsi K, et al. Transactive control of commercial buildings for demand response. IEEE Transactions on Power Systems, 2017, 32(1): 774–783

    Article  Google Scholar 

  15. Wu X, He J, Xu Y, et al. Hierarchical control of residential HVAC units for primary frequency regulation. IEEE Transactions on Smart Grid, 2018, 9(4): 3844–3856

    Article  Google Scholar 

  16. Song M, Gao C, Shahidehpour M, et al. Impact of uncertain parameters on TCL power capacity calculation via HDMR for generating power pulses. IEEE Transactions on Smart Grid, 2019, 10(3): 3112–3124

    Article  Google Scholar 

  17. Wai C H, Beaudin M, Zareipour H, et al. Cooling devices in demand response: a comparison of control methods. IEEE Transactions on Smart Grid, 2015, 6(1): 249–260

    Article  Google Scholar 

  18. Sinitsyn N A, Kundu S, Backhaus S. Safe protocols for generating power pulses with heterogeneous populations of thermostatically controlled loads. Energy Conversion and Management, 2013, 67: 297–308

    Article  Google Scholar 

  19. Lu N, Zhang Y. Design considerations of a centralized load controller using thermostatically controlled appliances for continuous regulation reserves. IEEE Transactions on Smart Grid, 2013, 4(2): 914–921

    Article  Google Scholar 

  20. Hu J, Cao J, Yong T, et al. Demand response load following of source and load systems. IEEE Transactions on Control Systems Technology, 2017, 25(5): 1586–1598

    Article  Google Scholar 

  21. Kim Y J, Fuentes E, Norford L K. Experimental study of grid frequency regulation ancillary service of a variable speed heat pump. IEEE Transactions on Power Systems, 2016, 31(4): 3090–3099

    Article  Google Scholar 

  22. Song M, Cao C W, Shahidehpour M, et al. Multi-time-scale modeling and parameter estimation of TCLs for smoothing out wind power generation variability. IEEE Transactions on Sustainable Energy, 2019, 10(1): 105–118

    Article  Google Scholar 

  23. Malhame R, Chong C Y. Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system. IEEE Transactions on Automatic Control, 1985, 30(9): 854–860

    Article  MATH  Google Scholar 

  24. Tindemans S H, Trovato V, Strbac G. Decentralized control of thermostatic loads for flexible demand response. IEEE Transactions on Control Systems Technology, 2015, 23(5): 1685–1700

    Article  Google Scholar 

  25. Bashash S, Fathy H K. Modeling and control of aggregate air conditioning loads for robust renewable power management. IEEE Transactions on Control Systems Technology, 2013, 21(4): 1318–1327

    Article  Google Scholar 

  26. Kamgarpour M, Ellen C, Soudjani S E Z, et al. Modeling options for demand side participation of thermostatically controlled loads. In: Bulk Power System Dynamics and Control- IX Optimization, Security and Control of the Emerging Power Grid (IREP), Rethymno, Greece, 2013

  27. Song M, Gao C, Shahidehpour M, et al. State space modeling and control of aggregated TCLs for regulation services in power grids. IEEE Transactions on Smart Grid, 2019, 10(4): 4095–4106

    Article  Google Scholar 

  28. Song M, Cao C, Yang J, et al. Novel aggregate control model of air conditioning loads for fast regulation service. IET Generation, Transmission & Distribution, 2017, 11(17): 4391–4401

    Article  Google Scholar 

  29. Liu M, Shi Y. Model predictive control of aggregated heterogeneous second-order thermostatically controlled loads for ancillary services. IEEE Transactions on Power Systems, 2016, 31(3): 1963–1971

    Article  Google Scholar 

  30. Hu J, Cao J, Chen M Z Q, et al. Load following of multiple heterogeneous TCL aggregators by centralized control. IEEE Transactions on Power Systems, 2017, 32(4): 3157–3167

    Article  Google Scholar 

  31. Liu M, Shi Y, Liu X. Distributed MPC of aggregated heterogeneous thermostatically controlled loads in smart grid. IEEE Transactions on Industrial Electronics, 2016, 63(2): 1120–1129

    Article  Google Scholar 

  32. Mathieu J L, Koch S, Callaway D S. State estimation and control of electric loads to manage real-time energy imbalance. IEEE Transactions on Power Systems, 2013, 28(1): 430–440

    Article  Google Scholar 

  33. Lu N. An evaluation of the HVAC load potential for providing load balancing service. IEEE Transactions on Smart Grid, 2012, 3(3): 1263–1270

    Article  Google Scholar 

  34. Esmaeil Zadeh Soudjani S, Abate A. Aggregation and control of populations of thermostatically controlled loads by formal abstractions. IEEE Transactions on Control Systems Technology, 2015, 23(3): 975–990

    Article  Google Scholar 

  35. Li C, Chen Y, Luo F, et al. Real-time decision making model for thermostatically controlled load aggregators by natural aggregation algorithm. In: IEEE International Conference on Energy Internet, Beijing, China, 2017

  36. Radaideh A, Vaidya U, Ajjarapu V. Sequential set-point control for heterogeneous thermostatically controlled loads through an extended markov chain abstraction. IEEE Transactions on Smart Grid, 2019, 10(1): 116–127

    Article  Google Scholar 

  37. Bhattarai B P, de Cerio Mendaza I D, Myers K S, et al. Optimum aggregation and control of spatially distributed flexible resources in smart grid. IEEE Transactions on Smart Grid, 2018, 9(5): 5311–5322

    Article  Google Scholar 

  38. Bashash S, Fathy H K. Modeling and control insights into demand-side energy management through setpoint control of thermostatic loads. In: Proceedings of the 2011 American Control Conference, San Francisco, CA, USA, 2011

  39. Hao H, Sanandaji B M, Poolla K, et al. Aggregate flexibility of thermostatically controlled loads. IEEE Transactions on Power Systems, 2015, 30(1): 189–198

    Article  Google Scholar 

  40. Ruelens F, Claessens B J, Vandael S, et al. Residential demand response applications using batch reinforcement learning. IEEE Transactions on Smart Grid, 2017, 8(5): 2149–2159

    Article  Google Scholar 

  41. Vrettos E, Ziras C, Andersson G. Fast and reliable primary frequency reserves from refrigerators with decentralized stochastic control. IEEE Transactions on Power Systems, 2017, 32(4): 2924–2941

    Article  Google Scholar 

  42. Molina-Garcia A, Bouffard F, Kirschen D S. Decentralized demand-side contribution to primary frequency control. IEEE Transactions on Power Systems, 2011, 26(1): 411–419

    Article  Google Scholar 

  43. Guo D, Zhang W, Yan G, et al. Decentralized control of aggregated loads for demand response. In: 2013 American Control Conference (ACC), Washington D.C., USA, 2013

  44. Meng K, Wang D, Dong Z Y, et al. Distributed control of thermostatically controlled loads in distribution network with high penetration of solar PV. CSEE Journal of Power and Energy Systems, 2017, 3(1): 53–62

    Article  Google Scholar 

  45. Saker N, Petit M, Vannier J C, et al. Demand side management of electrical water heaters and evaluation of the cold load pick-up characteristics. In: 2011 IEEE Trondheim PowerTech, Trondheim, Norway, 2011

  46. Perfumo C, Braslavsky J, Ward J K. A sensitivity analysis of the dynamics of a population of thermostatically-controlled loads. In: 2013 Australasian Universities Power Engineering Conference (AUPEC), Hobart, TAS, Australia, 2013

  47. Gilvanejad M, Askarian Abyaneh H, Mazlumi K. Estimation of cold-load pickup occurrence rate in distribution systems. IEEE Transactions on Power Delivery, 2013, 28(2): 1138–1147

    Article  Google Scholar 

  48. Wang D, Lu N, Miao W, et al. Performance evaluation of controlling thermostatically controlled appliances as virtual generators using comfort-constrained state-queueing models. IET Generation Transmission & Distribution, 2014, 8(4): 591–599

    Article  Google Scholar 

  49. Mahdavi N, Braslavsky J H, Perfumo C. Mapping the effect of ambient temperature on the power demand of populations of air conditioners. IEEE Transactions on Smart Grid, 2018, 9(3): 1540–1550

    Article  Google Scholar 

  50. Ruiz N, Cobelo I, Oyarzabal J. A direct load control model for virtual power plant management. IEEE Transactions on Power Systems, 2009, 24(2): 959–966

    Article  Google Scholar 

  51. Trovato V, Tindemans S H, Strbac G. The leaky storage model for optimal multi-service allocation of thermostatic loads. IET Generation, Transmission & Distribution, 2016, 10(3): 585–593

    Article  Google Scholar 

  52. Trovato V, Tindemans S H, Strbac G. Security constrained economic dispatch with flexible thermostatically controlled loads. In: IEEE PES Innovative Smart Grid Technologies, Istanbul, Turkey, 2014

  53. Song M, Gao C, Yang J, et al. Energy storage modeling of inverter air conditioning for output optimizing of wind generation in the electricity market. CSEE Journal of Power & Energy Systems, 2018, 4(3): 305–315

    Article  Google Scholar 

  54. Luo F, Dong Z Y, Meng K, et al. An operational planning framework for large-scale thermostatically controlled load dispatch. IEEE Transactions on Industrial Informatics, 2017, 13(1): 217–227

    Article  Google Scholar 

  55. Zhao L, Zhang W, Hao H, et al. A geometric approach to aggregate flexibility modeling of thermostatically controlled loads. IEEE Transactions on Power Systems, 2017, 32(6): 4721–4731

    Article  Google Scholar 

  56. Mathieu J L, Kamgarpour M, Lygeros J, et al. Arbitraging intraday wholesale energy market prices with aggregations of thermostatic loads. IEEE Transactions on Power Systems, 2015, 30(2): 763–772

    Article  Google Scholar 

  57. Kurucz C N, Brandt D, Sim S. A linear programming model for reducing system peak through customer load control programs. IEEE Transactions on Power Systems, 1996, 11(4): 1817–1824

    Article  Google Scholar 

  58. Yang H T, Huang K Y. Direct load control using fuzzy dynamic programming. IEE Proceedings-Generation, Transmission and Distribution, 1999, 146(3): 294–300

    Article  Google Scholar 

  59. Lee T F, Cho M Y, Hsiao Y C, et al. Optimization and implementation of a load control scheduler using relaxed dynamic programming for large air conditioner loads. IEEE Transactions on Power Systems, 2008, 23(2): 691–702

    Article  Google Scholar 

  60. Chu C M, Jong T L, Huang Y W. Mitigating DLC constraints of air-conditioning loads using a group-DLC method. In: 2007 IEEE Power Engineering Society General Meeting, Tampa, FL, USA, 2007

  61. Wen Y, Li W, Huang G, et al. Frequency dynamics constrained unit commitment with battery energy storage. IEEE Transactions on Power Systems, 2016, 31(6): 5115–5125

    Article  MathSciNet  Google Scholar 

  62. Ning Y, Li X, Ma X, et al. Optimal schedule strategy of battery energy storage systems for peak load shifting based on interior point method. In: 2016 12th World Congress on Intelligent Control and Automation (WCICA), Guilin, China, 2016

  63. Li N, Uckun C, Constantinescu E M, et al. Flexible operation of batteries in power system scheduling with renewable energy. IEEE Transactions on Sustainable Energy, 2016, 7(2): 685–696

    Article  Google Scholar 

  64. Lujano-Rojas J M, Dufo-Lopez R, Bernal-Agustin J L, et al. Optimizing daily operation of battery energy storage systems under real-time pricing schemes. IEEE Transactions on Smart Grid, 2017, 8(1): 316–330

    Article  Google Scholar 

  65. Hutchison G, Giaouris D, Gadoue S, et al. Non-invasive identification of turbo-generator parameters from actual transient network data. IET-Generation Transmission & Distribution, 2015, 9(11): 1129–1136

    Article  Google Scholar 

  66. Mahdavi N, Braslavsky J H, Seron M M, et al. Model predictive control of distributed air-conditioning loads to compensate fluctuations in solar powe. IEEE Transactions on Smart Grid, 2017, 8(6): 3055–3065

    Article  Google Scholar 

  67. Mathieu J L, Callaway D S. State estimation and control of heterogeneous thermostatically controlled loads for load following. In: 2012 45th Hawaii International Conference on System Sciences, Maui, HI, USA, 2012

  68. Vanouni M, Lu N. A reward allocation mechanism for thermostatically controlled loads participating in intra-hour ancillary services. IEEE Transactions on Smart Grid, 2018, 9(5): 4209–4219

    Article  Google Scholar 

  69. Renani Y K, Ehsan M, Shahidehpour M. Optimal transactive market operations with distribution system operators. IEEE Transactions on Smart Grid, 2018, 9(6): 6692–6701

    Article  Google Scholar 

  70. Gregoratti D, Matamoros J. Distributed energy trading: the multiple-microgrid case. Industrial Electronics IEEE Transactions on Industrial Electronics, 2015, 62(4): 2551–2559

    Article  Google Scholar 

  71. Liu Z, Wu Q, Shahidehpour M, et al. Transactive real-time electric vehicle charging management for commercial buildings with PV on-site generation. IEEE Transactions on Smart Grid, 2019, 10(5): 4939–4950

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (Grant No. 52007030), the US National Science Foundation (Grant No. ECCS-1552073), and awards of the US Department of Energy (DE-EE0007998 and DE-EE0009028).

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL, 32816, USA

    Meng Song & Wei Sun

Authors
  1. Meng Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Sun.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Song, M., Sun, W. Applications of thermostatically controlled loads for demand response with the proliferation of variable renewable energy. Front. Energy 16, 64–73 (2022). https://doi.org/10.1007/s11708-021-0732-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11708-021-0732-5

Keywords

Search

Navigation