Skip to main content
SpringerLink
Log in

Big Data and Deep Learning Analytics for Robust PV Power Forecast in Smart Grids

  • Chapter
  • First Online:
Advanced Technologies for Solar Photovoltaics Energy Systems

Part of the book series: Green Energy and Technology ((GREEN))

  • 1029 Accesses

Abstract

Photovoltaic (PV) power generation is intermittent and volatile in nature, rendering its large-scale deployment a challenge for the smart electricity grid’s operation safety, stability, and economic efficiency. Ultra-fast and accurate prediction of PV power helps effectively adjusting the dispatch schedules during different operating states the power grid may undergo. This chapter proposes a deep learning-based PV power forecasting approach, the so-called Chaotic-LSTM, which ensembles the principles of the long short-term memory (LSTM) neural network and chaos theory. The LSTM neural network is used to construct a nonlinear mapping between input and output variables, while the phase space reconstruction technology in chaos theory is used to analyze the nonlinear time series of PV power generation, and extract the intrinsic dynamic characteristics of the PV arrays. Finally, a correlation analysis is applied to extract the external factors influencing the PV arrays. The effectiveness of the Chaotic-LSTM technology is demonstrated by comparing with three state-of-the-art neural network models: back-propagation, radial basis function, and simple recursive Elman neural networks. The accuracy of the proposed method was assessed using four different forecasting time horizons (i.e., one-hour, four-hour, one-day, and four-day-ahead) and three evaluation metrics. Additional tests are conducted with seven levels of signal-noise ratio to provide a measure of model robustness and effectiveness. Numerical results will demonstrate that the proposed Chaotic-LSTM method can significantly improve the prediction accuracy of the short-term PV power generation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Eftekharnejad S, Heydt GT, Vittal V (2015) Optimal generation dispatch with high penetration of photovoltaic generation. IEEE Transactions on Sustainable Energy 6(3):1013–1020

    Google Scholar 

  2. Asrari A, Wu TX, Ramos B (2017) A hybrid algorithm for short-term solar power prediction—sunshine state case study. IEEE Trans Sustain Energy 8(2):582–591

    Google Scholar 

  3. Akhter MN, Mekhilef S, Mokhlis H, Mohamed Shah N (2019) Review on forecasting of photovoltaic power generation based on machine learning and metaheuristic techniques. IET Renew Power Generat 13(7):1009–1023

    Google Scholar 

  4. Nespoli A, Ogliari E, Leva S, Massi Pavan A, Mellit A, Lughi V, Dolara A (2019) Day-ahead photovoltaic forecasting: a comparison of the most effective techniques. Energies 12(9):1621

    Google Scholar 

  5. Yadav HK, Pal Y, Tripathi MM (2015) Photovoltaic power forecasting methods in smart power grid. In: 2015 annual IEEE India conference (INDICON), pp 1–6. IEEE

    Google Scholar 

  6. Wan C, Zhao J, Song Y, Xu Z, Lin J, Hu Z (2015) Photovoltaic and solar power forecasting for smart grid energy management. CSEE J Power Energy Syst 1(4):38–46

    Google Scholar 

  7. Ceci M, Corizzo R, Fumarola F, Malerba D, Rashkovska A (2017) Predictive modeling of PV energy production: how to set up the learning task for a better prediction? IEEE Trans Industr Inf 13(3):956–966

    Google Scholar 

  8. Mondol JD, Yohanis YG, Norton B (2007) Comparison of measured and predicted long term performance of grid a connected photovoltaic system. Energy Convers Manage 48(4):1065–1080

    Google Scholar 

  9. Eltamaly AM (2018) Performance of MPPT techniques of photovoltaic systems under normal and partial shading conditions. In: Advances in renewable energies and power technologies. Elsevier, pp 115–161

    Google Scholar 

  10. Singh B, Pozo D (2019) A guide to solar power forecasting using ARMA models. In: 2019 IEEE PES innovative smart grid technologies Europe (ISGT-Europe), pp 1–4

    Google Scholar 

  11. Chu Y, Urquhart B, Gohari SMI, Pedro HTC, Kleissl J, Coimbra CFM (2015) Short-term reforecasting of power output from a 48 MWe solar PV plant. Solar Energy 112:68–77

    Google Scholar 

  12. Payman D, Bei Z, Tatjana D, Mladen K (2018) Predictive risk analytics for weather-resilient operation of electric power systems. IEEE Trans Sustain Energy 10(1):3–15

    Google Scholar 

  13. Zhang B, Dehghanian P, Kezunovic M (2016) Spatial-temporal solar power forecast through use of Gaussian conditional random fields. In: 2016 IEEE power and energy society general meeting (PESGM), pp 1–5. IEEE

    Google Scholar 

  14. Sheng H, Xiao J, Cheng Y, Ni Q, Wang S (2018) Short-term solar power forecasting based on weighted gaussian process regression. IEEE Trans Indus Electron 65(1):300–308

    Google Scholar 

  15. Chong L, Rong J, Wenqiang D, Weicheng S, Xiping M (2016) Short-term PV generation forecasting based on weather type clustering and improved GPR model. In: 2016 China international conference on electricity distribution (CICED), pp 1–5, 2016

    Google Scholar 

  16. Kanwal S, Khan B, Ali SM, Mehmood CA, Rauf MQ (2018) Support vector machine and gaussian process regression based modeling for photovoltaic power prediction. In: 2018 international conference on frontiers of information and technology, pp 117–122

    Google Scholar 

  17. Zhou L, Wu H, Xu T, Mei F, Li Y, Yuan X, Liu H (2017) Ultra-short term hybrid power forecasting model for photovoltaic power station with meteorological monitoring data. In: 2017 32nd youth academic annual conference of chinese association of automation (YAC), pp 452–456

    Google Scholar 

  18. Vagropoulos SI, Chouliaras GI, Kardakos EG, Simoglou CK, Bakirtzis AG (2016) Comparison of SARIMAX, SARIMA, modified SARIMA and ANN-based models for short-term PV generation forecasting. In: 2016 IEEE international energy conference (ENERGYCON), pp 1–6

    Google Scholar 

  19. Kushwaha V, Pindoriya NM (2017) Very short-term solar PV generation forecast using SARIMA model: a case study. In: 2017 7th international conference on power systems (ICPS), pp 430–435

    Google Scholar 

  20. Laopaiboon T, Ongsakul W, Panyainkaew P, Sasidharan N (2018) Hour-ahead solar forecasting program using back propagation artificial neural network. In: 2018 international conference and utility exhibition on green energy for sustainable development (ICUE), pp 1–7

    Google Scholar 

  21. Khan I, Zhu H, Khan D, Panjwani MK (2017) Photovoltaic power prediction by cascade forward artificial neural network. In: 2017 international conference on information and communication technologies (ICICT), pp 145–149

    Google Scholar 

  22. Kou J, Liu J, Li Q, Fang W, Chen Z, Liu L, Guan T (2013) Photovoltaic power forecasting based on artificial neural network and meteorological data. In: 2013 IEEE international conference of IEEE region 10 (TENCON 2013), pp 1–4

    Google Scholar 

  23. Lu HJ, Chen HT, Chang GW (2018) Multi-day-ahead PV power output for improved radial basis function neural network. In: 2018 IEEE innovative smart grid technologies—Asia (ISGT Asia), pp 957–961

    Google Scholar 

  24. Park N, Ahn HK (2019) Multi-layer rnn-based short-term photovoltaic power forecasting using IoT dataset. In: 2019 AEIT international annual conference (AEIT), pp 1–5

    Google Scholar 

  25. Wilms H, Cupelli M, Monti A (2018) On the necessity of exogenous variables for load, PV and wind day-ahead forecasts using recurrent neural networks. In: 2018 IEEE electrical power and energy conference (EPEC), pp 1–6

    Google Scholar 

  26. Khan I, Zhu H, Yao J, Khan D (2017) Photovoltaic power forecasting based on Elman neural network software engineering method. In: 2017 8th IEEE international conference on software engineering and service science (ICSESS), pp 747–750

    Google Scholar 

  27. Ben Ammar R, Oualha A (2017) Photovoltaic power forecasting using recurrent neural networks. In: 2017 14th international multi-conference on systems, signals devices (SSD), pp 537–544

    Google Scholar 

  28. He H, Hu R, Zhang Y, Zhang Y, Jiao R (2018) A power forecasting approach for PV plant based on irradiance index and LSTM. In: 2018 37th Chinese control conference (CCC), pp 9404–9409

    Google Scholar 

  29. Mohamed A-N, Karar M (2019) Accurate photovoltaic power forecasting models using deep LSTM-RNN. Neural Comput Appl 31(7):2727–2740

    Google Scholar 

  30. Huang C-J, Kuo P-H (2019) Multiple-input deep convolutional neural network model for short-term photovoltaic power forecasting. IEEE Access 7:74822–74834

    Google Scholar 

  31. Jang HS, Bae KY, Park H, Sung DK (2016) Solar power prediction based on satellite images and support vector machine. IEEE Trans Sustain Energy 7(3):1255–1263

    Article  Google Scholar 

  32. Shi J, Lee W-J, Liu Y, Yang Y, Wang P (2011) Forecasting power output of photovoltaic system based on weather classification and support vector machine. In: 2011 IEEE industry applications society annual meeting, pp 1–6

    Google Scholar 

  33. Qijun S, Fen L, Jialin Q, Jinbin Z, Zhenghong C (2016) Photovoltaic power prediction based on principal component analysis and support vector machine. In: 2016 IEEE innovative smart grid technologies—Asia (ISGT-Asia), pp 815–820

    Google Scholar 

  34. Sun Y, Wang F, Mi Z, Sun H, Liu C, Wang B, Lu J, Zhen Z, Li K (2015) Short-term prediction model of module temperature for photovoltaic power forecasting based on support vector machine. In: International conference on renewable power generation (RPG 2015), pp 1–6

    Google Scholar 

  35. Monfared M, Fazeli M, Lewis R, Searle J (2019) Fuzzy predictor with additive learning for very short-term PV power generation. IEEE Access 7:91183–91192

    Article  Google Scholar 

  36. Liu F, Li R, Li Y, Yan R, Saha T (2017) Takagi-Sugeno fuzzy model-based approach considering multiple weather factors for the photovoltaic power short-term forecasting. IET Renew Power Gener 11(10):1281–1287

    Article  Google Scholar 

  37. Yang H, Huang C, Huang Y, Pai Y (2014) A weather-based hybrid method for 1-day ahead hourly forecasting of PV power output. IEEE Trans Sustain Energy 5(3):917–926

    Google Scholar 

  38. Yang Z, Cao Y, Xiu J (2014) Power generation forecasting model for photovoltaic array based on generic algorithm and BP neural network. In: 2014 IEEE 3rd international conference on cloud computing and intelligence systems, pp 380–383

    Google Scholar 

  39. Caputo D, Grimaccia F, Mussetta M, Zich RE (2010) Photovoltaic plants predictive model by means of ANN trained by a hybrid evolutionary algorithm. In: The 2010 international joint conference on neural networks (IJCNN), pp 1–6

    Google Scholar 

  40. Meng X, Xu A, Zhao W, Wang H, Li C, Wang H (2018) A new PV generation power prediction model based on GA-BP neural network with artificial classification of history day. In: 2018 international conference on power system technology (POWERCON), pp 1012–1017

    Google Scholar 

  41. Zhong Z, Tan J, Zhang T, Zhu L (2014) PV power short-term forecasting model based on the data gathered from monitoring network. China Commun 11(14):61–69

    Article  Google Scholar 

  42. Niu D, Wang K, Sun L, Wu J, Xu X (2020) Short-term photovoltaic power generation forecasting based on random forest feature selection and CEEMD: a case study. Appl Soft Comput 106389

    Google Scholar 

  43. Huang C, Chen S, Yang S, Kuo C (2015) One-day-ahead hourly forecasting for photovoltaic power generation using an intelligent method with weather-based forecasting models. IET Gener Trans Dist 9(14):1874–1882

    Google Scholar 

  44. Yan C, Xiu J, Liu C, Yang Z (2014) A high concentrated photovoltaic output power predictive model based on fuzzy clustering and RBF neural network. In: 2014 IEEE 3rd international conference on cloud computing and intelligence systems, pp 384–388

    Google Scholar 

  45. Panapakidis IP, Christoforidis GC (2017) A hybrid ANN/GA/ANFIS model for very short-term PV power forecasting. In: 2017 11th IEEE international conference on compatibility, power electronics and power engineering, pp 412–417

    Google Scholar 

  46. Yadav HK, Pal Y, Tripathi MM (2018) Short-term PV power forecasting using adaptive neuro-fuzzy inference system. In: 2018 IEEE 8th power India international conference (PIICON), pp 1–6

    Google Scholar 

  47. Semero YK, Zhang J, Zheng D (2018) PV power forecasting using an integrated GA-PSO-ANFIS approach and gaussian process regression based feature selection strategy. CSEE J Power Energy Syst 4(2):210–218

    Google Scholar 

  48. Pengtao L, Kaile Z, Lu X, Shanlin Y (2020) A hybrid deep learning model for short-term PV power forecasting. Appl Energy 259:114216

    Google Scholar 

  49. Biaowei C, Peijie L, Yaohai L, Yunfeng L, Shuying C, Zhicong C, Wu L (2020) Hour-ahead photovoltaic power forecast using a hybrid GRA-LSTM model based on multivariate meteorological factors and historical power datasets. E&ES 431(1):012059

    Google Scholar 

  50. Hangxia Z, Yujin Z, Lingfan Y, Qian L, Ke Y, Du Y (2019) Short-term photovoltaic power forecasting based on long short term memory neural network and attention mechanism. IEEE Access 7:78063–78074

    Google Scholar 

  51. Chang GW, Lu H-J (2018) Integrating gray data preprocessor and deep belief network for day-ahead PV power output forecast. IEEE Trans Sustain Energy 11(1):185–194

    Google Scholar 

  52. Happy A, Hong-Tzer Y, Chao-Ming H (2020) Short-term photovoltaic power forecasting using a convolutional neural network–salp swarm algorithm. Energies 13(8):1879

    Google Scholar 

  53. Liu Z-F, Li L-L, Tseng M-L, Lim MK (2020) Prediction short-term photovoltaic power using improved chicken swarm optimizer-extreme learning machine model. J Cleaner Product 248:119272

    Google Scholar 

  54. de Jesús DAR, Mandal P, Chakraborty S, Senjyu T (2019) Solar PV power prediction using a new approach based on hybrid deep neural network. In: 2019 IEEE power energy society general meeting (PESGM), pp 1–5

    Google Scholar 

  55. Zang H, Cheng L, Ding T, Cheung KW, Liang Z, Wei Z, Sun G (2018) Hybrid method for short-term photovoltaic power forecasting based on deep convolutional neural network. IET Gener Trans Dist 12(20):4557–4567

    Google Scholar 

  56. Takens F (1981) Detecting strange attractors in turbulence. In: Dynamical systems and turbulence, Warwick 1980. Springer, pp 366–381

    Google Scholar 

  57. Froehling H, Crutchfield JP, Farmer D, Packard NH, Shaw R (1981) On determining the dimension of chaotic flows. Physica D Nonlinear Phenomena 3(3):605–617

    Google Scholar 

  58. James T (1990) Estimating fractal dimension. JOSA A 7(6):1055–1073

    Google Scholar 

  59. Fraser AM (1989) Information and entropy in strange attractors. IEEE Trans Inf Theory 35(2):245–262

    Google Scholar 

  60. Fraser AM, Swinney HL (1986) Independent coordinates for strange attractors from mutual information. Phys Rev A 33(2):1134

    Article  MathSciNet  Google Scholar 

  61. Grassberger P, Procaccia I (2004) Measuring the strangeness of strange attractors. In The Theory of Chaotic Attractors, pages 170–189. Springer, 2004

    Google Scholar 

  62. Abarbanel HDI, Kennel MB (1993) Local false nearest neighbors and dynamical dimensions from observed chaotic data. Physical Review E 47(5):3057

    Google Scholar 

  63. Tang L, Liang J (2011) CC method to phase space reconstruction based on multivariate time series. In: 2011 2nd international conference on intelligent control and information processing, vol 1, pp 438–441. IEEE

    Google Scholar 

  64. Kim HS, Eykholt R, Salas JD (1998) Delay time window and plateau onset of the correlation dimension for small data sets. Phys Rev E 58(5):5676

    Article  Google Scholar 

  65. Dimitris K (1996) State space reconstruction parameters in the analysis of chaotic time series—the role of the time window length. Physica D 95(1):13–28

    Google Scholar 

  66. Kim HS, Eykholt R, Salas JD (1999) Nonlinear dynamics, delay times, and embedding windows. Physica D Nonlinear Phenomena 127(1–2):48–60

    Google Scholar 

  67. Broock WA, Alexandre Scheinkman J, Davis Dechert W, LeBaron B (1996) A test for independence based on the correlation dimension. Econometr Rev 15(3):197–235

    Google Scholar 

  68. Rosenstein MT, Collins JJ, De Luca CJ (1993) A practical method for calculating largest Lyapunov exponents from small data sets. Physica D Nonlinear Phenomena 65(1–2):117–134

    Google Scholar 

  69. Yona A, Senjyu T, Funabashi T (2007) Application of recurrent neural network to short-term-ahead generating power forecasting for photovoltaic system. In: 2007 IEEE power engineering society general meeting, pp 1–6

    Google Scholar 

  70. Yu Y, Cao J, Zhu J (2019) An LSTM short-term solar irradiance forecasting under complicated weather conditions. IEEE Access 7:145651–145666

    Article  Google Scholar 

  71. Alex G, Marcus L, Santiago F, Roman B, Horst B, Jürgen S (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868

    Google Scholar 

  72. Shinde BT (2020) Real-time stability surveillance in power systems: a deep learning approach. Master’s thesis, George Washington University

    Google Scholar 

  73. Zhang S, Wang Y, Liu M, Bao Z (2017) Data-based line trip fault prediction in power systems using LSTM networks and SVM. IEEE Access 6:7675–7686

    Google Scholar 

  74. Malhotra P, Vig L, Shroff G, Agarwal P (2015) Long short term memory networks for anomaly detection in time series. In: Proceedings, vol 89. Presses universitaires de Louvain

    Google Scholar 

  75. Abayomi-Alli A, Odusami MO, Abayomi-Alli O, Misra S, Ibeh GF (2019) Long short-term memory model for time series prediction and forecast of solar radiation and other weather parameters. In: 2019 19th international conference on computational science and its applications (ICCSA), pp 82–92

    Google Scholar 

  76. Yulara Solar System data download http://dkasolarcentre.com.au/download?location=yulara. Accessed 14 Feb 2020

  77. Alice-springs Solar System data download http://dkasolarcentre.com.au/download?location=alice-springs. Accessed 14 Feb 2020

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical and Electrical Engineering, Shenzhen Polytechnic, Shenzhen, 518055, China

    Yunhui Zhang

  2. Department of Electrical and Computer Engineering, George Washington University, Washington, DC, 20052, USA

    Shiyuan Wang & Payman Dehghanian

Authors
  1. Yunhui Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shiyuan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Payman Dehghanian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Payman Dehghanian .

Editor information

Editors and Affiliations

  1. ENSA, Sidi Mohamed Ben Abdellah University, Fes, Morocco

    Saad Motahhir

  2. Electrical Engineering Department, Mansoura University, Mansoura, Egypt

    Ali M. Eltamaly

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Zhang, Y., Wang, S., Dehghanian, P. (2021). Big Data and Deep Learning Analytics for Robust PV Power Forecast in Smart Grids. In: Motahhir, S., Eltamaly, A.M. (eds) Advanced Technologies for Solar Photovoltaics Energy Systems. Green Energy and Technology. Springer, Cham. https://doi.org/10.1007/978-3-030-64565-6_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-64565-6_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-64564-9

  • Online ISBN: 978-3-030-64565-6

  • eBook Packages: EnergyEnergy (R0)

Publish with us

Policies and ethics

Search

Navigation