Big Data Analytics for Electricity Price Forecast

  • Ashkan Yousefi
  • Omid Ameri SianakiEmail author
  • Tony Jan
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 927)


Electricity Price forecast is a major task in smart grid operation. There is a massive amount of data flowing in the power system including the data collection by control systems, sensors, etc. In addition, there are many data points which are not captured and processed by the energy market operators and electricity network operators including gross domestic product, the price of fuel, government policy and incentives for renewable and green energy sectors as well as impacts on new technologies such as battery technology advancement and electric vehicles. In this study, data points from 2001 to 2017 were collected and 78 data points are considered for analyses to select the highly-correlated features which could potentially affect the electricity price. In the first step, a comprehensive correlation method using Pearson Correlation Coefficient is applied to find the points which are correlated with the electricity price. In the next step, the correlated data is fed to the machine learning algorithm for price forecast. The algorithm results were tested in the historical data in California and the outcomes were satisfactory for the three years forecast. The combination of featured selection and machine learning is giving superior outcomes than the traditional methods.


  1. 1.
    Agrawal, R.K., Muchahary, F., Tripathi, M.M.: Long term load forecasting with hourly predictions based on long-short-term-memory networks. In: 2018 IEEE Texas Power and Energy Conference (TPEC), pp. 1–6 (2018)Google Scholar
  2. 2.
    Helseth, A., Haugen, M., Jaehnert, S., Mo, B., Farahmand, H., Naversen, C.: Multi-market price forecasting in hydro-thermal power systems. In: 15th International Conference on the European Energy Market (EEM), pp. 1–5 (2018)Google Scholar
  3. 3.
    Jiang, L. Hu, G.: Day-ahead price forecasting for electricity market using long-short term memory recurrent neural network. In: 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 949–954 (2018)Google Scholar
  4. 4.
    Varshney, H., Sharma, A., Kumar, R.: A hybrid approach to price forecasting incorporating exogenous variables for a day ahead electricity Market. In: 2016 IEEE 1st International Conference on Power Electronics, Intelligent Control and Energy Systems (ICPEICES), pp. 1–6 (2016)Google Scholar
  5. 5.
    Rafiei, M., Niknam, T., Khooban, M.: Probabilistic forecasting of hourly electricity price by generalization of ELM for usage in improved wavelet neural network. IEEE Trans. Industr. Inf. 13(1), 71–79 (2017)CrossRefGoogle Scholar
  6. 6.
    Kobayashi, K.: Optimal real-time pricing of electricity based on switched markov chain models and welfare maximization. In: IEEE 4th International Conference on Cyber-Physical Systems, Networks, and Applications (CPSNA), pp. 35–39 (2016)Google Scholar
  7. 7.
    Mosbah, H., El-hawary, M.: Hourly electricity price forecasting for the next month using multilayer neural network. Can. J. Electr. Comput. Eng. 39(4), 283–291 (2016)CrossRefGoogle Scholar
  8. 8.
    Ozozen, A., Kayakutlu, G., Ketterer, M., Kayalica, O.: A combined seasonal ARIMA and ANN model for improved results in electricity spot price forecasting: Case study in Turkey. In: 2016 Portland International Conference on Management of Engineering and Technology (PICMET), pp. 2681–2690 (2016)Google Scholar
  9. 9.
    Zhi-Wei, Q.: Mutivariable mutual information based feature selection for electricity price forecasting. In: 2012 International Conference on Machine Learning and Cybernetics, vol. 1, pp. 168–173 (2012)Google Scholar
  10. 10.
    Abedinia, O., Amjady, N., Zareipour, H.: A new feature selection technique for load and price forecast of electrical power systems. IEEE Trans. Power Syst. 32(1), 62–74 (2017)CrossRefGoogle Scholar
  11. 11.
    Hehui, Q., Zhiwei, Q.: Feature selection using C4.5 algorithm for electricity price prediction. In: 2014 International Conference on Machine Learning and Cybernetics, vol. 1, pp. 175–180 (2014)Google Scholar
  12. 12.
    Wang, K., et al.: A survey on energy internet: architecture, approach, and emerging technologies. IEEE Syst. J. 12(3), 2403–2416 (2018)CrossRefGoogle Scholar
  13. 13.
    Jiang, H., Wang, K., Wang, Y., Gao, M., Zhang, Y.: Energy big data: a survey. IEEE Access 4, 3844–3861 (2016)CrossRefGoogle Scholar
  14. 14.
    California Government Open Data Portal (2017).
  15. 15.
    Python Data Analysis Library (2017)Google Scholar
  16. 16.
    Brownlee, J.: Autoregression Models for Time Series Forecasting With Python – Machine Learning Mastery (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Victoria University SydneySydneyAustralia
  2. 2.Melbourne Institute of TechnologyMelbourneAustralia

Personalised recommendations