Big Data Analysis - An Approach to Improve Power System Data Analysis and Load Research

  • Sandhya S. Shankarlinga
  • K. T. Veeramanju
  • R. Nagaraja
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 801)


The introduction of various intelligent electronic devices (IEDs), sensors and other network controls for smarter operation of the electric grid has resulted in massive data explosion. With an exponential growth in volume and diversity of data sources, developing an effective data management system is challenging and also imperative. This paper explores the current state of data analysis and associated problems in power sector with reference to Indian scenario and narrates how Big Data Analysis and statistics analysis tools could be adapted to improve power system data analysis and load research by acting on the deluge of big data and leveraging various statistical algorithms. We leverage Apache Hadoop BigData ecosystem for large volume of load research data and ‘R’ for pattern recognition and load forecasting. The paper also suggests an approachable roadmap to the power utility for sub-station data analysis embracing identification of peaks and valleys in sub-station demand, detection of anomalies in the data and also conducting short term load forecasting of the sub-station peak demand using these technologies.


Big data Power system data analysis Load research Short term load forecasting Seasonal ARIMA 



The first author gratefully acknowledges the guidance and motivation of Dr. K.T. Veeramanju, Professor & HOD E&E, Sri Jayachamarajendra College of Engineering, Mysuru, India, Dr. R. Nagaraja, Managing Director, Power Research & Development Consultants Pvt. Ltd., Bengaluru, India and Mr. Ganapathi Devappa, Consultant, Power Research & Development Consultants Pvt. Ltd., Bengaluru, India for her work.


  1. 1.
    Kezunovic, M., Grijalva, S.: Role of Big Data in improving power system operation and protection. In: 2013 IREP Symposium Bulk Power System Dynamics and Control - IX Optimization, Security and Control of the Emerging Power Grid (IREP) (2013)Google Scholar
  2. 2.
    Anil, C.: Benchmarking of data mining techniques as applied to power system analysis. In: Uppsala University Publications (2013)Google Scholar
  3. 3.
    Konopko, J.: Big data solutions for smart grids and smart meters. In: Ryżko, D., Gawrysiak, P., Kryszkiewicz, M., Rybiński, H. (eds.) Machine Intelligence and Big Data in Industry. SBD, vol. 19, pp. 181–200. Springer, Cham (2016). Scholar
  4. 4.
    Seppala, A.: Load Research and Load Estimation in Electricity Distribution. Technical Research Centre of Finland (1996)Google Scholar
  5. 5.
    Venables, W.N., Smith, D.M.: An Introduction to R. Network Theory (2009)Google Scholar
  6. 6.
    Prajapati, V.: Big Data Analytics with R and Hadoop. Packt Publishing, Birmingham (2013)Google Scholar
  7. 7.
    White, T.: Hadoop: The Definitive Guide. Shroff Publishers & Distributers Private Limited, Mumbai (2015)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Karnataka Power Transmission Corporation LimitedBengaluruIndia
  2. 2.Sri Jayachamarajendra College of EngineeringMysuruIndia
  3. 3.Power Research & Development Consultants Pvt. Ltd.BengaluruIndia

Personalised recommendations