Result processing approaches for large smart grid co-simulations

Abstract

Simulations of smart grids provide a safe means to test new concepts prior to laboratory and field tests. Due to the multi-actor and multi-physics complexity of smart grids, various research institutes have developed “co-simulation” environments which link different models and simulators together. However, the subsequent result analysis of a co-simulation is challenging, due to e.g. various distributed simulations and the large and varied amount of result- and log-data. When results over long time spans are considered, this may become a big data analysis problem. This paper proposes two result processing approaches for co-simulations, of which one is stream-based. A first performance test shows promising data processing rates and we discuss future development steps.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3

Image source: [10]

Fig. 4

Image source: [11]

Fig. 5
Fig. 6
Fig. 7

Notes

  1. 1.

    www.opsim.net.

  2. 2.

    https://pypi.python.org/pypi/pandapower.

  3. 3.

    http://spark.apache.org/.

  4. 4.

    https://hazelcast.com/products/jet/.

  5. 5.

    https://flink.apache.org/.

  6. 6.

    https://hazelcast.com/press-release/introducing-hazelcast-jet-new-lightweight-distributed-data-processing-engine/.

References

  1. 1.

    SmartGrids SRA 2035 (2012) Strategic research agenda update of the SmartGrids SRA 2007 for the needs by the year 2035. http://www.smartgrids.eu/documents/sra2035.pdf. Accessed 12 Jan 2017

  2. 2.

    Drayer E, Hegemann J, Gehler S, Braun M (2016) Resilient distribution grids cyber threat scenarios and test environment. In: IEEE PES innovative smart grid technologies conference Europe (ISGT-Europe), pp 1–6

  3. 3.

    Wang H, Stetz T, Marten F, Kraiczy M, Schmidt S, Bock C, Braun M (2015) Controlled reactive power provision at the interface of medium- and high voltage level: first laboratory experiences for a bayernwerk distribution grid using real-time hardware-in-the-loop-simulation. International ETG Congress 2015; Die Energiewende—Blueprints for the new energy age, pp 1–8

  4. 4.

    Lin H, Smbamoorthy S, Shukla S, Thorp J, Mili L (2011) Power system and communication network co-simulation for smart grid applications. In: ISGT 2011: IEEE PES conference on innovative smart grid technologies

  5. 5.

    Daily J, Fuller J, Marinovici L, Fisher A, Agarwal K (2014) Framework for network co-simulation. In: 3rd workshop on next-generation analytics for the future power grid

  6. 6.

    Lin H, Veda SS, Shukla SS, Mili L, Thorp J (2012) Geco: global event-driven co-simulation framework for interconnected power system and communication network. IEEE Trans Smart Grid 3(3):1444–1456

    Article  Google Scholar 

  7. 7.

    Vogt M, Marten F, Loewer L, Horst KBD, Fetzer D, Menke J-H, Troncia M, Hegemann J, Tobermann C, Braun M (2015)Evaluation of interactions between multiple grid operators based on sparse grid knowledge in context of a smart grid co-simulation environment (Eindhoven), IEEE PowerTech

  8. 8.

    Ding Y, Morawietz A, Beigl M (2016) Investigation of a grid-driven real-time pricing in a simulation environment. In: IEEE international energy conference, ENERGYCON

  9. 9.

    Kosek AM, Lnsdorf O, Scherfke S, Gehrke O, Rohjans S (2014) Evaluation of smart grid control strategies in co-simulation integration of ipsys and mosaik. In: Power systems computation conference, pp 1–7

  10. 10.

    Aydin AA, Anderson KM (2017) Batch to real-time: incremental data collection and analytics platform. In: Proceedings of the 50th Hawaii international conference on system sciences

  11. 11.

    Peng W, Li Y, Zhu X, Li B (2016) An analysis platform of road traffic management system log data based on distributed storage and parallel computing techniques. In: IEEE international conferences on big data and cloud computing (BDCloud) social computing and networking, pp 585–589

  12. 12.

    Wu Y, Gong G (2013) A fully distributed collection technology for mass simulation data. In: International conference on computational and information sciences

  13. 13.

    Chaudhary M (2014) Apache storm: what we learned about scaling and pushing the performance envelope. LOGGLY-Blog. Accessed 4 Aug 2017

Download references

Acknowledgements

This work presents selected results from the project “OpSimEval”, which is performed by Fraunhofer IWES and University of Kassel and is funded by the Federal Ministry for Economic Affairs and Energy under Grant Nos. 032578A and 032578B, on the basis of a decision by the German Bundestag. The development of the “Caro” platform benefited from ideas and feedback of Jaro Habiger, who worked at Fraunhofer IWES during the first prototype development. The authors take full responsibility for the content of this paper.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Frank Marten.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Marten, F., Mand, A., Bernard, A. et al. Result processing approaches for large smart grid co-simulations. Comput Sci Res Dev 33, 199–205 (2018). https://doi.org/10.1007/s00450-017-0359-2

Download citation

Keywords

  • Co-simulation
  • Stream processing
  • Big data analysis