Simulation Standardization: Current State and Cross-Platform System for Network Simulators

  • Zohaib Latif
  • Kashif Sharif
  • Maria K. Alvi
  • Fan Li
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 747)


The amount of research done in the field of mobile ad hoc networks is extraordinarily large. Evaluation of protocols designed for ad hoc networks is challenging as the cost of node deployment in terms of resources required is high, hence, most of the researchers use simulations for performance evaluation. In this paper we address the pitfalls of simulation studies in ad hoc routing protocols published in recent years. We have conducted a survey to evaluate the current state of simulation studies published in top conference/journals of the communication domain. In majority of the published papers (the way simulation results are reported) we have found design flaws, unrealistic assumptions, are non-reproducible, and statistically invalid results. We also propose a standardizing architecture for automating the reporting and replication process for network simulators. This platform independent architecture alleviates the challenge of simulation parameter reporting and facilitates in designing better network simulation experiments.


  1. 1.
    Jensen, J.D.: Scientific uncertainty in news coverage of cancer research: effects of hedging on scientists and journalists credibility. Hum. Commun. Res. 34(3), 347–369 (2008)CrossRefGoogle Scholar
  2. 2.
    Patton, M.Q.: Enhancing the quality and credibility of qualitative analysis. Health Serv. Res. 34(5 Pt 2), 1189 (1999)Google Scholar
  3. 3.
    Metzger, M.J.: Making sense of credibility on the web: models for evaluating online information and recommendations for future research. J. Assoc. Inf. Sci. Technol. 58(13), 2078–2091 (2007)CrossRefGoogle Scholar
  4. 4.
    Riege, A.M.: Validity and reliability tests in case study research: a literature review with hands-on applications for each research phase. Qual. Mark. Res. Int. J. 6(2), 75–86 (2003)CrossRefGoogle Scholar
  5. 5.
    Kurkowski, S., Camp, T., Colagrosso, M.: MANET simulation studies: the incredibles. In: ACM SIGMOBILE Mobile Computing and Communications Review, vol. 9, no. 4, pp. 50–61 (2005)Google Scholar
  6. 6.
    Gunes, M., Wenig, M.: On the way to a more realistic simulation environment for mobile ad-hoc networks. In: International Workshop on Mobile Services and Personalized Environments, GI LNI (2006)Google Scholar
  7. 7.
    Andel, T.R., Yasinsac, A.: On the credibility of MANET simulations. Computer 39(7), 48–54 (2006)CrossRefGoogle Scholar
  8. 8.
    Peng, L., Bo, Z., Zhongyong, Z.: Simulation of VANET in a more realistic scenario. In: IEEE, ISSN, pp. 978–1000 (2011)Google Scholar
  9. 9.
    Feeley, M., Hutchinson, N., Ray, S.: Realistic mobility for mobile ad hoc network simulation. In: Nikolaidis, I., Barbeau, M., Kranakis, E. (eds.) ADHOC-NOW 2004. LNCS, vol. 3158, pp. 324–329. Springer, Heidelberg (2004). Scholar
  10. 10.
    Divecha, B., Abraham, A., Grosan, C., Sanyal, S.: Impact of node mobility on MANET routing protocols models. JDIM 5(1), 19–23 (2007)Google Scholar
  11. 11.
    Martinez, F.J., Toh, C.-K., Cano, J.-C., Calafate, C.T., Manzoni, P.: Realistic radio propagation models (RPMs) for VANET simulations. In: Wireless Communications and Networking Conference, WCNC 2009, pp. 1–6. IEEE (2009)Google Scholar
  12. 12.
    Sandve, G.K., Nekrutenko, A., Taylor, J., Hovig, E.: Ten simple rules for reproducible computational research. PLoS Comput. Biol. 9(10), e1003285 (2013)CrossRefGoogle Scholar
  13. 13.
    Prabhakaran, P., Sankar, R.: Impact of realistic mobility models on wireless networks performance. In: IEEE International Conference on Wireless and Mobile Computing, Networking and Communications : WiMob 2006, pp. 329–334. IEEE (2006)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.School of Computer ScienceBeijing Institute of TechnologyBeijingChina
  2. 2.Research Center of High Volume Language Information Processing and Cloud Computing ApplicationsBeijingChina
  3. 3.School of Electrical Engineering and Computer ScienceNational University of Sciences and TechnologyIslamabadPakistan

Personalised recommendations