Simulation and Evaluation of Mixed-Mode Environments: Towards Higher Quality of Simulations

  • Vinay Sachidananda
  • Diego Costantini
  • Christian Reinl
  • Dominik Haumann
  • Karen Petersen
  • Parag S. Mogre
  • Abdelmajid Khelil
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6472)


For rescue and surveillance scenarios, the Mixed-Mode Environments (MMEs) for data acquisition, processing, and dissemination have been proposed. Evaluation of the algorithms and protocols developed for such environments before deployment is vital. However, there is a lack of realistic testbeds for MMEs due to reasons such as high costs for their setup and maintenance. Hence, simulation platforms are usually the tool of choice when testing algorithms and protocols for MMEs. However, existing simulators are not able to fully support detailed evaluation of complex scenarios in MMEs. This is usually due to lack of highly accurate models for the simulated entities and environments. This affects the results which are obtained by using such simulators. In this paper, we highlight the need to consider the Quality of Simulations (QoSim), in particular aspects such as accuracy, validity, certainty, and acceptability. The focus of this paper is to understand the gap between real-world experiments and simulations for MMEs. The paper presents key QoSim concepts and characteristics for MMEs simulations, describing the aspects of contents of simulation, processing of simulation, and simulation outputs. Eventually, a road map for improving existing simulation environments is proposed.


Sensor Network Sensor Node Wireless Sensor Network Mobile Robot Model View 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    McHaney, R.: Computer simulation: a practical perspective. Academic Press Professional, Inc., San Diego (1991)Google Scholar
  2. 2.
    Eriksson, J.: Detailed simulation of heterogeneous wireless sensor networks. PhD thesis, Uppsala University, Department of Information Technology (May 2009)Google Scholar
  3. 3.
    Kropff, M., Reinl, C., Listmann, K., Petersen, K., Radkhah, K., Shaikh, F.K., Herzog, A., Strobel, A., Jacobi, D., von Stryk, O.: MM-ulator: Towards a common evaluation platform for mixed mode environments. In: Carpin, S., Noda, I., Pagello, E., Reggiani, M., von Stryk, O. (eds.) SIMPAR 2008. LNCS (LNAI), vol. 5325, pp. 41–52. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  4. 4.
    Zahedi, S., Srivastava, M.B., Bisdikian, C.: A computational framework for quality of information analysis for detection-oriented sensor networks. In: Military Communications Conference, MILCOM 2008., pp. 1–7. IEEE, Los Alamitos (2008)Google Scholar
  5. 5.
    Gelenbe, E., Hey, L.: Quality of information: An empirical approach. In: 5th IEEE International Conference on Mobile Ad Hoc and Sensor Systems, MASS 2008, pp. 730–735 (September 2008)Google Scholar
  6. 6.
    Zahedi, S., Bisdikian, C.: A framework for QoI-inspired analysis for sensor network deployment planning. In: WICON 2007: Proceedings of the 3rd International Conference on Wireless Internet, pp. 1–8. ICST, Brussels (2007)Google Scholar
  7. 7.
    Thornley, D.J., Young, R.I., Richardson, P.J.: From mission specification to quality of information measures-closing the loop in military sensor networks. In: ACITA 2008 (2008)Google Scholar
  8. 8.
    Bisdikian, C., Damarla, R., Pham, T., Thomas, V.: Quality of information in sensor networks. In: ITA 2007 (2007)Google Scholar
  9. 9.
    Levis, P., Lee, N., Welsh, M., Culler, D.: TOSSIM: Accurate and scalable simulation of entire TinyOS applications. In: Proceedings of the 1st International Conference on Embedded Networked Sensor Systems, pp. 126–137. ACM, New York (2003)CrossRefGoogle Scholar
  10. 10.
    The Network Simulator NS-2,
  11. 11.
    Varga, A., Hornig, R.: An overview of the OMNeT++ simulation environment. In: Simutools 2008: Proceedings of the 1st International Conference on Simulation Tools and Techniques for Communications, Networks and Systems & Workshops, pp. 1–10. ICST, Brussels (2008)Google Scholar
  12. 12.
    Friedmann, M., Petersen, K., von Stryk, O.: Adequate motion simulation and collision detection for soccer playing humanoid robots. Robotics and Autonomous Systems 57, 786–795 (2009)CrossRefGoogle Scholar
  13. 13.
    Lewis, M., Wang, J., Hughes, S.: USARSim: Simulation for the Study of Human-Robot Interaction. Journal of Cognitive Engineering and Decision Making 2007, 98–120 (2007)Google Scholar
  14. 14.
    Gerkey, B.P., Vaughan, R.T., Howard, A.: The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems. In: Proceedings of the 11th International Conference on Advanced Robotics, pp. 317–323 (2003)Google Scholar
  15. 15.
    Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2149–2154 (2004)Google Scholar
  16. 16.
    Michel, O.: Cyberbotics ltd. webots tm: Professional mobile robot simulation. Int. Journal of Advanced Robotic Systems 1, 39–42 (2004)CrossRefGoogle Scholar
  17. 17.
    Friedmann, M.: Simulation of Autonomous Robot Teams With Adaptable Levels of Abstraction. PhD thesis, Technische Universität Darmstadt (November 30, 2009)Google Scholar
  18. 18.
    Curren, D.: A survey of simulation in sensor networks. Technical report, University of BinghamtonGoogle Scholar
  19. 19.
    Mekni, M., Moulin, B.: A survey on sensor webs simulation tools. In: Second International Conference on Sensor Technologies and Applications, SENSORCOMM 2008, pp. 574–579 (25-31, 2008)Google Scholar
  20. 20.
    Mogre, P.S., Hollick, M., d’Heureuse, N., Heckel, H.W., Krop, T., Steinmetz, R.: A Graph-based Simple Mobility Model. In: 4th Workshop zu Mobilen Ad Hoc Netzen, KiVS 2007 (2007)Google Scholar
  21. 21.
    Österlind, F., Dunkels, A., Eriksson, J., Finne, N., Voigt, T.: Demo abstract: Cross-level simulation in cooja. In: Proceedings of the First IEEE International Workshop on Practical Issues in Building Sensor Network Applications (2006)Google Scholar
  22. 22.
    Eriksson, J., Österlind, F., Finne, N., Tsiftes, N., Dunkels, A., Voigt, T., Sauter, R., Marrón, P.J.: Cooja/mspsim: interoperability testing for wireless sensor networks. In: Simutools 2009: Proceedings of the 2nd International Conference on Simulation Tools and Techniques, pp. 1–7. ICST, Brussels (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Vinay Sachidananda
    • 1
  • Diego Costantini
    • 1
  • Christian Reinl
    • 1
  • Dominik Haumann
    • 1
  • Karen Petersen
    • 1
  • Parag S. Mogre
    • 1
  • Abdelmajid Khelil
    • 1
  1. 1.Research Training Group “Cooperative, Adaptive and Responsive Monitoring in Mixed-Mode Environments”Technische Universität DarmstadtDarmstadtGermany

Personalised recommendations