The GENI Book pp 407-431 | Cite as

A Walk Through the GENI Experiment Cycle

  • Thierry Rakotoarivelo
  • Guillaume Jourjon
  • Olivier Mehani
  • Max Ott
  • Michael Zink
Chapter

Abstract

The ability to repeat experiments from a research study and obtain similar results is a corner stone in experiment-based scientific discovery. This essential feature has often been overlooked by the distributed computing and networking community. There are many reasons for that, such as the complexity of provisioning, configuring, and orchestrating the resources used by experiments, their multiple external dependencies, or the difficulty to seamlessly record these dependencies. This chapter describes a methodology based on well-established principles to plan, prepare and execute reproducible experiments. We propose and describe a family of tools, the LabWiki workspace, to support an experimenter’s workflow based on that methodology. This proposed workspace provides services and mechanisms for each step of an experiment-based study, while automatically capturing the necessary information to allow others to repeat, inspect, validate and modify prior experiments. Our LabWiki workspace builds on existing contributions, de-facto protocols, and model standards, which emerged from recent experimental facility initiatives. We use a real experiment as a thread to guide and illustrate the discussion throughout this chapter.

References

  1. 1.
    Berman, M., et al.: GENI: a federated testbed for innovative network experiments. Comput. Netw. 61 (2014). Special issue on Future Internet Testbeds—Part I, pp. 5–23. ISSN: 1389–1286. doi:10.1016/j.bjp.2013.12.037
  2. 2.
    Chacon, S.: Pro Git, 1st edn. Apress, Berkely (2009). ISBN: 1430218339CrossRefGoogle Scholar
  3. 3.
    Fisher, R.A.: The Design of Experiments. Hafner Publishing Company, New York (1937)MATHGoogle Scholar
  4. 4.
    Gabriel, A., Capone, R.: Executable paper grand challenge workshop. Procedia Comput. Sci. 4 (2011). Proceedings of the International Conference on Computational Science, ICCS 2011, pp. 577–578. ISSN: 1877–0509. doi:10.1016/j.procs.2011.04.060
  5. 5.
    Gavras, A., et al.: Future internet research and experimentation: the FIRE initiative. SIGCOMM Comput. Commun. Rev. 37 (3), 89–92 (2007). ISSN: 0146–4833. doi:10.1145/1273445.1273460
  6. 6.
    Jourjon, G., Rakotoarivelo, T., Ott, M.: From learning to researcher, ease the shift through testbed, ser. LNICST, Berlin Heidelberg: Springer-Verlag 46, 496–505 (2010)Google Scholar
  7. 7.
    Kavoussanakis, K., et al.: BonFIRE: the clouds and services testbed. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom), vol. 2, pp. 321–326 (2013). doi:10.1109/CloudCom.2013.156
  8. 8.
    Kim, Y.-H. et al.: Enabling iterative development and reproducible evaluation of network protocols. Comput. Netw. 63, 238–250 (2014)CrossRefGoogle Scholar
  9. 9.
    Krishnamurthy, B., Willinger, W., Gill, P., Arlitt, M.: A socratic method for validation of measurement based networking research. Comput. Commun. 34, 43–53 (2011)CrossRefGoogle Scholar
  10. 10.
    Langer, M.: iBooks Author: Publishing Your First eBook. Flying M Production, USA (2012)Google Scholar
  11. 11.
    Medina, A., Lakhina, A., Matta, I., Byers, J.: BRITE: an approach to universal topology generation. In: Proceedings of the International Workshop on Modeling, Analysis and Simulation of Computer and Telecommunications Systems, MASCOTS’01 (2001)Google Scholar
  12. 12.
    Mehani, O., Jourjon, G., Rakotoarivelo, T., Ott, M.: An instrumentation framework for the critical task of measurement collection in the future internet. Comput. Netw. 63 (2014). ISSN: 1389–1286. doi:10.1016/j.bjp.2014.01.007
  13. 13.
    Mehani, O., Taib, R., Itzstein, B.: Time calibration in experiments with networked sensors. In: Proceedings of IEEE of the 39th Local Computer Networks Conference (LCN) (2014). ISBN: 978-1-4799-3780-6/14Google Scholar
  14. 14.
    Mills, D., Martin, J., Burbank, J., Kasch, W.: Network time protocol version 4: protocol and algorithms specification. RFC 5905 (2010)Google Scholar
  15. 15.
    Paxson, V.: Strategies for sound internet measurement. In: The Internet Measurement Conference (IMC) (2004)Google Scholar
  16. 16.
    Rajasekar, A., et al.: iRODS primer: integrated rule-oriented data system. In: Synthesis Lectures on Information Concepts, Retrieval, and Services 2.1. Morgan and Claypool Publishers (2010). doi:10.2200/s00233ed1v01y200912icr012
  17. 17.
    Rakotoarivelo, T., Ott, M., Jourjon, G., Seskar, I.: OMF: a control and management framework for networking testbeds. SIGOPS Oper. Syst. Rev. 43 (4), 54–59 (2010). ISSN: 0163–5980. doi:10.1145/1713254.1713267
  18. 18.
    Rakotoarivelo, T., Jourjon, G., Ott, M.: Designing and orchestrating re-producible experiments on federated networking testbeds. Comput. Netw. 63 (2014). doi:http://dx.doi.org/10.1016/j.bjp.2013.12.033
  19. 19.
    Römer, K., Blum, P., Meier, L.: Time synchronization and calibration in wireless sensor networks. Handbook of Sensor Networks. Wiley, New York (2005). Chap. 7. doi:10.1002/047174414x.ch7 CrossRefGoogle Scholar
  20. 20.
    Vandenberghe, W., et al.: Architecture for the heterogeneous federation of future internet experimentation facilities. Future Network and Mobile Summit. (2013). ISBN: 978-1-905824-37-3Google Scholar
  21. 21.
    Wright, A.: Tablets over textbooks? Commun. ACM 55 (3), 17–17 (2012)Google Scholar
  22. 22.
    Zhuang, Y., et al.: Taking a walk on the wild side: teaching cloud computing on distributed research testbeds. In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education. SIGCSE ’14. Atlanta, GA, pp. 535–540. ACM, New York (2014). ISBN: 978-1-4503-2605-6. doi:10.1145/2538862.2538931

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Thierry Rakotoarivelo
    • 1
  • Guillaume Jourjon
    • 1
  • Olivier Mehani
    • 1
  • Max Ott
    • 1
  • Michael Zink
    • 2
  1. 1.NICTAAustralian Technology ParkEveleighAustralia
  2. 2.Department of Electrical and Computer EngineeringUniversity of Massachusetts in AmherstAmherstUSA

Personalised recommendations