A Walk Through the GENI Experiment Cycle
- 500 Downloads
The ability to repeat experiments from a research study and obtain similar results is a corner stone in experiment-based scientific discovery. This essential feature has often been overlooked by the distributed computing and networking community. There are many reasons for that, such as the complexity of provisioning, configuring, and orchestrating the resources used by experiments, their multiple external dependencies, or the difficulty to seamlessly record these dependencies. This chapter describes a methodology based on well-established principles to plan, prepare and execute reproducible experiments. We propose and describe a family of tools, the LabWiki workspace, to support an experimenter’s workflow based on that methodology. This proposed workspace provides services and mechanisms for each step of an experiment-based study, while automatically capturing the necessary information to allow others to repeat, inspect, validate and modify prior experiments. Our LabWiki workspace builds on existing contributions, de-facto protocols, and model standards, which emerged from recent experimental facility initiatives. We use a real experiment as a thread to guide and illustrate the discussion throughout this chapter.
KeywordsContent Management System Experiment Controller Code Editor Measurement Stream Experiment Widget
NICTA is funded by the Australian Government through the Department of Communications and the Australian Research Council through the ICT Centre of Excellence Program. This material is based in part upon work supported by the GENI (Global Environment for Network Innovations) initiative under a National Science Foundation grant.
- 6.Jourjon, G., Rakotoarivelo, T., Ott, M.: From learning to researcher, ease the shift through testbed, ser. LNICST, Berlin Heidelberg: Springer-Verlag 46, 496–505 (2010)Google Scholar
- 7.Kavoussanakis, K., et al.: BonFIRE: the clouds and services testbed. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom), vol. 2, pp. 321–326 (2013). doi: 10.1109/CloudCom.2013.156
- 10.Langer, M.: iBooks Author: Publishing Your First eBook. Flying M Production, USA (2012)Google Scholar
- 11.Medina, A., Lakhina, A., Matta, I., Byers, J.: BRITE: an approach to universal topology generation. In: Proceedings of the International Workshop on Modeling, Analysis and Simulation of Computer and Telecommunications Systems, MASCOTS’01 (2001)Google Scholar
- 13.Mehani, O., Taib, R., Itzstein, B.: Time calibration in experiments with networked sensors. In: Proceedings of IEEE of the 39th Local Computer Networks Conference (LCN) (2014). ISBN: 978-1-4799-3780-6/14Google Scholar
- 14.Mills, D., Martin, J., Burbank, J., Kasch, W.: Network time protocol version 4: protocol and algorithms specification. RFC 5905 (2010)Google Scholar
- 15.Paxson, V.: Strategies for sound internet measurement. In: The Internet Measurement Conference (IMC) (2004)Google Scholar
- 20.Vandenberghe, W., et al.: Architecture for the heterogeneous federation of future internet experimentation facilities. Future Network and Mobile Summit. (2013). ISBN: 978-1-905824-37-3Google Scholar
- 21.Wright, A.: Tablets over textbooks? Commun. ACM 55 (3), 17–17 (2012)Google Scholar
- 22.Zhuang, Y., et al.: Taking a walk on the wild side: teaching cloud computing on distributed research testbeds. In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education. SIGCSE ’14. Atlanta, GA, pp. 535–540. ACM, New York (2014). ISBN: 978-1-4503-2605-6. doi: 10.1145/2538862.2538931