Good Experimental Methodologies for Autonomous Robotics: From Theory to Practice

  • Francesco AmigoniEmail author
  • Viola Schiaffonati
  • Mario Verdicchio
Part of the SpringerBriefs in Applied Sciences and Technology book series (BRIEFSAPPLSCIENCES)


A lively discussion on good experimental methodologies has recently taken place in the autonomous robotics community. Workshops have been organized, special issues published, and projects funded after recognizing that experimentation in autonomous robotics has not yet reached a level of maturity comparable with other fields of engineering and science. Within this discussion, we are not aware of any systematic survey on how experiments are conducted in autonomous robotics papers published in major journals and conferences. In this chapter, we provide an initial contribution to fill this gap by analyzing the experimental trends that emerge from the autonomous robotics papers presented over the last 11 years at the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), which constitute a privileged sample to get a picture on the evolution of experimental activity in the area. We conduct our analysis in the light of some principles that have been proposed for the development of good experimental methodologies in autonomous robotics.


Autonomous robots Experimental methodologies 


  1. 1.
    Euron GEM Sig (2007) Accessed July 2013
  2. 2.
    Madhavan R, Scrapper C, Kleiner A (2009) Special issue on characterizing mobile robot localization and mapping. Auton Robot 27(4):309–481Google Scholar
  3. 3.
    BRICS (2009) Best practice in robotics. Accessed July 2013
  4. 4.
    Rawseeds (2006) Accessed July 2013
  5. 5.
    RoCKIn (2013) Robot competitions kick innovation in cognitive systems and robotics. Accessed July 2013
  6. 6.
    RoSta (2007) Robot standards and reference architectures. Accessed July 2013
  7. 7.
    Bonsignorio F, Hallam J, del Pobil AP (2007) Good experimental methodology - GEM guidelines. Accessed July 2013
  8. 8.
    Amigoni F, Reggiani M, Schiaffonati V (2009) An insightful comparison between experiments in mobile robotics and in science. Auton Robot 27(4):313–325Google Scholar
  9. 9.
    USARSim (2011) Unified system for automation and robot simulation. Accessed July 2013
  10. 10.
    Webots (2011) Accessed July 2013
  11. 11.
    Adept Technology (2011) Accessed July 2013
  12. 12.
    Sony Aibo (2006) Accessed July 2013
  13. 13.
    ROS (2011) Robot operating system. Accessed July 2013
  14. 14.
    Cohen P (1995) Empirical methods for artificial intelligence. The MIT Press, CambridgeGoogle Scholar
  15. 15.
    Howard A, Roy N (2003) The robotics data set repository (radish). Accessed July 2013

Copyright information

© The Author(s) 2014

Authors and Affiliations

  • Francesco Amigoni
    • 1
    Email author
  • Viola Schiaffonati
    • 1
  • Mario Verdicchio
    • 2
  1. 1.Dipartimento di Elettronica, Informazione e BioingegneriaPolitecnico di MilanoMilanItaly
  2. 2.Dipartimento di IngegneriaUniversità degli Studi di BergamoBergamoItaly

Personalised recommendations