A Model-Driven Approach to Specifying and Monitoring Controlled Experiments in Software Engineering

  • Marília Freire
  • Paola Accioly
  • Gustavo Sizílio
  • Edmilson Campos Neto
  • Uirá Kulesza
  • Eduardo Aranha
  • Paulo Borba
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7983)

Abstract

This paper presents a process-oriented model-driven approach that supports the conduction of controlled experiments in software engineering. The approach consists of: (i) a domain specific language (DSL) for process specification and statistical design of controlled experiments; (ii) model-driven transformations that allow workflow models generations specific to each experiment participant and according to the experiment statistical design; and (iii) a workflow execution environment that allows the monitoring of participant activities in the experiment, besides gathering participants feedback from the experiment. The paper also presents the results of an exploratory study that analyzes the feasibility of the approach and the expressivity of the DSLs in the modeling of a non-trivial software engineering experiment.

Keywords

Software Engineering Test Suite Software Product Line Configuration File Change Request 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Sjoeberg, D.I.K., Hannay, J.E., Hansen, O., Kampenes, V.B., Karahasanovic, A., Liborg, N.-K., Rekdal, A.C.: A survey of controlled experiments in software engineering. IEEE Transactions on Software Engineering 31(9), 733–753 (2005)CrossRefGoogle Scholar
  2. 2.
    Jedlitschka, A., Ciolkowski, M., Pfahl, D.: Reporting Experiments in Software Engineering. In: Guide to Advanced Empirical Software Engineering. Springer Science+Business Media (2008)Google Scholar
  3. 3.
    Hochstein, L., Nakamura, T., Shull, F., Zazworka, N., Basili, V., Zelkowitz, M.: An Environment for Conducting Families of Software Engineering Experiments. Advances in Computers 74, 175–200 (2008)CrossRefGoogle Scholar
  4. 4.
    Sjøberg, D., Anda, B., Arisholm, E., Dybå, T., Jørgensen, M., Karahasanovic, A., Koren, E., Vokác, M.: Conducting Realistic Experiments in Software Engineering. In: International Symposium on Empirical Software Engineering (2002)Google Scholar
  5. 5.
    Travassos, G., Santos, P., Mian, P., Dias Neto, A., Biolchini, J.: An environment to support large scale experimentation in software engineering. In: 13th IEEE International Conference on Engineering of Complex Computer Systems, pp. 193–202 (2008)Google Scholar
  6. 6.
    Accioly, Borba, P., Bonifácio, R.: Comparing Two Black-box Testing Strategies for Software Product Lines. In: Proceedings of SBCARS, Natal, Brazil (2012)Google Scholar
  7. 7.
    Wohlin, C., Runeson, P., Höst, M., Ohlsson, M., Regnell, B., Wesslén, A.: Experimentation in Software Engineering: An Introduction. Kluwer Academic Publishers, Boston (2000)MATHCrossRefGoogle Scholar
  8. 8.
    Pfleeger, S.: Experimental design and analysis in software engineering: Part 2: how to set up and experiment. SIGSOFT Softw. Eng. Notes 20, 22–26 (1995)CrossRefGoogle Scholar
  9. 9.
    Lochmann, H., Bräuer, M.: Towards Semantic Integration of Multiple Domain-Specific Languages Using Ontological Foundations. In: ATEM on MoDELS, Nashville (2007)Google Scholar
  10. 10.
    Freire, M., Aleixo, F., Uira, K., Aranha, E., Coelho, R.: Automatic Deployment and Monitoring of Software Processes: A Model-Driven Approach. In: SEKE 2011, Mi/Fl (2011)Google Scholar
  11. 11.
    Freire, M., Alencar, D., Aranha, E., Kulesza, U.: Software Process Monitoring using Statistical Process Control Integrated in Workflow Systems. In: SEKE 2012, SF/CA (2012)Google Scholar
  12. 12.
    Juristo, N., Moreno, A.M.: Basics of Software Engineering Experimentation. Kluwer Academic Publisher, Madrid (2001)MATHCrossRefGoogle Scholar
  13. 13.
    Campos, E., Bezerra, A., Freire, M., Kulesza, U., Aranha, E.: Composição de Linguagens de Modelagem Específicas de Domínio: Um Estudo Exploratório. In: MDSD, pp. 41–48 (2012)Google Scholar
  14. 14.
    Campos, E., Freire, M., Kulesza, U., Bezerra, A., Aranha, E.: Composition of Domain Specific Modeling Languages: An Exploratory Study. In: MODELSWARD (2013)Google Scholar
  15. 15.
    Freire, M., Alencar, D., Campos, E., Medeiros, T., Kulesza, U., Aranha, E., Soares, S.: Automated Support for Controlled Experiments in Software Engineering: A Systematic Review. In: SEKE, Boston/USA (2013)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Marília Freire
    • 1
    • 2
  • Paola Accioly
    • 3
  • Gustavo Sizílio
    • 1
    • 2
  • Edmilson Campos Neto
    • 1
    • 2
  • Uirá Kulesza
    • 1
  • Eduardo Aranha
    • 1
  • Paulo Borba
    • 3
  1. 1.Federal University of Rio Grande do NorteNatalBrasil
  2. 2.Federal Institute of Rio Grande do NorteNatalBrasil
  3. 3.Federal University of PernambucoRecifeBrasil

Personalised recommendations