Abstract
Methods to guide introduction to Software Process Improvement (SPI) courses to potentiate “learning SPI by doing SPI” and their systematic evaluations are relevant to both practice and research. An evaluation model for an educational method to teach SPI was developed. This model is based on a model for the evaluation of educational games. The developed model is composed of model design; evaluation process, objective and questionnaire; documentation model, data compilation and analysis model and spreadsheet; and example of use. The model was used to evaluate a course. Results of this evaluation provide initial validation of this model and also indicate that the evaluated method is effective in potentiate “learning SPI by doing SPI”.
Keywords
- Software process improvement
- Teaching SPI
- Evaluation model
This is a preview of subscription content, access via your institution.
Buying options






References
Salviano, C.F.: Teaching process improvement by establishing process modeling profile to drive process improvement – the PRO2PI-WORK4E method. In: [20], pp. 63–69 (2015)
Salviano, C.F.: Model-driven process capability engineering for knowledge working intensive organization. In: SPICE 2008, Nuremberg, Germany, pp. 1–9 (2008)
Savi, R., von Wangenheim, C.G., Borgatto, A.F., Buglione, L., Ulbricht, V.R.: MEEGA – a model for the evaluation of games for teaching software engineering. INCoD Technical report, 001/2012 (2012)
Savi, R.: Evaluation of games for knowledge dissemination (in Portuguese “Avaliação de Jogos Voltados para a Disseminação do Conhecimento”). Ph.D. Thesis in Engenharia e Gestão do Conhecimento at Univ. Fed. Santa Catarina, UFSC, Florianópolis, 236 p. (2011)
Savi, R., von Wangenheim, C.G., Borgatto, A.F.: A model for the evaluation of educational games for teaching software engineering (in Portuguese “Um Modelo de Avaliação de Jogos Educacionais na Engenharia de Software”). In: Proceedings of the 25th Brazilian Symposium on Software Engineering, pp. 194–203 (2011)
Petri, G., von Wangenheim, C.G.: How to evaluate educational games: a systematic literature review. J. Univ. Comput. Sci. 22(7), 992–1021 (2016)
Kirkpatrick, D.L., Kirkpatrick, J.D.: Evaluating Training Programs. Berrett-Koehler Publishers, Oakland (1994)
Keller, J.M.: Development and use of the ARCS model of instructional design. J. Instr. Develop. 10(2) (1987). doi:10.1007/BF02905780
Krathwohl, D.R.: A revision of Bloom’s taxonomy: an overview. Theory Pract. 41(4) (2002)
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering. Springer, Heidelberg (2012). 236 p., WORK4E
Jedlitschka, A., Pfahl, D.: Reporting guidelines for controlled experiments in software engineering. In: Proceedings of the 4th International Symposium on Empirical Software Engineering, Noosa Heads, pp. 95–104 (2005)
Basili, V.R.: Software Modeling and Measurement: The Goal/Question/Metric Paradigm. Univ. of Maryland, College Park, MD, USA, Technical report CS-TR-2956, 24 p. (1992)
Charmaz, K.: Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis, vol. 10. SAGE Publications Inc., London (2006)
Salviano, C.F.: EM4E - Evaluation Method of PRO2PI-WORK4E Method (in Portuguese “EM4E - Modelo de Avaliação do Método PRO2PI-WORK4E”). Technical report TRT0040117, CTI Renato Archer/NMPS Research Group, version 1.1 (2017)
Salviano, C.F.: Slides on Introduction to Software Process Improvement with PRO2PI-WORK4E 2017 edition (original in Portuguese, “Slides sobre Introdução à Melhoria de Processo de Software com PRO2PI-WORK4E edição 2017”). Technical report TRT0043117, CTI Renato Archer/ NMPS Research Group, version 1.1, 268 p. (2017)
Salviano, C.F.: Results of PRO2PI-WORK4E Method Evaluation in CET-811 course 2017 edition (original in Portuguese “Resultado da Avaliação do Método PRO2PI-WORK4E na Disciplina CET-811 edição 2017”). Technical report TRT0041117, CTI Renato Archer/ NMPS Research Group, version 1.1 (2017)
Salviano, C.F.: Starting Software Process Improvement with PRO2PI-WORK4E in an Innovative Product VSE (original in Portuguese “Início da Melhoria de Processo de Software com PRO2PI-WORK4E em MPE de Produto Inovador”). Technical report TRT0042117, CTI Renato Archer/ NMPS Research Group, version 1.1, 19 p. (2017)
Petri, G., von Wangenheim, C.G, Borgatto, A.F.: MEEGA+: An Evolution of a Model for the Evaluation of Educational Games. Technical report INCoD/GQS.03.2016.E, Version 1.0, ISSN 2236-5281 (2016)
Kitchenham, B., Madeyski, L., Budgen, D., Keung, J., Brereton, J., Charters, S., Gibbs, S., Pohthong, A.: Robust statistical methods for empirical software engineering. Empir. Softw. Eng. 22, 579–630 (2017). doi:10.1007/s10664-016-9437-5
O’Connor, R.V., Mitasiunas, A., Ross, M. (eds.) In: Proceedings of 1st International Workshop on Software Process Education, Training and Professionalism. Gothenburg, Sweden (2015). http://ceur-ws.org
Ibrahim, R.L., Hirmanpour, I.: The Subject Matter of Process Improvement: A Topic and Reference Source for Software Engineering Educators and Trainers. Technical report CMU/SEI-95-TR-003 ESC-TR-95-003 (1995). http://www.sei.cmu.edu/reports/95tr003.pdf
Salviano, C.F.: Establishing ISO/IEC 15504-Based Process Capability Profile to Process Improvement. In: Presented at 16th EuroSPI Conference on Tutorial Slides, Spain (2009)
Salviano, C.F.: PRO2PI-WORK4E project (2017). https://www.researchgate.net/project/PRO2PI-WORK4E-Method-for-teaching-software-process-improvement
Acknowledgments
The author thanks the students of the mentioned course for participating in the SPI learning process and for answering the evaluation questionnaire, the authors of MEEGA model for providing reference to EM4E model, and the reviewers of SPICE 2017 for providing useful comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Salviano, C.F. (2017). Evaluation Model of PRO2PI-WORK4E Method for Teaching Software Process Improvement. In: Mas, A., Mesquida, A., O'Connor, R., Rout, T., Dorling, A. (eds) Software Process Improvement and Capability Determination. SPICE 2017. Communications in Computer and Information Science, vol 770. Springer, Cham. https://doi.org/10.1007/978-3-319-67383-7_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-67383-7_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67382-0
Online ISBN: 978-3-319-67383-7
eBook Packages: Computer ScienceComputer Science (R0)