Hitting the Target: Practices for Moving Toward Innovation Experiment Systems

  • Teemu Karvonen
  • Lucy Ellen Lwakatare
  • Tanja Sauvola
  • Jan Bosch
  • Helena Holmström Olsson
  • Pasi Kuvaja
  • Markku Oivo
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 210)


The benefits and barriers that software development companies face when moving beyond agile development practices are identified in a multiple-case study in five Finnish companies. The practices that companies need to adopt when moving towards innovation experiment systems are recognised. The background of the study is the Stairway to Heaven (StH) model that describes the path that many software development companies take when advancing their development practices. The development practices in each case are investigated and analysed in relation to the StH model. At first the results of the analysis strengthened the validity of the StH model as a path taken by software development companies to advance their development practices. Based on the findings, the StH model was extended with a set of additional practices and their adoption levels for each step of the model. The extended model was validated in five case companies.


Software development Agile development Feedback loops Innovation experiment systems Continuous deployment 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Highsmith, J.: Agile Project Management: Creating Innovative Products. Addison-Wesley Professional, New York (2009)Google Scholar
  2. 2.
    Bosch, J., Eklund, U.: Eternal Embedded Software: Towards Innovation Experiment Systems. In: Margaria, T., Steffen, B. (eds.) ISoLA 2012, Part I. LNCS, vol. 7609, pp. 19–31. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  3. 3.
    Fagerholm, F., Guinea, A.S., Mäenpää, H., Münch, J.: Building Blocks for Continuous Experimentation. In: 1st International Workshop on Rapid Continuous Software Engineering, pp. 26–35. ACM Press, New York (2014)Google Scholar
  4. 4.
    Olsson, H.H., Bosch, J., Alahyari, H.: Towards R&D as Innovation Experiment Systems: A Framework for Moving Beyond Agile Software Development. In: IASTED Multiconferences - Proceedings of the IASTED International Conference on Software Engineering, pp. 798–805 (2013)Google Scholar
  5. 5.
    Rodríguez, P., Markkula, J., Oivo, M., Turula, K.: Survey on Agile and Lean Usage in Finnish Software Industry. In: ACM-IEEE International symposium on Empirical Software Engineering and Measurement, pp. 139–148. ACM Press, New York (2012)CrossRefGoogle Scholar
  6. 6.
    Dybå, T., Dingsøyr, T.: Empirical Studies of Agile Software Development: A Systematic Review. Information and Software Technology 50, 833–859 (2008)CrossRefGoogle Scholar
  7. 7.
    Goodman, D., Elbaz, M.: “It’s Not the Pants, it’s the People in the Pants” Learnings from the Gap Agile Transformation What Worked, How We Did it, and What Still Puzzles Us. In: Agile Conference, pp. 112–115. IEEE Press, New York (2008)Google Scholar
  8. 8.
    Marschall, M.: Transforming a Six Month Release Cycle to Continuous Flow. In: Agile Conference, pp. 395–400. IEEE Press, New York (2007)Google Scholar
  9. 9.
    Neely, S., Stolt, S.: Continuous Delivery? Easy! Just Change Everything (Well, Maybe It Is Not That Easy). In: Agile Conference, pp. 121–128. IEEE Press, New York (2013)Google Scholar
  10. 10.
    Trimble, J., Webster, C.: From Traditional, to Lean, to Agile Development: Finding the Optimal Software Engineering Cycle. In: 46th Hawaii International Conference on System Sciences, pp. 4826–4833. IEEE Press, New York (2013)Google Scholar
  11. 11.
    Ståhl, D., Bosch, J.: Modeling Continuous Integration Practice Differences in Industry Software Development. Journal of Systems and Software 87, 48–59 (2014)CrossRefGoogle Scholar
  12. 12.
    Humble, J., Farley, D.: Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation. Addison-Wesley Professional, Boston (2010)Google Scholar
  13. 13.
    Claps, G.G., Berntsson Svensson, R., Aurum, A.: On the Journey to Continuous Deployment: Technical and Social Challenges Along the Way. Information and Software Technology 57, 21–31 (2015)CrossRefGoogle Scholar
  14. 14.
    Leppänen, M., Mäkinen, S., Pagels, M., Eloranta, V.-P., Itkönen, J., Mäntylä, M.V., Mannisto, T.: The Highways and Country Roads to Continuous Deployment. IEEE Software 32, 64–72 (2015)CrossRefGoogle Scholar
  15. 15.
    Fitzgerald, B., Stol, K.-J.: Continuous Software Engineering and Beyond: Trends and Challenges. In: 1st International Workshop on Rapid Continuous Software Engineering, RCoSE 2014, pp. 1–9. ACM Press, New York (2014)CrossRefGoogle Scholar
  16. 16.
    Karvonen, T., Rodriguez, P., Kuvaja, P., Mikkonen, K., Oivo, M.: Adapting the Lean Enterprise Self-Assessment Tool for the Software Development Domain. In: 38th Euromicro Conference on Software Engineering and Advanced Applications, pp. 266–273. IEEE Press, New York (2012)CrossRefGoogle Scholar
  17. 17.
    Poppendieck, M., Poppendieck, T.: Implementing Lean Software Development. Addison-Wesley, New York (2006)Google Scholar
  18. 18.
    Bosch, J., Bosch-Sijtsema, P.: From Integration to Composition: On the Impact of Software Product Lines, Global Development and Ecosystems. Journal of Systems and Software 83, 67–76 (2010)CrossRefGoogle Scholar
  19. 19.
    Olsson, H.H., Bosch, J.: From Opinions to Data-Driven Software R&D: A Multi-case Study on How to Close the “Open Loop” Problem. In: 40th EUROMICRO Conference on Software Engineering and Advanced Applications, pp. 9–16. IEEE Press, New York (2014)Google Scholar
  20. 20.
    Pressman, R., Maxim, B.: Software Engineering: A Practitioner’s Approach. McGraw Hill Education, New York (2014)Google Scholar
  21. 21.
    Ries, E.: The Lean Startup: How Today’s Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses. Crown Publishing, New York (2011)Google Scholar
  22. 22.
    van der Linden, F.J., Dannenberg, R.B., Kamsties, E., Känsälä, K., Obbink, H.: Software Product Family Evaluation. In: Nord, R.L. (ed.) SPLC 2004. LNCS, vol. 3154, pp. 110–129. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  23. 23.
    Runeson, P., Höst, M., Rainer, A., Regnell, B.: Case Study Research in Software Engineering: Guidelines and Examples. John Wiley & Sons, New Jersey (2012)CrossRefGoogle Scholar
  24. 24.
    Yin, R.K.: Case Study Research: Design and Methods. SAGE Publications Inc., California (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Teemu Karvonen
    • 1
  • Lucy Ellen Lwakatare
    • 1
  • Tanja Sauvola
    • 1
  • Jan Bosch
    • 2
  • Helena Holmström Olsson
    • 3
  • Pasi Kuvaja
    • 1
  • Markku Oivo
    • 1
  1. 1.University of OuluOuluFinland
  2. 2.Chalmers University of TechnologyGöteborgSweden
  3. 3.Malmö UniversityMalmöSweden

Personalised recommendations