Skip to main content
Log in

Does agile methodology fit all characteristics of software projects? Review and analysis

  • Published:
Empirical Software Engineering Aims and scope Submit manuscript

Abstract

The agile paradigm for software projects has significantly impacted software development worldwide. It is currently widely accepted as having advantages in accommodating changes due to volatile requirements. However, several aspects of the agile paradigm and its compatibility with various software project characteristics remain empirically under-researched. In this paper, we employ a systematic literature review (SLR) to assess the compatibility of agile methodology with the characteristics of software development projects. We have mapped the characteristics to create a two-dimensional decision-making framework comprised of the software development life cycle (SDLC) phases (the y-axis) and knowledge areas derived from the Project Management Body of Knowledge (PMBOK) (the x-axis). We have then explored the position-sentiment regarding each cell of the decision-making framework as it is expressed in a wide set of academic articles, to help researchers and practitioners evaluate the compatibility of the agile methodology with the software project they are dealing with. Predictably, this would assist them in effectively assigning the agile methodology to suitable projects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Abrahamsson P, Salo O, Ronkainen J, Warsta J (2002) Agile software development methods: review and analysis. arXiv preprint arXiv:1709.08439

  • Abrahamsson P, Salo O, Ronkainen J, Warsta J (2017) Agile software development methods: Review and analysis. arXiv preprint arXiv:1709.08439

  • Abrahamsson P, Warsta J, Siponen MT, Ronkainen J (2003) New directions on agile methods: a comparative analysis. In: Proceedings of the 25th international conference on software engineering. IEEE, pp 244–254

    Google Scholar 

  • Abrahamsson P, Babar MA, Kruchten P (2010) Agility and architecture: can they coexist? IEEE Softw 27(2):16–22

    Article  Google Scholar 

  • Ahimbisibwe A, Cavana RY, Daellenbach U (2015) A contingency fit model of critical success factors for software development projects: a comparison of agile and traditional plan-based methodologies. J Enterp Inf Manag

  • Ahmad S, Mallick DN, Schroeder RG (2013) New product development: impact of project characteristics and development practices on performance. J Prod Innov Manag 30(2):331–348

    Article  Google Scholar 

  • Alaidaros H, Omar M, Romli R (2019) The key factors of evaluating agile approaches: a systematic literature review. Int J Supply Chain Manag 8(2):1–11

    Google Scholar 

  • Alami A, Krancher O (2022) How scrum adds value to achieving software quality? Empir Softw Eng 27(7):165

    Article  Google Scholar 

  • Alqudah MK, Razali R (2017) Key factors for selecting an agile method: a systematic literature review. Int J Adv Sci Eng Inf Technol 7(2):526–537

    Article  Google Scholar 

  • Al-Saqqa S, Sawalha S, AbdelNabi H (2020) Agile software development: methodologies and trends. Int J Interact Mob Technol 14(11):246–270

    Article  Google Scholar 

  • Alzoubi Y, Gill A (2021) The critical communication challenges between geographically distributed agile development teams: empirical findings. IEEE Trans Prof Commun 64(4):322–337

    Article  Google Scholar 

  • Ambler SW, Lines M (2012) Disciplined agile delivery: a practitioner's guide to agile software delivery in the enterprise. IBM press

    Google Scholar 

  • Axelsson J, Skoglund M (2016) Quality assurance in software ecosystems: a systematic literature mapping and research agenda. J Syst Softw 114:69–81

    Article  Google Scholar 

  • Babar MA, Brown AW, Mistrík I (eds) (2013) Agile software architecture: aligning agile processes and software architectures. Newnes

    Google Scholar 

  • Bass JM (2016) Artefacts and agile method tailoring in large-scale offshore software development programmes. Inf Softw Technol 75:1–16

    Article  Google Scholar 

  • Bass JM, Allison IK, Banerjee U (2013) Agile method tailoring in a CMMI level 5 organization. J Int Technol Inf Manag 22(4):5

    Google Scholar 

  • Batra D, Xia W, VanderMeer D, Dutta K (2010) Balancing agile and structured development approaches to successfully manage large distributed software projects: a case study from the cruise line industry. Commun Assoc Inf Syst 27(1):21

    Google Scholar 

  • Batra D, Xia W, Zhang M (2017) Collaboration in agile software development: concept and dimensions. Commun Assoc Inf Syst 41(1):20

    Google Scholar 

  • Beck K (2000) Extreme programming explained: embrace change. Addison-Wesley Longman Publishing, Boston

    Google Scholar 

  • Beck K, Beedle M, Van Bennekum A, Cockburn A, Cunningham W, Fowler M, ..., Thomas D (2001) Manifesto for agile software development

  • Beecham S, Clear T, Lal R, Noll J (2021) Do scaling agile frameworks address global software development risks? An empirical study. J Syst Softw 171:110823

    Article  Google Scholar 

  • Behutiye W, Rodríguez P, Oivo M, Aaramaa S, Partanen J, Abhervé A (2022) Towards optimal quality requirement documentation in agile software development: a multiple case study. J Syst Softw 183:111112

    Article  Google Scholar 

  • Berłowski J, Chruściel P, Kasprzyk M, Konaniec I, Jureczko M (2016) Highly automated agile testing process: an industrial case study. e-Informatica Software Engineering Journal 10(1)

  • Boehm B (2002) Get ready for agile methods, with care. Computer 35(1):64–69

    Article  Google Scholar 

  • Boehm B, Turner R (2004) Balancing agility and discipline: Evaluating and integrating Agile and plan-driven methods. In: Proceedings. 26th International Conference on Software Engineering. IEEE, pp 718–719

    Chapter  Google Scholar 

  • Borque P, Fairley R (2014) Guide to the software engineering body of knowledge version 3.0. IEEE Computer Society Staff

    Google Scholar 

  • Campanelli AS, Parreiras FS (2015) Agile methods tailoring–a systematic literature review. J Syst Softw 110:85–100

    Article  Google Scholar 

  • Capilla R, Jansen A, Tang A, Avgeriou P, Babar MA (2016) 10 years of software architecture knowledge management: practice and future. J Syst Softw 116:191–205

    Article  Google Scholar 

  • Chan FK, Thong JY (2009) Acceptance of agile methodologies: a critical review and conceptual framework. Decis Support Syst 46(4):803–814

    Article  Google Scholar 

  • Chow T, Cao DB (2008) A survey study of critical success factors in agile software projects. J Syst Softw 81(6):961–971

    Article  Google Scholar 

  • CMMI Institute (2018) Introducing CMMI® V2.0. Retrieved from https://cmmiinstitute.com/cmmi. Accessed May 2023

  • Cockburn A (2004) Crystal clear: a human-powered methodology for small teams. Addison-Wesley Longman Publishing, Boston

    Google Scholar 

  • Conforto EC, Amaral DC, da Silva SL, Di Felippo A, Kamikawachi DSL (2016) The agility construct on project management theory. Int J Proj Manag 34(4):660–674

    Article  Google Scholar 

  • Coram M, Bohner S (2005) The impact of agile methods on software project management. In: 12th IEEE international conference and workshops on the engineering of computer-based systems (ECBS'05). IEEE, pp 363–370

    Chapter  Google Scholar 

  • Cornide-Reyes H, Riquelme F, Noel R, Villarroel R, Cechinel C, Letelier P, Munoz R (2021) Key skills to work with agile frameworks in software engineering: Chilean perspectives. IEEE Access 9:84724–84738

    Article  Google Scholar 

  • Dikert K, Paasivaara M, Lassenius C (2016) Challenges and success factors for large-scale agile transformations: a systematic literature review. J Syst Softw 119:87–108

    Article  Google Scholar 

  • Dingsøyr T, Moe NB, Fægri TE, Seim EA (2018) Exploring software development at the very large-scale: a revelatory case study and research agenda for Agile method adaptation. Empir Softw Eng 23:490–520

    Article  Google Scholar 

  • Drury M, Conboy K, Power K (2012) Obstacles to decision making in agile software development teams. J Syst Softw 85(6):1239–1254

    Article  Google Scholar 

  • Dvir D, Lipovetsky S, Shenhar A, Tishler A (1998) In search of project classification: a non-universal approach to project success factors. Res Policy 27(9):915–935

    Article  Google Scholar 

  • Dybå T, Dingsøyr T (2008) Empirical studies of agile software development: a systematic review. Inf Softw Technol 50(9):833–859

    Article  Google Scholar 

  • Dyba T, Dingsoyr T, Hanssen GK (2007) Applying systematic reviews to diverse study types: an experience report. In: First international symposium on empirical software engineering and measurement (ESEM 2007). IEEE, pp 225–234

    Chapter  Google Scholar 

  • Dyck S, Majchrzak TA (2012) Identifying common characteristics in fundamental, integrated, and agile software development methodologies. In: 2012 45th Hawaii international conference on system sciences. IEEE, pp 5299–5308

    Chapter  Google Scholar 

  • Felsing JM, Palmer SR (2002) A practical guide to feature-driven development. IEEE Softw 7:67–72

    Google Scholar 

  • Gartner Inc. (2019) Gartner Says Global IT Spending to Grow 1.1 Percent in 2019. STAMFORD, Conn. Retrieved from https://www.gartner.com/en/newsroom/press-releases/2019-04-17-gartner-says-global-it-spending-to-grow-1-1-percent-i. Accessed May 2023

  • Gehlenborg N, Wong B (2012) Points of view: heat maps. Nat Methods 9:213

    Article  Google Scholar 

  • Ghobadi S, Mathiassen L (2016) Perceived barriers to effective knowledge sharing in agile software teams. Inf Syst J 26(2):95–125

    Article  Google Scholar 

  • Gilb T (2005) Competitive engineering: a handbook for systems engineering, requirements engineering, and software engineering using Planguage. Butterworth-Heinemann, Oxford

    Google Scholar 

  • Glass RL (2004) Matching methodology to problem domain. Commun ACM 47(5):19–21

    Article  Google Scholar 

  • Heeager LT, Rose J (2015) Optimising agile development practices for the maintenance operation: nine heuristics. Empir Softw Eng 20(6):1762–1784

    Article  Google Scholar 

  • Highsmith J (2001) The great methodologies debate part I: opening statement. Cutter IT J 14(12):2–4

    Google Scholar 

  • Hoda R, Kruchten P, Noble J, Marshall S (2010) Agility in context. In: Proceedings of the ACM international conference on object oriented programming systems languages and applications, pp 74–88

    Chapter  Google Scholar 

  • Howell D, Windahl C, Seidel R (2010) A project contingency framework based on uncertainty and its consequences. Int J Proj Manag 28(3):256–264

    Article  Google Scholar 

  • Huo M, Verner J, Zhu L, Babar MA (2004) Software quality and agile methods. In: Proceedings of the 28th annual international computer software and applications conference, 2004. COMPSAC 2004. IEEE, pp 520–525

    Google Scholar 

  • Jalali S, Wohlin C (2012a) Global software engineering and agile practices: a systematic review. J Softw: Evol Process 24(6):643–659

    Google Scholar 

  • Jalali S, Wohlin C (2012b) Systematic literature studies: database searches vs. backward snowballing. In: Proceedings of the 2012 ACM-IEEE international symposium on empirical software engineering and measurement. IEEE, pp 29–38

    Chapter  Google Scholar 

  • Kajko-Mattsson M, Nyfjord J (2009) A model of Agile evolution and maintenance process. In: 2009 42nd Hawaii International Conference on System Sciences. IEEE, pp 1–10

    Google Scholar 

  • Karhapää P, Behutiye W, Rodríguez P, Oivo M, Costal D, Franch X, ... Abherve A (2021) Strategies to manage quality requirements in agile software development: a multiple case study. Empir Softw Eng 26(2):28

  • Kasauli R, Knauss E, Horkoff J, Liebel G, de Oliveira Neto FG (2021) Requirements engineering challenges and practices in large-scale agile system development. J Syst Softw 172:110851

    Article  Google Scholar 

  • Kitchenham B, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering. Version 2.3 University of keele (software engineering group, school of computer science and mathematics) and Durham. Department of Computer Science, UK

  • Korhonen K (2013) Evaluating the impact of an agile transformation: a longitudinal case study in a distributed context. Softw Qual J 21(4):599–624

    Article  Google Scholar 

  • Kropp M, Meier A, Biddle R (2016) Agile practices, collaboration and experience. Product-focused software process improvement, pp 416–431

  • Kula E, Greuter E, Van Deursen A, Gousios G (2021) Factors affecting on-time delivery in large-scale agile software development. IEEE Trans Softw Eng 48(9):3573–3592

    Article  Google Scholar 

  • Larman C, Vodde B (2016) Large-scale scrum: more with LeSS. Addison-Wesley Professional

    Google Scholar 

  • Larusdottir M, Gulliksen J, Cajander Å (2017) A license to kill–improving UCSD in Agile development. J Syst Softw 123:214–222

    Article  Google Scholar 

  • Lee G, Xia W (2010) Toward agile: an integrated analysis of quantitative and qualitative field data on software development agility. MIS Q 34(1):87–114

    Article  Google Scholar 

  • Leffingwell D (2016) SAFe 4.0 reference guide: scaled agile framework for lean software and systems engineering. Addison-Wesley Professional, Indianapolis

    Google Scholar 

  • Lehman MM (1996) Laws of software evolution revisited. In: Software process technology: 5th European workshop, EWSPT'96 Nancy, France, October 9–11, 1996 proceedings 5. Springer Berlin Heidelberg, pp 108–124

    Chapter  Google Scholar 

  • Lehman TJ, Sharma A (2011) Software development as a service: agile experiences. In: Annual SRII global conference. IEEE, pp 749–758

    Google Scholar 

  • Lenarduzzi V, Sillitti A, Taibi D (2017) Analyzing forty years of software maintenance models. In: 2017 IEEE/ACM 39th international conference on software engineering companion (ICSE-C). IEEE, pp 146–148

    Chapter  Google Scholar 

  • Lindsjørn Y, Sjøberg DI, Dingsøyr T, Bergersen GR, Dybå T (2016) Teamwork quality and project success in software development: a survey of agile development teams. J Syst Softw 122:274–286

    Article  Google Scholar 

  • Martini A, Bosch J, Chaudron M (2015) Investigating architectural technical debt accumulation and refactoring over time: a multiple-case study. Inf Softw Technol 67:237–253

    Article  Google Scholar 

  • McLeod L, Doolin B, MacDonell SG (2012) A perspective-based understanding of project success. Proj Manag J 43(5):68–86

    Article  Google Scholar 

  • Melo CDO, Cruzes DS, Kon F, Conradi R (2013) Interpretative case studies on agile team productivity and management. Inf Softw Technol 55(2):412–427

    Article  Google Scholar 

  • Meredith J, Zwikael O (2019) When is a project successful?. IEEE Eng Manag Rev 47(3):127–134

  • Mishra D, Mishra A, Ostrovska S (2012) Impact of physical ambiance on communication, collaboration and coordination in agile software development: an empirical evaluation. Inf Softw Technol 54(10):1067–1078

    Article  Google Scholar 

  • Moe NB, Aurum A, Dybå T (2012) Challenges of shared decision-making: a multiple case study of agile software development. Inf Softw Technol 54(8):853–865

    Article  Google Scholar 

  • Moe NB et al (2015) Continuous software testing in a globally distributed project. In: 2015 IEEE 10th international conference on global software engineering. IEEE

    Google Scholar 

  • Muhammad A, Siddique A, Naveed QN, Saleem U, Hasan MA, Shahzad B (2021) Investigating crucial factors of agile software development through composite approach. Intelligent Automation & Soft Computing 27(1)

  • Naldi M (2019) A review of sentiment computation methods with R packages. arXiv preprint arXiv:1901.08319

  • Nurdiani I, Börstler J, Fricker SA (2016) The impacts of agile and lean practices on project constraints: a tertiary study. J Syst Softw 119:162–183

    Article  Google Scholar 

  • Petersen K, Wohlin C (2009) A comparison of issues and advantages in agile and incremental development between state of the art and an industrial case. J Syst Softw 82(9):1479–1490

    Article  Google Scholar 

  • Petersen K, Vakkalanka S, Kuzniarz L (2015) Guidelines for conducting systematic mapping studies in software engineering: an update. Inf Softw Technol 64:1–18

    Article  Google Scholar 

  • PMI (2017) A guide to the Project Management body of knowledge (PMBOK guide), 6th edn. Project Management Institute

    Google Scholar 

  • Rahy S, Bass JM (2022) Managing non-functional requirements in agile software development. IET Softw 16(1):60–72

    Article  Google Scholar 

  • Ramesh B, Cao L, Baskerville R (2010) Agile requirements engineering practices and challenges: an empirical study. Inf Syst J 20(5):449–480

    Article  Google Scholar 

  • Ramesh B, Mohan K, Cao L (2012) Ambidexterity in agile distributed development: an empirical investigation. Inf Syst Res 23(2):323–339

    Article  Google Scholar 

  • Rinker T (2017) Package ‘sentimentr’. Retrieved, 8, 31

  • Russo D (2021) The agile success model: a mixed-methods study of a large-scale agile transformation. ACM Trans Softw Eng Methodol 30(4):1–46

    Article  Google Scholar 

  • Salija K, Hidayat R, Patak AA (2016) Mendeley impact on scientific writing: thematic analysis. International Journal on Advanced Science Engineering Information Technology 6(5)

  • Santos A, Vegas S, Dieste O, Uyaguari F, Tosun A, Fucci D ... Juristo N (2021) A family of experiments on test-driven development. Empir Softw Eng 26:1–53

  • Schwaber K, Beedle M (2002) Agile software development with scrum, vol 1. Prentice Hall, Upper Saddle River

    MATH  Google Scholar 

  • Serrador P, Pinto JK (2015) Does agile work?—a quantitative analysis of agile project success. Int J Proj Manag 33(5):1040–1051

    Article  Google Scholar 

  • Sharif B, Khan SA, Bhatti MW (2012) Measuring the impact of changing requirements on software project cost: an empirical investigation. Int J Comput Sci Issues 9(3):170

    Google Scholar 

  • Sheffield J, Lemétayer J (2013) Factors associated with the software development agility of successful projects. Int J Proj Manag 31(3):459–472

    Article  Google Scholar 

  • Shenhar AJ, Dvir D (2007) Reinventing project management: the diamond approach to successful growth and innovation. Harvard Business Review Press

    Google Scholar 

  • Silva FS, Soares FSF, Peres AL, de Azevedo IM, Vasconcelos APL, Kamei FK, de Lemos Meira SR (2015) Using CMMI together with agile software development: a systematic review. Inf Softw Technol 58:20–43

    Article  Google Scholar 

  • Smite D, Gencel C (2009) Why a CMMI level 5 company fails to meet the deadlines?. In: Product-focused software process improvement: 10th International Conference, PROFES 2009, Oulu, Finland, June 15–17, 2009. Proceedings 10. Springer Berlin Heidelberg, pp 87–95

  • Sommerville I (2016) Software engineering, 10th edn. Addison-Wesley, Pearson Education

    MATH  Google Scholar 

  • Standards Coordinating Committee of the Computer Society (1990) IEEE Standard Glossary of Software Engineering Terminology. vol IEEE Standard 610.12. Los Alamitos

  • Stapleton J (ed) (2003) DSDM: business focused development. Pearson Education, London

    Google Scholar 

  • Stavru S (2014) A critical examination of recent industrial surveys on agile method usage. J Syst Softw 94:87–97

    Article  Google Scholar 

  • Stray V, Florea R, Paruch L (2022) Exploring human factors of the agile software tester. Softw Qual J 30(2):455–481

    Article  Google Scholar 

  • Sutherland J, Jakobsen CR, Johnson K (2008) Scrum and CMMI level 5: the magic potion for code warriors. In: Proceedings of the 41st annual Hawaii international conference on system sciences (HICSS 2008). IEEE, p 466

    Chapter  Google Scholar 

  • Tam C, da Costa Moura EJ, Oliveira T, Varajão J (2020) The factors influencing the success of on-going agile software development projects. Int J Proj Manag 38(3):165–176

    Article  Google Scholar 

  • Tavares BG, Keil M, Sanches da Silva CE, de Souza AD (2021) A risk management tool for agile software development. J Comput Inf Syst 61(6):561–570

    Google Scholar 

  • Team, C. P (2010) CMMI® for services, version 1.3. CMU SEI, Nov-2010

    Google Scholar 

  • Tessem B (2017) The customer effect in agile system development projects. A process tracing case study. Procedia Comput Sci 121:244–251

    Article  Google Scholar 

  • The Standish Group (2020) Standish group Chaos report. Retrieved from https://www.standishgroup.com/. Accessed May 2023

  • Tiky YT (2016) Software development life cycle. The Hongkong University of Science and Technology, Hongkong

    Google Scholar 

  • Tiwana A, Keil M (2004) The one-minute risk assessment tool. Commun ACM 47(11):73–77

    Article  Google Scholar 

  • Traini L (2022) Exploring performance assurance practices and challenges in agile software development: an ethnographic study. Empir Softw Eng 27(3):74

    Article  Google Scholar 

  • Trendowicz A, Münch J (2009) Factors influencing software development productivity—state-of-the-art and industrial experiences. Adv Comput 77:185–241

    Article  Google Scholar 

  • Turetken O, Stojanov I, Trienekens JJ (2017) Assessing the adoption level of scaled Agile development: a maturity model for scaled Agile framework. J Softw Evol Process 29(6):e1796

    Article  Google Scholar 

  • Van Wessel RM, Kroon P, De Vries HJ (2021) Scaling agile company-wide: the organizational challenge of combining agile-scaling frameworks and Enterprise architecture in service companies. IEEE Trans Eng Manag 69(6):3489–3502

    Article  Google Scholar 

  • VersionOne, Inc, The annual “state of agile development” survey, 2007–2019

  • Wafa R, Khan MQ, Malik F, Abdusalomov AB, Cho YI, Odarchenko R (2022) The impact of agile methodology on project success, with a moderating role of Person’s job fit in the IT industry of Pakistan. Appl Sci 12(21):10698

    Article  Google Scholar 

  • Yang LR, Huang CF, Wu KS (2011) The association among project manager's leadership style, teamwork and project success. Int J Proj Manag 29(3):258–267

    Article  Google Scholar 

  • Yang C, Liang P, Avgeriou P (2016) A systematic mapping study on the combination of software architecture and agile development. J Syst Softw 111:157–184

    Article  Google Scholar 

  • Young DK, Beebe NL, Dietrich G, Liu CZ (2016) An empirical examination of an agile contingent project/method fit model. Commun Assoc Inf Syst 39(1):14

    Google Scholar 

  • Zwikael O, Meredith JR, Smyrk J (2019) The responsibilities of the project owner in benefits realization. Int J Oper Prod Manag 39(4):503–524

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gelbard Roy.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Communicated by: Daniel Méndez

Appendices

Appendix 1: SLR - Primary Studies

  1. [S1]

    Hoda, R., Kruchten, P., Noble, J., & Marshall, S. (2010, October). Agility in context. In Proceedings of the ACM international conference on Object oriented programming systems languages and applications (pp. 74–88).

  2. [S2]

    Mangalaraj, G., Mahapatra, R., & Nerur, S. (2009). Acceptance of software process innovations–the case of extreme programming. European Journal of Information Systems, 18(4), 344–354.

  3. [S3]

    Petersen, K., & Wohlin, C. (2009). A comparison of issues and advantages in agile and incremental development between state of the art and an industrial case. Journal of systems and software, 82(9), 1479–1490.

  4. [S4]

    Misra, S. C., Kumar, V., & Kumar, U. (2009). Identifying some important success factors in adopting agile software development practices. Journal of Systems and Software, 82(11), 1869–1890.

  5. [S5]

    Lee, G., & Xia, W. (2010). Toward agile: an integrated analysis of quantitative and qualitative field data on software development agility. MIS quarterly, 34(1), 87–114.

  6. [S6]

    Moe, N. B., Dingsøyr, T., & Dybå, T. (2010). A teamwork model for understanding an agile team: A case study of a Scrum project. Information and Software Technology, 52(5), 480–491.

  7. [S7]

    Ramesh, B., Cao, L., & Baskerville, R. (2010). Agile requirements engineering practices and challenges: an empirical study. Information Systems Journal, 20(5), 449–480.

  8. [S8]

    Laanti, M., Salo, O., & Abrahamsson, P. (2011). Agile methods rapidly replacing traditional methods at Nokia: A survey of opinions on agile transformation. Information and Software Technology, 53(3), 276–290.

  9. [S9]

    Conboy, K., Coyle, S., & Wang, X. (2010). People over Process: Key Challenges in Agile Development,(99), 48–57.

  10. [S10]

    Vlaanderen, K., Jansen, S., Brinkkemper, S., & Jaspers, E. (2011). The agile requirements refinery: Applying SCRUM principles to software product management. Information and software technology, 53(1), 58–70.

  11. [S11]

    Kautz, K. (2011). Investigating the design process: participatory design in agile software development. Information Technology & People.

  12. [S12]

    Pikkarainen, M., Salo, O., Kuusela, R., & Abrahamsson, P. (2012). Strengths and barriers behind the successful agile deployment—insights from the three software intensive companies in Finland. Empirical software engineering, 17(6), 675–702.

  13. [S13]

    Sletholt, M. T., Hannay, J. E., Pfahl, D., & Langtangen, H. P. (2011). What do we know about scientific software development’s agile practices?. Computing in Science & Engineering, 14(2), 24–37.

  14. [S14]

    Drury, M., Conboy, K., & Power, K. (2012). Obstacles to decision making in Agile software development teams. Journal of Systems and Software, 85(6), 1239–1254.

  15. [S15]

    Senapathi, M., & Srinivasan, A. (2012). Understanding post-adoptive agile usage: An exploratory cross-case analysis. Journal of Systems and Software, 85(6), 1255–1268.

  16. [S16]

    Concas, G., Marchesi, M., Destefanis, G., & Tonelli, R. (2012). An empirical study of software metrics for assessing the phases of an agile project. International Journal of Software Engineering and Knowledge Engineering, 22(04), 525–548.

  17. [S17]

    Mishra, D., Mishra, A., & Ostrovska, S. (2012). Impact of physical ambiance on communication, collaboration and coordination in agile software development: An empirical evaluation. Information and software Technology, 54(10), 1067–1078.

  18. [S18]

    Moe, N. B., Aurum, A., & Dybå, T. (2012). Challenges of shared decision-making: A multiple case study of agile software development. Information and Software Technology, 54(8), 853–865.

  19. [S19]

    Jalali, S., & Wohlin, C. (2012). Global software engineering and agile practices: a systematic review. Journal of software: Evolution and Process, 24(6), 643–659.

  20. [S20]

    Ramesh, B., Mohan, K., & Cao, L. (2012). Ambidexterity in agile distributed development: an empirical investigation. Information systems research, 23(2), 323–339.

  21. [S21]

    Melo, C. D. O., Cruzes, D. S., Kon, F., & Conradi, R. (2013). Interpretative case studies on agile team productivity and management. Information and Software Technology, 55(2), 412–427.

  22. [S22]

    Korhonen, K. (2013). Evaluating the impact of an agile transformation: a longitudinal case study in a distributed context. Software Quality Journal, 21(4), 599–624.

  23. [S23]

    Rafique, Y., & Mišić, V. B. (2012). The effects of test-driven development on external quality and productivity: A meta-analysis. IEEE Transactions on Software Engineering, 39(6), 835–856.

  24. [S24]

    Matalonga, S., Solari, M., & Matturro, G. (2013). Factors affecting distributed agile projects: a systematic review. International Journal of Software Engineering and Knowledge Engineering, 23(09), 1289–1301.

  25. [S25]

    Hummel, M., Rosenkranz, C., & Holten, R. (2013). The role of communication in agile systems development. Business & Information Systems Engineering, 5(5), 343–355.

  26. [S26]

    Daneva, M., Van Der Veen, E., Amrit, C., Ghaisas, S., Sikkel, K., Kumar, R., ... & Wieringa, R. (2013). Agile requirements prioritization in large-scale outsourced system projects: An empirical study. Journal of systems and software, 86(5), 1333–1353.

  27. [S27]

    Sundararajan, S., Bhasi, M., & Vijayaraghavan, P. K. (2014). Case study on risk management practice in large offshore-outsourced Agile software projects. IET software, 8(6), 245–257.

  28. [S28]

    Estler, H. C., Nordio, M., Furia, C. A., Meyer, B., & Schneider, J. (2014). Agile vs. structured distributed software development: A case study. Empirical Software Engineering, 19(5), 1197–1224.

  29. [S29]

    Shrivastava, S. V., & Rathod, U. (2014). Risks in distributed agile development: A review. Procedia-Social and Behavioral Sciences, 133, 417–424.

  30. [S30]

    Papatheocharous, E., & Andreou, A. S. (2014). Empirical evidence and state of practice of software agile teams. Journal of Software: Evolution and Process, 26(9), 855–866.

  31. [S31]

    Drury-Grogan, M. L. (2014). Performance on agile teams: Relating iteration objectives and critical decisions to project management success factors. Information and Software Technology, 56(5), 506–515.

  32. [S32]

    Kautz, K., Johansen, T. H., & Uldahl, A. (2014). The perceived impact of the agile development and project management method scrum on information systems and software development productivity.

  33. [S33]

    Hummel, M., Rosenkranz, C., & Holten, R. (2015). The role of social agile practices for direct and indirect communication in information systems development teams. Communications of the Association for Information Systems, 36(1), 15.

  34. [S34]

    Ahimbisibwe, A., Cavana, R. Y., & Daellenbach, U. (2015). A contingency fit model of critical success factors for software development projects: A comparison of agile and traditional plan-based methodologies. Journal of Enterprise Information Management.

  35. [S35]

    Martini, A., Bosch, J., & Chaudron, M. (2015). Investigating Architectural Technical Debt accumulation and refactoring over time: A multiple-case study. Information and Software Technology, 67, 237–253.

  36. [S36]

    Shrivastava, S. V., & Rathod, U. (2015). Categorization of risk factors for distributed agile projects. Information and Software Technology, 58, 373–387.

  37. [S37]

    Heikkilä, V. T., Paasivaara, M., Rautiainen, K., Lassenius, C., Toivola, T., & Järvinen, J. (2015). Operational release planning in large-scale Scrum with multiple stakeholders–A longitudinal case study at F-Secure Corporation. Information and Software Technology, 57, 116–140.

  38. [S38]

    Heeager, L. T., & Rose, J. (2015). Optimising agile development practices for the maintenance operation: nine heuristics. Empirical Software Engineering, 20(6), 1762–1784.

  39. [S39]

    Wale-Kolade, A. Y. (2015). Integrating usability work into a large inter-organisational agile development project: Tactics developed by usability designers. Journal of systems and software, 100, 54–66.

  40. [S40]

    Bjarnason, E., Unterkalmsteiner, M., Borg, M., & Engström, E. (2016). A multi-case study of agile requirements engineering and the use of test cases as requirements. Information and Software Technology, 77, 61–79.

  41. [S41]

    Bass, J. M. (2016). Artefacts and agile method tailoring in large-scale offshore software development programmes. Information and software technology, 75, 1–16.

  42. [S42]

    Ghobadi, S., & Mathiassen, L. (2016). Perceived barriers to effective knowledge sharing in agile software teams. Information systems journal, 26(2), 95–125.

  43. [S43]

    Nurdiani, I., Börstler, J., & Fricker, S. A. (2016). The impacts of agile and lean practices on project constraints: A tertiary study. Journal of Systems and Software, 119, 162–183.

  44. [S44]

    Bissi, W., Neto, A. G. S. S., & Emer, M. C. F. P. (2016). The effects of test driven development on internal quality, external quality and productivity: A systematic review. Information and Software Technology, 74, 45–54.

  45. [S45]

    Yang, C., Liang, P., & Avgeriou, P. (2016). A systematic mapping study on the combination of software architecture and agile development. Journal of Systems and Software, 111, 157–184.

  46. [S46]

    Berłowski, J., Chruściel, P., Kasprzyk, M., Konaniec, I., & Jureczko, M. (2016). Highly automated agile testing process: An industrial case study. e-Informatica Software Engineering Journal, 10(1).

  47. [S47]

    Lindsjørn, Y., Sjøberg, D. I., Dingsøyr, T., Bergersen, G. R., & Dybå, T. (2016). Teamwork quality and project success in software development: A survey of agile development teams. Journal of Systems and Software, 122, 274–286.

  48. [S48]

    Capilla, R., Jansen, A., Tang, A., Avgeriou, P., & Babar, M. A. (2016). 10 years of software architecture knowledge management: Practice and future. Journal of Systems and Software, 116, 191–205.

  49. [S49]

    Young, D. K., Beebe, N. L., Dietrich, G., & Liu, C. Z. (2016). An Empirical Examination of an Agile Contingent Project/Method Fit Model. Communications of the Association for Information Systems, 39(1), 14.

  50. [S50]

    Gregory, P., Barroca, L., Sharp, H., Deshpande, A., & Taylor, K. (2016). The challenges that challenge: Engaging with agile practitioners’ concerns. Information and Software Technology, 77, 92–104.

  51. [S51]

    Dikert, K., Paasivaara, M., & Lassenius, C. (2016). Challenges and success factors for large-scale agile transformations: A systematic literature review. Journal of Systems and Software, 119, 87–108.

  52. [S52]

    Chen, J., Xiao, J., Wang, Q., Osterweil, L. J., & Li, M. (2016). Perspectives on refactoring planning and practice: an empirical study. Empirical Software Engineering, 21(3), 1397–1436.

  53. [S53]

    Yagüe, A., Garbajosa, J., Díaz, J., & González, E. (2016). An exploratory study in communication in Agile Global Software Development. Computer Standards & Interfaces, 48, 184–197.

  54. [S54]

    Drury-Grogan, M. L., Conboy, K., & Acton, T. (2017). Examining decision characteristics & challenges for agile software development. Journal of Systems and Software, 131, 248–265.

  55. [S55]

    Gren, L., Torkar, R., & Feldt, R. (2017). Group development and group maturity when building agile teams: A qualitative and quantitative investigation at eight large companies. Journal of Systems and Software, 124, 104–119.

  56. [S56]

    Murphy-Hill, E., & Black, A. P. (2008, May). Breaking the barriers to successful refactoring: observations and tools for extract method. In Proceedings of the 30th international conference on Software engineering (pp. 421–430).

  57. [S57]

    Heikkilä, V. T., Paasivaara, M., Lasssenius, C., Damian, D., & Engblom, C. (2017). Managing the requirements flow from strategy to release in large-scale agile development: a case study at Ericsson. Empirical Software Engineering, 22(6), 2892–2936.

  58. [S58]

    Borrego, G., Morán, A. L., Cinco, R. R. P., Rodríguez-Elias, O. M., & García-Canseco, E. (2017). Review of approaches to manage architectural knowledge in Agile Global Software Development. IET Software, 11(3), 77–88.

  59. [S59]

    Lei, H., Ganjeizadeh, F., Jayachandran, P. K., & Ozcan, P. (2017). A statistical analysis of the effects of Scrum and Kanban on software development projects. Robotics and Computer-Integrated Manufacturing, 43, 59–67.

  60. [S60]

    Tessem, B. (2017). The customer effect in agile system development projects. A process tracing case study. Procedia computer science, 121, 244–251.

  61. [S61]

    Schön, E. M., Thomaschewski, J., & Escalona, M. J. (2017). Agile Requirements Engineering: A systematic literature review. Computer Standards & Interfaces, 49, 79–91.

  62. [S62]

    Alahyari, H., Svensson, R. B., & Gorschek, T. (2017). A study of value in agile software development organizations. Journal of Systems and Software, 125, 271–288.

  63. [S63]

    Alqudah, M. K., & Razali, R. (2017). Key factors for selecting an Agile method: A systematic literature review. International Journal on Advanced Science, Engineering and Information Technology, 7(2), 526–537.

  64. [S64]

    Larusdottir, M., Gulliksen, J., & Cajander, Å. (2017). A license to kill–Improving UCSD in Agile development. Journal of Systems and Software, 123, 214–222.

  65. [S65]

    Batra, D., Xia, W., & Zhang, M. (2017). Collaboration in agile software development: Concept and dimensions. Communications of the Association for Information Systems, 41(1), 20.

  66. [S66]

    Curcio, K., Navarro, T., Malucelli, A., & Reinehr, S. (2018). Requirements engineering: A systematic mapping study in agile software development. Journal of Systems and Software, 139, 32–50.

  67. [S67]

    Batra, D. (2018). Agile values or plan-driven aspects: Which factor contributes more toward the success of data warehousing, business intelligence, and analytics project development?. Journal of Systems and Software, 146, 249–262.

  68. [S68]

    Medeiros, J., Vasconcelos, A., Silva, C., & Goulão, M. (2018). Quality of software requirements specification in agile projects: A cross-case analysis of six companies. Journal of Systems and Software, 142, 171–194.

  69. [S69]

    Ochodek, M., & Kopczyńska, S. (2018). Perceived importance of agile requirements engineering practices–a survey. Journal of Systems and Software, 143, 29–43.

  70. [S70]

    George, J. F., Scheibe, K., Townsend, A. M., & Mennecke, B. (2018). The amorphous nature of agile: no one size fits all. Journal of Systems and Information Technology.

  71. [S71]

    Tolfo, C., Wazlawick, R. S., Ferreira, M. G. G., & Forcellini, F. A. (2018). Agile practices and the promotion of entrepreneurial skills in software development. Journal of Software: Evolution and Process, 30(9), e1945.

  72. [S72]

    Patanakul, P., & Rufo-McCarron, R. (2018). Transitioning to agile software development: Lessons learned from a government-contracted program. The Journal of High Technology Management Research, 29(2), 181–192.

  73. [S73]

    Kaikkonen, H., Haapasalo, H., & Hänninen, K. (2018). Characteristics of self-managing teams in rapid product development projects. International Journal of Value Chain Management, 9(1), 1–25.

  74. [S74]

    Usman, M., Britto, R., Damm, L. O., & Börstler, J. (2018). Effort estimation in large-scale software development: An industrial case study. Information and Software technology, 99, 21–40.

  75. [S75]

    Akerele, O. (2018). System dynamics modelling of the impact of agile practice on the quality of continuous delivery projects. Innovations in Systems and Software Engineering, 14(3), 183–208.

  76. [S76]

    Gren, L., Knauss, A., & Stettina, C. J. (2018). Non-technical individual skills are weakly connected to the maturity of agile practices. Information and Software Technology, 99, 11–20.

  77. [S77]

    Vallon, R., da Silva Estacio, B. J., Prikladnicki, R., & Grechenig, T. (2018). Systematic literature review on agile practices in global software development. Information and Software Technology, 96, 161–180.

  78. [S78]

    Cram, W. A., & Marabelli, M. (2018). Have your cake and eat it too? Simultaneously pursuing the knowledge-sharing benefits of agile and traditional development approaches. Information & Management, 55(3), 322–339.

  79. [S79]

    Akbar, M. A., Sang, J., Khan, A. A., Amin, F. E., Hussain, S., Sohail, M. K., ... & Cai, B. (2018). Statistical analysis of the effects of heavyweight and lightweight methodologies on the six-pointed star model. IEEE Access, 6, 8066–8079.

  80. [S80]

    Dingsøyr, T., Moe, N. B., Fægri, T. E., & Seim, E. A. (2018). Exploring software development at the very large-scale: a revelatory case study and research agenda for agile method adaptation. Empirical Software Engineering, 23(1), 490–520.

  81. [S81]

    Paasivaara, M., Behm, B., Lassenius, C., & Hallikainen, M. (2018). Large-scale agile transformation at Ericsson: a case study. Empirical Software Engineering, 23(5), 2550–2596.

  82. [S82]

    Matkovic, P., Maric, M., Tumbas, P., & Sakal, M. (2018). Traditionalisation of agile processes: Architectural aspects. Computer Science and Information Systems, 15(1), 79–109.

  83. [S83]

    Özcan-Top, Ö., & McCaffery, F. (2019). To what extent the medical device software regulations can be achieved with agile software development methods? XP—DSDM—Scrum. Journal of Supercomputing, 75(8).

  84. [S84]

    Tavares, B. G., da Silva, C. E. S., & de Souza, A. D. (2019). Practices to improve risk management in agile projects. International Journal of Software Engineering and Knowledge Engineering, 29(03), 381–399.

  85. [S85]

    Abrar, M. F., Khan, M. S., Ali, S., Ali, U., Majeed, M. F., Ali, A., ... & Rasheed, N. (2019). Motivators for large-scale agile adoption from management perspective: A systematic literature review. Ieee Access, 7, 22,660–22,674.

  86. [S86]

    Bakhtiary, V., Gandomani, T. J., & Salajegheh, A. (2020). The effectiveness of test-driven development approach on software projects: A multi-case study. Bulletin of Electrical Engineering and Informatics, 9(5), 2030–2037.

  87. [S87]

    Shameem, M., Khan, A. A., Hasan, M. G., & Akbar, M. A. (2020). Analytic hierarchy process based prioritisation and taxonomy of success factors for scaling agile methods in global software development. IET Software, 14(4), 389–401.

  88. [S88]

    Alzoubi, Y. I., & Gill, A. Q. (2020). An Empirical Investigation of Geographically Distributed Agile Development: The Agile Enterprise Architecture is a Communication Enabler. IEEE Access, 8, 80,269–80,289.

  89. [S89]

    Alsaqaf, W., Daneva, M., & Wieringa, R. (2019). Quality requirements challenges in the context of large-scale distributed agile: An empirical study. Information and software technology, 110, 39–55.

  90. [S90]

    Serrador, P., & Pinto, J. K. (2015). Does Agile work?—A quantitative analysis of agile project success. International journal of project management, 33(5), 1040–1051.

  91. [S91]

    Sheffield, J., & Lemétayer, J. (2013). Factors associated with the software development agility of successful projects. International Journal of Project Management, 31(3), 459–472.

  92. [S92]

    Silva, F. S., Soares, F. S. F., Peres, A. L., de Azevedo, I. M., Vasconcelos, A. P. L., Kamei, F. K., & de Lemos Meira, S. R. (2015). Using CMMI together with agile software development: A systematic review. Information and Software Technology, 58, 20–43.

  93. [S93]

    Conforto, E. C., Salum, F., Amaral, D. C., Da Silva, S. L., & De Almeida, L. F. M. (2014). Can agile project management be adopted by industries other than software development?. Project Management Journal, 45(3), 21–34.

  94. [S94]

    Recker, J., Holten, R., Hummel, M., & Rosenkranz, C. (2017). How agile practices impact customer responsiveness and development success: A field study. Project Management Journal, 48(2), 99–121.

  95. [S95]

    Alzoubi, Y. I., Gill, A. Q., & Al-Ani, A. (2016). Empirical studies of geographically distributed agile development communication challenges: A systematic review. Information & Management, 53(1), 22–37.

  96. [S96]

    Santos, A., Vegas, S., Dieste, O., Uyaguari, F., Tosun, A., Fucci, D., ... & Juristo, N. (2021). A family of experiments on test-driven development. Empirical Software Engineering, 26, 1–53.

  97. [S97]

    Beecham, S., Clear, T., Lal, R., & Noll, J. (2021). Do scaling agile frameworks address global software development risks? An empirical study. Journal of Systems and Software, 171, 110,823.

  98. [S98]

    Muhammad, A., Siddique, A., Naveed, Q. N., Saleem, U., Hasan, M. A., & Shahzad, B. (2021). Investigating Crucial Factors of Agile Software Development through Composite Approach. Intelligent Automation & Soft Computing, 27(1).

  99. [S99]

    Cornide-Reyes, H., Riquelme, F., Noel, R., Villarroel, R., Cechinel, C., Letelier, P., & Munoz, R. (2021). Key skills to work with agile frameworks in software engineering: Chilean perspectives. IEEE Access, 9, 84,724–84,738.

  100. [S100]

    Šmite, D., Moe, N. B., & Gonzalez-Huerta, J. (2021). Overcoming cultural barriers to being agile in distributed teams. Information and Software Technology, 138, 106,612.

  101. [S101]

    Kasauli, R., Knauss, E., Horkoff, J., Liebel, G., & de Oliveira Neto, F. G. (2021). Requirements engineering challenges and practices in large-scale agile system development. Journal of Systems and Software, 172, 110,851.

  102. [S102]

    Zaimovic, T., Kozic, M., Efendić, A., & Džanić, A. (2021). Self-Organizing Teams in Software Development–Myth or Reality. TEM Journal, 10(4), 1565.

  103. [S103]

    Karhapää, P., Behutiye, W., Rodríguez, P., Oivo, M., Costal, D., Franch, X., ... & Abherve, A. (2021). Strategies to manage quality requirements in agile software development: a multiple case study. Empirical Software Engineering, 26(2), 28.

  104. [S104]

    Russo, D. (2021). The agile success model: a mixed-methods study of a large-scale agile transformation. ACM Transactions on Software Engineering and Methodology (TOSEM), 30(4), 1–46.

  105. [S105]

    Alzoubi, Y., & Gill, A. (2021). The critical communication challenges between geographically distributed agile development teams: empirical findings. IEEE Transactions on Professional Communication, 64(4), 322–337.

  106. [S106]

    Zaina, L. A., Sharp, H., & Barroca, L. (2021). UX information in the daily work of an agile team: A distributed cognition analysis. International Journal of Human-Computer Studies, 147, 102,574.

  107. [S107]

    Butt, S. A., Khalid, A., Ercan, T., Ariza-Colpas, P. P., Melisa, A. C., Piñeres-Espitia, G., ... & Ortega, R. M. (2022). A software-based cost estimation technique in scrum using a developer’s expertise. Advances in Engineering Software, 171, 103,159.

  108. [S108]

    Spagnoletti, P., Kazemargi, N., & Prencipe, A. (2021). Agile practices and organizational agility in software ecosystems. IEEE Transactions on Engineering Management, 69(6), 3604–3617.

  109. [S109]

    Persson, J. S., Bruun, A., Lárusdóttir, M. K., & Nielsen, P. A. (2022). Agile software development and UX design: A case study of integration by mutual adjustment. Information and Software Technology, 152, 107,059.

  110. [S110]

    Ågren, P., Knoph, E., & Berntsson Svensson, R. (2022). Agile software development one year into the COVID−19 pandemic. Empirical Software Engineering, 27(6), 121.

  111. [S111]

    Hinderks, A., Mayo, F. J. D., Thomaschewski, J., & Escalona, M. J. (2022). Approaches to manage the user experience process in Agile software development: A systematic literature review. Information and Software Technology, 150, 106,957.

  112. [S112]

    Kausar, M., Ishtiaq, M., & Hussain, S. (2021). Distributed Agile Patterns-Using Agile Practices to Solve Offshore Development Issues. IEEE Access, 10, 8840–8854.

  113. [S113]

    Tyagi, S., Sibal, R., & Suri, B. (2022). Empirically developed framework for building trust in distributed agile teams. Information and Software Technology, 145, 106,828.

  114. [S114]

    Moedt, W., Bernsteiner, R. C., Hall, M., & Fruhling, A. L. (2022). Enhancing IoT Project Success through Agile Best Practices. ACM Transactions on Internet of Things.

  115. [S115]

    Cao, L. (2022). Estimating Efforts for Various Activities in Agile Software Development: An Empirical Study. IEEE Access, 10, 83,311–83,321.

  116. [S116]

    Stray, V., Florea, R., & Paruch, L. (2022). Exploring human factors of the agile software tester. Software Quality Journal, 30(2), 455–481.

  117. [S117]

    Traini, L. (2022). Exploring performance assurance practices and challenges in agile software development: an ethnographic study. Empirical Software Engineering, 27(3), 74.

  118. [S118]

    Kula, E., Greuter, E., Van Deursen, A., & Gousios, G. (2021). Factors affecting on-time delivery in large-scale agile software development. IEEE Transactions on Software Engineering, 48(9), 3573–3592.

  119. [S119]

    Alami, A., & Krancher, O. (2022). How Scrum adds value to achieving software quality?. Empirical Software Engineering, 27(7), 165.

  120. [S120]

    Rahy, S., & Bass, J. M. (2022). Managing non-functional requirements in agile software development. IET Software, 16(1), 60–72.

  121. [S121]

    Van Wessel, R. M., Kroon, P., & De Vries, H. J. (2021). Scaling Agile Company-Wide: The Organizational Challenge of Combining Agile-Scaling Frameworks and Enterprise Architecture in Service Companies. IEEE Transactions on Engineering Management, 69(6), 3489–3502.

  122. [S122]

    Dada, O. A., & Sanusi, I. T. (2022). The adoption of Software Engineering practices in a Scrum environment. African Journal of Science, Technology, Innovation and Development, 14(6), 1429–1446.

  123. [S123]

    Wafa, R., Khan, M. Q., Malik, F., Abdusalomov, A. B., Cho, Y. I., & Odarchenko, R. (2022). The Impact of Agile Methodology on Project Success, with a Moderating Role of Person’s Job Fit in the IT Industry of Pakistan. Applied Sciences, 12(21), 10,698.

  124. [S124]

    Behutiye, W., Rodríguez, P., Oivo, M., Aaramaa, S., Partanen, J., & Abhervé, A. (2022). Towards optimal quality requirement documentation in agile software development: a multiple case study. Journal of Systems and Software, 183, 111112.

  125. [S125]

    Altuwaijri, F. S., & Ferrario, M. A. (2022). Factors affecting Agile adoption: An industry research study of the mobile app sector in Saudi Arabia. Journal of Systems and Software, 190, 111347.

  126. [S126]

    Tam, C., da Costa Moura, E. J., Oliveira, T., & Varajão, J. (2020). The factors influencing the success of on-going agile software development projects. International Journal of Project Management, 38(3), 165–176.

Appendix 2

Table 4 Syntax Used for Selection from Electronic Databases

Appendix 3

Table 5 Overview of the Primary Studies

Appendix 4

Table 6 Studies’ Mapping into Decision-Framework based on Sentiment Score

Appendix 5: Description of Calculations in the Decision-Framework Processing

Figures 10, 11 and 12 present three forms of the decision framework as resulted through the data processing steps. The calculations method are also detailed described.

Fig. 10
figure 10

Decision-Making Framework – Number of studies

Fig. 11
figure 11

Decision-Making Framework – Sentiment Score

The calculation method:

  • Let S denotes the primary studies included in this review, namely S = {S1, S2, … S126}.

  • Let P denotes the SLDC phases included in the decision framework, namely P = {Architecture and Design, Development, Quality Assurance, Maintenance, SDLC General}.

  • Let C denotes projects characteristics include in the decision framework, namely, C = {Quality, Complexity, Requirements, Schedule, Budget, Risk, Productivity, Communication, Distribution, Decision-making, Low-Skills, High-Skills, Small-Medium Scale, Large Scale}.

  • Let (P,C) denote cell position within the decision framework.

  • Let POL(s,p,c) denote the sum sentiment score for a study in S associated with the cell (p,c).

First, we generated a decision-making framework with the number of distinct studies for each cell. The calculation for each cell is as follows:

$$\textrm{Number}\ \textrm{of}\ {\textrm{studies}}_{\left(\textrm{P},\textrm{C}\right)}=\mid \left\{\textrm{S}1,\textrm{S}2,\dots, \textrm{S}126\right\}\mid$$

Next, we generated a decision-making framework with the total sentiment score for each cell. Since each study featured a different number of sentiments, studies with a higher number of associated sentiments were presumed to have a greater impact on the final score, thus creating bias. Therefore, we adopted the following procedure to ensure that each study would equally impact the final score by:

  1. 1.

    Calculating the total sentiment score for each cell within the decision-making framework for each of the 126 primary study in {S}, as follows (for the results of this step see Appendix Table 6):

    $$\textrm{POL}\left(\textrm{s},\textrm{p},\textrm{c}\right)=\sum \textrm{Sentiment}\ \textrm{Score}$$
  2. 2.

    POL(s,p,c) normalization to 1,0 and − 1 according to the following conditions:

    1. i.

      If the score total was positive (higher than 0), the score value was set at 1.

    2. ii.

      If the score total was negative (lower than 0), the score value was set at −1.

    3. iii.

      If the score total was neutral (neither positive nor negative), the score value was set at 0.

  3. 3.

    Calculating collectively the total sentiment score for each cell of the primary studies {S}, as follows:

    $$\textrm{Sum}\ \textrm{of}\ \textrm{Sentiment}\ \textrm{Score}\ \left(\textrm{p},\textrm{c}\right)=\sum\nolimits_{s=1}^{126} POL\left(\textrm{s},\textrm{p},\textrm{c}\right)$$

The results of both decision-making frameworks, number of studies, and total sentiment scores were used to generate a decision-making framework that characterizes each cell by one of the classifications presented in Table 2. Following is a description of the classification procedure:

If the number of studies is (P,C) ≤ 5 then set classification as ‘Lack of evidence’, else calculate the following:

\(Cell\ Score\ (CS)=\frac{\textrm{Sum}\ \textrm{of}\ \textrm{Sentiment}\ \textrm{Score}\left(\textrm{p},\textrm{c}\right)\ }{\textrm{Number}\ \textrm{of}\ \textrm{studies}\left(\textrm{p},\textrm{c}\right)}\)  

Fig. 12
figure 12

Decision-Making Framework – Cell Score

Appendix 6: Quality Assessment Checklists

Table 7 presents Dyba et al.’s quality assessment (2007), which was used for non-SLR studies. The scoring values are: “Yes” = 1, “No” = 0 for each screening question. A study that scored “No” on the first screening question or on the second and third screening questions, was excluded as these screening questions represent the minimum quality threshold of the review (Dybå and Dingsøyr 2008).

Table 7 Quality assessment questionnaire used for non-SLR studies (Dyba et al. 2007)

Nurdiani et al.’s quality assessment checklist (2016), that served to assess the SLR studies presented in Table 8. The scoring values were: “Yes” = 1, “Partially” = 0.5, “No” = 0. The authors conducted the quality assessment separately and independently, and later compared and discussed the results to resolve any disagreement points that came up.

Table 8 Quality assessment questionnaire for SLR studies (Nurdiani et al. 2016)

Table 9 presents metadata’ format of the extracted items-studies.

Table 9 Metadata’ format of the extracted studies

Table 10 presents the format used to represent each of the sentiment found. Each study may express a variety of sentiments, each of them is saved in the format defined in the table.

Table 10 The format used to represent each sentiment discovered in the text

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Itzik, D., Roy, G. Does agile methodology fit all characteristics of software projects? Review and analysis. Empir Software Eng 28, 105 (2023). https://doi.org/10.1007/s10664-023-10334-7

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10664-023-10334-7

Keywords

Navigation