Advertisement

Requirements Engineering

, Volume 23, Issue 1, pp 63–95 | Cite as

Empirical research in requirements engineering: trends and opportunities

  • Talat Ambreen
  • Naveed IkramEmail author
  • Muhammad Usman
  • Mahmood Niazi
Original Article

Abstract

Requirements engineering (RE) being a foundation of software development has gained a great recognition in the recent era of prevailing software industry. A number of journals and conferences have published a great amount of RE research in terms of various tools, techniques, methods, and frameworks, with a variety of processes applicable in different software development domains. The plethora of empirical RE research needs to be synthesized to identify trends and future research directions. To represent a state-of-the-art of requirements engineering, along with various trends and opportunities of empirical RE research, we conducted a systematic mapping study to synthesize the empirical work done in RE. We used four major databases IEEE, ScienceDirect, SpringerLink and ACM and Identified 270 primary studies till the year 2012. An analysis of the data extracted from primary studies shows that the empirical research work in RE is on the increase since the year 2000. The requirements elicitation with 22 % of the total studies, requirements analysis with 19 % and RE process with 17 % are the major focus areas of empirical RE research. Non-functional requirements were found to be the most researched emerging area. The empirical work in the sub-area of requirements validation and verification is little and has a decreasing trend. The majority of the studies (50 %) used a case study research method followed by experiments (28 %), whereas the experience reports are few (6 %). A common trend in almost all RE sub-areas is about proposing new interventions. The leading intervention types are guidelines, techniques and processes. The interest in RE empirical research is on the rise as whole. However, requirements validation and verification area, despite its recognized importance, lacks empirical research at present. Furthermore, requirements evolution and privacy requirements also have little empirical research. These RE sub-areas need the attention of researchers for more empirical research. At present, the focus of empirical RE research is more about proposing new interventions. In future, there is a need to replicate existing studies as well to evaluate the RE interventions in more real contexts and scenarios. The practitioners’ involvement in RE empirical research needs to be increased so that they share their experiences of using different RE interventions and also inform us about the current requirements-related challenges and issues that they face in their work.

Keywords

Evidence-based software engineering Requirements engineering Systematic review Mapping study 

References

  1. 1.
    IEEE, International Conference on Requirement Engineering. http://www.requirements-engineering.org/
  2. 2.
    Springer, International Journal of Requirement Engineering. http://www.springer.com/computer/swe/journal/766
  3. 3.
    Nuseibeh B, Easterbrook S (2000) Requirements engineering: a roadmap. In: Proceedings of the conference on the future of software engineering. ACM, pp 35–46Google Scholar
  4. 4.
    Cheng BH, Atlee JM (2007) Research directions in requirements engineering. In: 2007 Future of software engineering. IEEE Computer Society, pp 285–303Google Scholar
  5. 5.
    Davis A, Hickey A, Dieste O, Juristo N, Moreno A (2007) A quantitative assessment of requirements engineering publications—1963–2006. In: Requirements engineering: foundation for software quality. Springer, Berlin, pp 129–143Google Scholar
  6. 6.
    Lami G, Ferguson RW (2007) An empirical study on the impact of automation on the requirements analysis process. J Comput Sci Technol 22(3):338–347CrossRefGoogle Scholar
  7. 7.
    Davis AM, Hickey AM (2002) Requirements researchers: do we practice what we preach? Requir Eng 7(2):107–111CrossRefGoogle Scholar
  8. 8.
    Wieringa RJ, Heerkens JMG (2006) The methodological soundness of requirements engineering papers: a conceptual framework and two case studies. Requir Eng 11(4):295–307CrossRefGoogle Scholar
  9. 9.
    Wasson KS (2004) Requirements metrics: scaling up. In: Proceedings of 2nd international workshop on comparative evaluation in requirements engineering (CERE’04), Kyoto, Japan, pp 51–55Google Scholar
  10. 10.
    Seaman CB (1999) Qualitative methods in empirical studies of software engineering. IEEE Trans Softw Eng 25(4):557–572CrossRefGoogle Scholar
  11. 11.
    Kitchenham BA, Dyba T, Jorgensen M (2004) Evidence-based software engineering. In: Proceedings of the 26th international conference on software engineering. IEEE Computer Society, pp 273–281Google Scholar
  12. 12.
    Ambreen T, Usman M, Ikram N, Bano M (2011) Evidence in requirements engineering: a systematic literature review protocol. In: The Sixth international conference on software engineering advances. ICSEA, pp 576–580Google Scholar
  13. 13.
    Kitchenham B, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering (version 2.3). Technical Report, Keele University and University of DurhamGoogle Scholar
  14. 14.
    Bjørnson FO, Dingsøyr T (2008) Knowledge management in software engineering: a systematic review of studied concepts, findings and research methods used. Inf Softw Technol 50(11):1055–1068CrossRefGoogle Scholar
  15. 15.
    Jorgensen M, Shepperd M (2007) A systematic review of software development cost estimation studies. IEEE Trans Softw Eng 33(1):33–53CrossRefGoogle Scholar
  16. 16.
    Qureshi N, Usman M, Ikram N (2013). Evidence in software architecture, a systematic literature review. In: Proceedings of the 17th international conference on evaluation and assessment in software engineering. ACM, pp 97–106Google Scholar
  17. 17.
    Dieste O, Juristo N (2011) Systematic review and aggregation of empirical studies on elicitation techniques. IEEE Trans Softw Eng 37(2):283–304CrossRefGoogle Scholar
  18. 18.
    Davis A, Dieste O, Hickey A, Juristo N, Moreno AM (2006) Effectiveness of requirements elicitation techniques: empirical results derived from a systematic review. In: 14th IEEE international conference requirements engineering. IEEE, pp 179–188Google Scholar
  19. 19.
    Pacheco C, Garcia I (2012) A systematic literature review of stakeholder identification methods in requirements elicitation. J Syst Softw 85(9):2171–2181CrossRefGoogle Scholar
  20. 20.
    Nicolás J, Toval A (2009) On the generation of requirements specifications from software engineering models: a systematic literature review. Inf Softw Technol 51(9):1291–1307CrossRefGoogle Scholar
  21. 21.
    Condori-Fernandez N, Daneva M, Sikkel K, Wieringa R, Dieste O, Pastor O (2009) A systematic mapping study on empirical evaluation of software requirements specifications techniques. In: Proceedings of the 2009 3rd international symposium on empirical software engineering and measurement. IEEE Computer Society, pp 502–505Google Scholar
  22. 22.
    Amyot D, Mussbacher G (2011) User requirements notation: the first ten years, the next ten years. J Softw 6(5):747–768CrossRefGoogle Scholar
  23. 23.
    Li J, Zhang H, Zhu L, Jeffery R, Wang Q, Li M (2012) Preliminary results of a systematic review on requirements evolution. In: Evaluation & assessment in software engineering (EASE 2012), 16th International Conference on, IET, pp 12–21Google Scholar
  24. 24.
    Herrmann A, Daneva M (2008) Requirements prioritization based on benefit and cost prediction: an agenda for future research. In: 16th IEEE international requirements engineering. RE’08. IEEE, pp 125–134Google Scholar
  25. 25.
    Winkler S, Pilgrim J (2010) A survey of traceability in requirements engineering and model-driven development. Softw Syst Model (SoSyM) 9(4):529–565CrossRefGoogle Scholar
  26. 26.
    Walia GS, Carver JC (2009) A systematic literature review to identify and classify software requirement errors. Inf Softw Technol 51(7):1087–1109CrossRefGoogle Scholar
  27. 27.
    Bano M, Imtiaz S, Ikram N, Niazi M, Usman M (2012) Causes of requirement change—a systematic literature review. In: 16th international conference on evaluation and assessment in software engineering (EASE 2012). IET, pp 22–31Google Scholar
  28. 28.
    Khurum M, Uppalapati N, Veeramachaneni RC (2012) Software requirements triage and selection: state-of-the-art and state-of-practice. In: 2012 19th Asia-Pacific Software Engineering Conference (APSEC), vol 1. IEEE, pp 416–421Google Scholar
  29. 29.
    De Azambuja FB, Bastos RM, Bacelo APT (2009) Systematic review of requirements reuse. In: SEKE, pp 67–72Google Scholar
  30. 30.
    Lopez A, Carrillo-de-Gea JM, Toval A (2009) Risks and safeguards for the requirements engineering process in global software development. In: Fourth IEEE international conference on global software engineering. ICGSE 2009. IEEE, pp 394–399Google Scholar
  31. 31.
    Peng R, Lai H (2012) DRE-specific wikis for distributed requirements engineering: a review. In: 2012 19th Asia-Pacific Software Engineering Conference (APSEC), vol 1. IEEE, pp 116–126Google Scholar
  32. 32.
    Blanes D, Insfran E, Abrahão S (2009) Requirements engineering in the development of multi-agent systems: a systematic review. In: Intelligent Data Engineering and Automated Learning-IDEAL 2009. Springer, Berlin, pp 510–517Google Scholar
  33. 33.
    Alves V, Niu N, Alves C, Valença G (2010) Requirements engineering for software product lines: a systematic literature review. Inf Softw Technol 52(8):806–820CrossRefGoogle Scholar
  34. 34.
    Cruzes DS, Dybå T (2011) Research synthesis in software engineering: a tertiary study. Inf Softw Technol 53(5):440–455CrossRefGoogle Scholar
  35. 35.
    Cruzes DS, Dyba T (2011) Recommended steps for thematic synthesis in software engineering. In: 2011 International symposium on empirical software engineering and measurement (ESEM). IEEE, pp. 275–284Google Scholar
  36. 36.
    Kitchenham BA, Brereton OP, Budgen D, Li Z (2009) An evaluation of quality checklist proposals: a participant-observer case study. In: Proceedings of the 13th international conference on evaluation and assessment in software engineering. British Computer Society, pp 55–64Google Scholar
  37. 37.
    Kitchenham B, Sjøberg DI, Brereton OP, Budgen D, Dybå T, Höst M, Runeson P (2010) Can we evaluate the quality of software engineering experiments? In: Proceedings of the 2010 ACM-IEEE international symposium on empirical software engineering and measurement. ACM, p 2Google Scholar
  38. 38.
    Höst M, Runeson P (2007) Checklists for software engineering case study research. In: ESEM, pp 479–481Google Scholar
  39. 39.
    Budgen D, Zhang C (2009) Preliminary reporting guidelines for experience papers. In: Proceedings of EASE, vol 2009, pp 1–10Google Scholar
  40. 40.
    Bourque P, Dupuis R (2004) Guide to the software engineering body of knowledge 2004 Version. In: SWEBOKGoogle Scholar
  41. 41.
    Aoyama M, Nakatani T, Saito S, Suzuki M, Fujita K, Nakazaki H, Suzuki R (2010) A model and architecture of REBOK (Requirements Engineering Body of Knowledge) and its evaluation. In: 2010 17th Asia Pacific Software Engineering Conference (APSEC). IEEE, pp 50–59Google Scholar
  42. 42.
    Wieringa R, Maiden N, Mead N, Rolland C (2006) Requirements engineering paper classification and evaluation criteria: a proposal and a discussion. Requir Eng 11(1):102–107CrossRefGoogle Scholar
  43. 43.
  44. 44.
    Sikora E, Tenbergen B, Pohl K (2012) Industry needs and research directions in requirements engineering for embedded systems. Requir Eng 17(1):57–78CrossRefGoogle Scholar
  45. 45.
    Daneva M et al (2014) Empirical research methodologies and studies in requirements engineering: how far did we come? J Syst Softw 95:1–9CrossRefGoogle Scholar
  46. 46.
    Talbot A, Connor AM (2014) Requirements engineering current practice and capability in small and medium software development enterprises in New Zealand. arXiv preprint arXiv:1407.6102
  47. 47.
    Aranda J, Easterbrook S, Wilson G (2007) Requirements in the wild: how small companies do it. In: 15th IEEE international requirements engineering conference, 2007. RE’07. IEEE, pp 39–48Google Scholar
  48. 48.
    Sadraei E, Aurum A, Beydoun G, Paech B (2007) A field study of the requirements engineering practice in Australian software industry. Requir Eng 12(3):145–162CrossRefGoogle Scholar
  49. 49.
    Liu L, Zhang H, Ma W, Shan Y, Xu J, Peng F, Burda T (2009) Understanding chinese characteristics of requirements engineering. In: 17th IEEE international requirements engineering conference, 2009. RE’09. IEEE, pp 261–266Google Scholar
  50. 50.
    Liu L, Li T, Peng F (2010) Why requirements engineering fails: a survey report from china. In: 2010 18th IEEE international requirements engineering conference (RE). IEEE, pp 317–322Google Scholar
  51. 51.
    Solemon B, Sahibuddin S, Ghani AAA (2010) Adoption of requirements engineering practices in Malaysian software development companies. In: Advances in software engineering. Springer, Berlin, pp 141–150Google Scholar
  52. 52.
    Juristo N, Moreno AM, Silva A (2002) Is the European industry moving toward solving requirements engineering problems? IEEE Softw 19(6):70–77CrossRefGoogle Scholar
  53. 53.
    Svensson RB, Höst M, Regnell B (2010) Managing quality requirements: a systematic review. In: 36th EUROMICRO conference on software engineering and advanced applications (SEAA), pp 261–268Google Scholar
  54. 54.
    Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2000) Experimentation in software engineering—an introduction. Kluwer Academic, BostonCrossRefzbMATHGoogle Scholar
  55. 55.
    Lindsay RM, Ehrenberg A (1993) The design of replicated studies. Am Stat 47(3):217–228Google Scholar
  56. 56.
    Popper K (1959) The logic of scientific discovery. Hutchinson & Co, BangkokzbMATHGoogle Scholar
  57. 57.
    Schmidt S (2009) Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Rev Gen Psychol 13(2):90CrossRefGoogle Scholar
  58. 58.
    França ACC, da Cunha PR, da Silva FQ (2010) The effect of reasoning strategies on success in early learning of programming: lessons learned from an external experiment replication. In: International conference on evaluation and assessment in software engineering, pp 81–90Google Scholar
  59. 59.
    Lung J, Aranda J, Easterbrook S, Wilson G (2008) On the difficulty of replicating human subjects studies in software engineering. In: ACM/IEEE 30th international conference on software engineering, 2008. ICSE’08. IEEE, pp 191–200Google Scholar
  60. 60.
    Ivarsson M, Gorschek T (2009) Technology transfer decision support in requirements engineering research: a systematic review of REj. Requir Eng 14(3):155–175CrossRefGoogle Scholar
  61. 61.
    Saha SK, Selvi M, Buyukcan G, Mohymen M (2012) A systematic review on creativity techniques for requirements engineering. In: 2012 International conference on informatics, electronics & vision (ICIEV). IEEE, pp 34–39Google Scholar

Copyright information

© Springer-Verlag London 2016

Authors and Affiliations

  • Talat Ambreen
    • 1
  • Naveed Ikram
    • 2
    Email author
  • Muhammad Usman
    • 3
  • Mahmood Niazi
    • 4
  1. 1.Department of Computer Science and Software EngineeringInternational Islamic UniversityIslamabadPakistan
  2. 2.Faculty of ComputingRiphah International UniversityIslamabadPakistan
  3. 3.Department of Software EngineeringBlekinge Institute of TechnologyKarlskronaSweden
  4. 4.Information and Computer Science DepartmentKing Fahd University of Petroleum and MineralsDhahranSaudi Arabia

Personalised recommendations