Abstract
Behavior-Driven Development (BDD) refers to an agile development practice to express the fulfillment of a requirement often depicted in a user story. BDD is meant to facilitate the understanding of how to properly execute requirements among role-divergent stakeholders in a software project. In that way, the development team avoids an excessive focus on coding at the early requirements definition stage and can focus on truly capturing the features and behaviors that are expected by the end-users. In BDD, user-driven scenarios are written in structured natural language following a defined template. Notwithstanding, not much attention has been placed in the literature in terms of defining/studying the quality aspects of the written BDD scenarios; therefore, practitioners tend to use the technique in an ad-hoc manner. In this study, we explore the quality attributes assigned to a well-written BDD scenario. We refine an existing framework by establishing formal definitions for each of the scenarios’ attributes, study their applicability through real BDD scenarios, and link them to the quality attributes appointed to user stories. We then develop and present an experimental Computer-Aided Software Engineering (CASE) tool that helps practitioners assess the quality of the BDD scenarios through the automated evaluation of a set of conforming quality attributes namely Uniqueness, Essentiality, Integrity, and Singularity. We further validate the framework and the tool by collecting two expert opinions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
The build-up of the dataset and the CASE-tool are being concretely described in Sect. 5.
- 4.
The source code and dataset are being provided in the online appendix: https://data.mendeley.com/datasets/4bcd94yh6r/1.
- 5.
Due to space restrictions, we provide only a snapshot of the user-interface report.
References
Beck, K.: Test-Driven Development: By Example. Addison-Wesley Professional (2003)
Binamungu, L.P., Embury, S.M., Konstantinou, N.: Characterising the quality of behaviour driven development specifications. In: Proc. of the 21st Int. Conf. on Agile Software Development, XP 2020. LNBIP, vol. 383, pp. 87–102. Springer (2020)
Cohn, M.: User Stories Applied: For Agile Software Development. Addison-Wesley Professional (2004)
Duszkiewicz, A.G., Sørensen, J.G., Johansen, N., Edison, H., Silva, T.R.: On identifying similar user stories to support agile estimation based on historical data. In: Proceediungs of the First International Workshop on Agile Methods for Information System Engeeniring (Agil-ISE 2022), Leuven, Belgium. CEUR Workshop Proceedings, vol. 3134, pp. 21–26 (2022)
Gupta, A., Poels, G., Bera, P.: Generating multiple conceptual models from behavior-driven development scenarios. Data Knowl. Eng. 145, 102141 (2023)
Heng, S., Tsilionis, K., Wautelet, Y.: Building user stories and behavior driven development scenarios with a strict set of concepts: Ontology, benefits and primary validation. In: Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing, SAC 2023. pp. 1422–1429. ACM (2023)
Hevner, A.R., March, S.T., Park, J., Ram, S.: Design science in information systems research. MIS Quart. 28, 75–105 (2004)
IIBA, A.: Guide to the business analysis body of knowledge (babok guide) ver 3.0 (2015)
Lucassen, G., Dalpiaz, F., van der Werf, J.M.E.M., Brinkkemper, S.: Improving agile requirements: the quality user story framework and tool. Requir. Eng. 21(3), 383–403 (2016)
Lucassen, G., Dalpiaz, F., Werf, J.M.E.M., Brinkkemper, S.: The use and effectiveness of user stories in practice. In: Daneva, M., Pastor, O. (eds.) REFSQ 2016. LNCS, vol. 9619, pp. 205–222. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-30282-9_14
Melnik, G., Maurer, F.: Multiple perspectives on executable acceptance test-driven development. In: Concas, G., Damiani, E., Scotto, M., Succi, G. (eds.) XP 2007. LNCS, vol. 4536, pp. 245–249. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73101-6_46
North, D., et al.: Introducing BDD. Better Softw. 12 (2006)
Oliveira, G., Marczak, S.: On the empirical evaluation of BDD scenarios quality: preliminary findings of an empirical study. In: IEEE 25th International Requirements Engineering Conference Workshops, RE 2017 Workshops, Lisbon, Portugal, pp. 299–302. IEEE Computer Society (2017)
Oliveira, G., Marczak, S., Moralles, C.: How to evaluate BDD scenarios’ quality? In: do Carmo Machado, I., Souza, R., Maciel, R.S.P., Sant’Anna, C. (eds.) Proceedings of the XXXIII Brazilian Symposium on Software Engineering, SBES 2019, Salvador, Brazil, pp. 481–490. ACM (2019)
Patton, J., Economy, P.: User Story Mapping: Discover the Whole Story, Build the Right Product. O’Reilly Media, Inc. (2014)
Sedano, T., Ralph, P., Péraire, C.: The product backlog. In: Atlee, J.M., Bultan, T., Whittle, J. (eds.) Proceedings of the 41st International Conference on Software Engineering, ICSE 2019, Montreal, QC, Canada, May 25–31, 2019, pp. 200–211. IEEE/ACM (2019)
Shafiee, S., Hvam, L., Haug, A., Wautelet, Y.: Behavior-driven development in product configuration systems (short paper). In: Felfernig, A., Tiihonen, J., Hotz, L., Stettinger, M. (eds.) Proceedings of the 20th Configuration Workshop, Graz, Austria, September 27–28, 2018. CEUR Workshop Proceedings, vol. 2220, pp. 49–52. CEUR-WS.org (2018)
Snoeck, M., Wautelet, Y.: Agile MERODE: a model-driven software engineering method for user-centric and value-based development. Softw. Syst. Model. 21(4), 1469–1494 (2022)
Tsilionis, K., Wautelet, Y., Faut, C., Heng, S.: Unifying behavior driven development templates. In: 29th IEEE International Requirements Engineering Conference, RE 2021, Notre Dame, IN, USA, 20–24 September 2021, pp. 454–455. IEEE (2021)
Tsilionis, K., Wautelet, Y., Heng, S.: Building a unified ontology for behavior driven development scenarios. In: Taibi, D., Kuhrmann, M., Mikkonen, T., Klünder, J., Abrahamsson, P. (eds.) PROFES 2022. LNCS, vol. 13709, pp. 518–524. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-21388-5_36
Wake, B.: Invest in good stories, and smart tasks. Retrieved 13 December, 2011 (2003)
Wautelet, Y., Gielis, D., Poelmans, S., Heng, S.: Evaluating the impact of user stories quality on the ability to understand and structure requirements. In: Gordijn, J., Guédria, W., Proper, H.A. (eds.) PoEM 2019. LNBIP, vol. 369, pp. 3–19. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-35151-9_1
Wautelet, Y., Heng, S., Kiv, S., Kolp, M.: User-story driven development of multi-agent systems: a process fragment for agile methods. Comput. Lang. Syst. Struct. 50, 159–176 (2017)
Wautelet, Y., Heng, S., Kolp, M., Mirbel, I.: Unifying and extending user story models. In: Jarke, M., et al. (eds.) CAiSE 2014. LNCS, vol. 8484, pp. 211–225. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07881-6_15
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 IFIP International Federation for Information Processing
About this paper
Cite this paper
Wautelet, Y., Nassiri, A.K., Tsilionis, K. (2024). Investigating Quality Attributes in Behavior-Driven Development Scenarios: An Evaluation Framework and an Experimental Supporting Tool. In: Almeida, J.P.A., Kaczmarek-Heß, M., Koschmider, A., Proper, H.A. (eds) The Practice of Enterprise Modeling. PoEM 2023. Lecture Notes in Business Information Processing, vol 497. Springer, Cham. https://doi.org/10.1007/978-3-031-48583-1_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-48583-1_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48582-4
Online ISBN: 978-3-031-48583-1
eBook Packages: Computer ScienceComputer Science (R0)
