Skip to main content
SpringerLink
Log in

Visual requirements analytics: a framework and case study

  • RE 2013
  • Published:
Requirements Engineering Aims and scope Submit manuscript

Abstract

For many software projects, keeping requirements on track needs an effective and efficient path from data to decision. Visual analytics creates such a path that enables the human to extract insights by interacting with the relevant information. While various requirements visualization techniques exist, few have produced end-to-end value to practitioners. In this paper, we advance the literature on visual requirements analytics by characterizing its key components and relationships in a framework. We follow the goal–question–metric paradigm to define the framework by teasing out five conceptual goals (user, data, model, visualization, and knowledge), their specific operationalizations, and their interconnections. The framework allows us to not only assess existing approaches, but also create tool enhancements in a principled manner. We evaluate our enhanced tool support through a case study where massive, heterogeneous, and dynamic requirements are processed, visualized, and analyzed. Working together with practitioners on a contemporary software project within its real-life context leads to the main finding that visual analytics can help tackle both open-ended visual exploration tasks and well-structured visual exploitation tasks in requirements engineering. In addition, the study helps the practitioners to reach actionable decisions in a wide range of areas relating to their project, ranging from theme and outlier identification, over requirements tracing, to risk assessment. Overall, our work illuminates how the data-to-decision analytical capabilities could be improved by the increased interactivity of requirements visualization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Gotel O, Marchese FT, Morris SJ (2008) The potential for synergy between information visualization and software engineering visualization. In: International conference on information visualisation (IV), London, UK, pp 547–552

  2. Thomas JJ, Cook KA (2005) Illuminating the path: the research and development agenda for visual analytics. IEEE Press, Alamitos

    Google Scholar 

  3. Keim DA, Mansmann F, Schneidewind J, Thomas JJ, Ziegler H (2008) Visual analytics: scope and challenges. In: Simoff SJ, Böhlen MH, Mazeika A (eds) Visual data mining—theory, techniques and tools for visual analytics. Springer, Berlin, pp 76–90

  4. Cooper JR Jr, Lee S-W, Gandhi RA, Gotel O (2009) Requirements engineering visualization: a survey on the state-of-the-art. In: International workshop on requirements engineering visualization (REV), Atlanta, GA, USA, pp 46–55

  5. Gandhi RA, Lee S-W (2007) Visual analytics for requirements-driven risk assessment. In: International workshop on requirements engineering visualization (REV), article no. 6, New Delhi, India

  6. Reddivari S, Chen Z, Niu N (2012) ReCVisu a tool for clustering-based visual exploration of requirements. In: International requirements engineering conference (RE), Chicago, IL, USA, pp 327–328

  7. Jankun-Kelly TJ, Ma K-L, Gertz M (2007) A model and framework for visualization exploration. IEEE Trans Vis Comput Graph 13(2):357–369

    Article  Google Scholar 

  8. Basili V, Caldiera G, Dieter RH (1994) The goal question metric paradigm. Encycl Softw Eng 2:528–532

    Google Scholar 

  9. Niu N, Reddivari S, Chen Z (2013) Keeping requirements on track via visual analytics. In: International requirements engineering conference (RE), Rio de Janeiro, Brazil, pp 205–214

  10. Cleland-Huang J, Habrat R (2007) Visual support in automated tracing. In: International workshop on requirements engineering visualization (REV), article no. 4. New Delhi, India

  11. Noack A (2007) Energy models for graph clustering. J Graph Algorithms Appl 11(2):453–480

    Article  MATH  MathSciNet  Google Scholar 

  12. Niu N, Reddivari S, Mahmoud A, Bhowmik T, Xu S (2012) Automatic labeling of software requirements clusters. In: International workshop on search-driven development: users, infrastructure, tools, and evaluation (SUITE), Zurich, Switzerland, pp 17–20

  13. Menzies T, Zimmermann T (2013) Software analytics: so what? IEEE Softw 30(4):31–37

    Article  Google Scholar 

  14. Buse RPL, Zimmermann T (2012) Information needs for software development analytics. In: International conference on software engineering (ICSE), Zurich, Switzerland, pp 987–996

  15. Han J, Kamber M (2000) Data mining: concepts and techniques. Academic Press, London

    Google Scholar 

  16. Alpaydin E (2004) Introduction to machine learning. The MIT Press, Cambridge

    Google Scholar 

  17. Horkoff J, Yu E (2010) Visualizations to support interactive goal model analysis. In: International workshop on requirements engineering visualization (REV), Sydney, Australia, pp 1–10

  18. Mussbacher G, Amyot D, Weiss M (2007) Visualizing early aspects with use case maps. Trans Aspect-Oriented Softw Dev 3:105–143

    Article  Google Scholar 

  19. Wnuk K, Regnell B, Karlsson L (2009) What happened to our features? Visualization and understanding of scope change dynamics in a large-scale industrial setting. In: International requirements engineering conference (RE), Atlanta, GA, USA, pp 89–98

  20. Seater R, Jackson D, Gheyi R (2007) Requirement progression in problem frames: deriving specifications from requirements. Requir Eng 12(2):77–102

    Article  Google Scholar 

  21. Kwan I, Damian D, Storey M-A (2006) Visualizing a requirements-centred social network to maintain awareness within development teams. In: International workshop on requirements engineering visualization (REV), article no. 7, Minneapolis/St. Paul, MN, USA

  22. Hansen CD, Johnson CR (2004) Visualization handbook. Academic Press, London

    Google Scholar 

  23. Card SK, Mackinlay J, Shneiderman B (1999) Readings in information visualization: using vision to think. Morgan Kaufmann, Los Altos

    Google Scholar 

  24. Reinhard T, Meier S, Glinz M (2007) An improved fisheye zoom algorithm for visualizing and editing hierarchical models. In: International workshop on requirements engineering visualization (REV), article no. 9, New Delhi, India

  25. Matulevicius R, Heymans P (2007) Visually effective goal models using KAOS. In: International workshop on requirements, intentions and goals in conceptual modeling (RIGiM). Auckland, New Zealand, pp 265–275

  26. Heim P, Lohmann S, Lauenroth K, Ziegler J (2008) Graph-based visualization of requirements relationships. In: International workshop on requirements engineering visualization (REV), Barcelona, Spain, pp 51–55

  27. Shneiderman B (1996) The eyes have it: a task by data type taxonomy for information visualizations. In: IEEE symposium on visual language (VL), Boulder, CO, USA, pp 336–343

  28. Natt och Dag J, Gervasi V, Brinkkemper S, Regnell B (2005) A linguistic–engineering approach to large-scale requirements management. IEEE Softw 22(1):32–39

    Article  Google Scholar 

  29. Gacitua R, Sawyer P, Gervasi V (2011) Relevance-based abstraction identification: technique and evaluation. Requir Eng 16(3):251–265

    Article  Google Scholar 

  30. Goldin L, Berry DM (1997) AbstFinder, a prototype natural language text abstraction finder for use in requirements elicitation. Autom Softw Eng 4(4):375–412

    Article  Google Scholar 

  31. Niu N, Easterbrook S (2008) Extracting and modeling product line functional requirements. In: International requirements engineering conference (RE), Barcelona, Spain, pp 155–164

  32. Mahmoud A, Niu N (2011) Source code indexing for automated tracing. In: International workshop on traceability in emerging forms of software engineering (TEFSE), Honolulu, HI, USA, pp 3–9

  33. Yu Eric SK (1997) Towards modeling and reasoning support for early-phase requirements engineering. In: International symposium on requirements engineering (RE), Annapolis, MD, USA, pp 226–235

  34. Laurence MD, Heymans P, Matulevicius R (2009) Improving the effectiveness of visual representations in requirements engineering: an evaluation of i * visual syntax. In: International requirements engineering conference (RE), Atlanta, GA, USA, pp 171–180

  35. Laurence MD, Heymans P, Matulevicius R (2010) Visual syntax does matter: improving the cognitive effectiveness of the i * visual notation. Requir Eng 15(2):141–175

    Article  Google Scholar 

  36. Laurence MD (2009) The “physics” of notations: toward a scientific basis for constructing visual notations in software engineering. IEEE Trans Software Eng 35(6):756–779

    Article  Google Scholar 

  37. Caire P, Genon N, Heymans P, Laurence MD (2013) Visual notation design 2.0: towards user comprehensible requirements engineering notations. In: International requirements engineering conference (RE), Rio de Janeiro, Brazil

  38. Shepperd MJ, Song Q, Sun Z, Mair C (2013) Data quality: some comments on the NASA software defect datasets. IEEE Trans Softw Eng 39(9):1208–1215

    Article  Google Scholar 

  39. Amyot D, Ghanavati S, Horkoff J, Mussbacher G, Peyton L, Yu ESK (2010) Evaluating goal models within the goal-oriented requirement language. Int J Intell Syst 25(8):841–877

    Article  Google Scholar 

  40. Niu N, Easterbrook S (2007) So, you think you know others’ goals? A repertory grid study. IEEE Softw 24(2):53–61

    Article  Google Scholar 

  41. Feather MS, Cornford SL, Kiper JD, Menzies T (2006) Experiences using visualization techniques to present requirements, risks to them, and options for risk mitigation. In: International workshop on requirements engineering visualization (REV), article no. 10, Minneapolis/St. Paul, MN, USA

  42. Yin R (2003) Case study research: design and methods. Sage, Beverley Hills

    Google Scholar 

  43. Easterbrook S, Singer J, Storey M-A, Damian D (2007) Selecting empirical methods for software engineering research. In: Shull F, Singer J, Sjøberg DIK, (eds) Guide to advanced empirical software engineering. Springer, Berlin, pp 285–311

  44. Wood J, Silver D (1995) Joint application development. Wiley, New York

    Google Scholar 

  45. Haag S, Cummings M, McCubbrey DJ (2003) Management information systems for the information age. McGraw-Hill, New York

    Google Scholar 

  46. Richards L (2005) Handling qualitative data: a practical guide. Sage, Beverly Hills

    Google Scholar 

  47. Tzerpos V, Holt RC (1997) The orphan adoption problem in architecture maintenance. In: Working conference on reverse engineering (WCRE), Amsterdam, The Netherlands, pp 76–82

  48. Cleland-Huang J, Berenbach B, Clark S, Settimi R, Romanova E (2007) Best practices for automated traceability. IEEE Comput 40(6):27–35

    Article  Google Scholar 

  49. Mahmoud A, Niu N, Xu S (2012) A semantic relatedness approach for traceability link recovery. In: International conference on program comprehension (ICPC), Passau, Germany, pp 183–192

  50. Hayes JH, Dekhtyar A, Karthikeyan SS (2006) Advancing candidate link generation for requirements tracing: the study of methods. IEEE Trans Softw Eng 32(1):4–19

    Article  Google Scholar 

  51. Herrmann K (2006) Visualization of release planning. In: International workshop on requirements engineering visualization (REV), article no. 8, Minneapolis/St. Paul, MN, USA

  52. Telea A, Voinea L (2009) Case study: visual analytics in software product assessments. In: International workshop on visualizing software for understanding and analysis (VISSOFT), Edmonton, Canada, pp 65–72

  53. Nestor D, Thiel S, Botterweck G, Cawley C, Healy P (2008) Applying visualisation techniques in software product lines. In: ACM symposium on software visualization (SOFTVIS), Ammersee, Germany, pp 175–184

  54. Gallagher K, Hatch A, Munro M (2008) Software architecture visualization: an evaluation framework and its application. IEEE Trans Softw Eng 34(2):260–270

    Article  Google Scholar 

  55. Caserta P, Zendra O (2011) Visualization of the static aspects of software: a survey. IEEE Trans Vis Comput Graph 17(7):913–933

    Article  Google Scholar 

Download references

Acknowledgments

We are grateful to the partner company for the generous support throughout our study, especially for sharing their data, time, and expertise. We thank Zhangji Chen for implementing parts of ReCVisu+ functionalities and for his contributions to an earlier version of this paper. Thanks also go to the anonymous reviewers for their insightful and constructive comments. The research is in part supported by the U.S. NSF (National Science Foundation) Grant CCF-1238336.

Author information

Authors and Affiliations

  1. Mississippi State University, Starkville, MS, USA

    Sandeep Reddivari, Shirin Rad, Tanmay Bhowmik, Nisreen Cain & Nan Niu

Authors
  1. Sandeep Reddivari
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shirin Rad
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tanmay Bhowmik
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nisreen Cain
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nan Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nan Niu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Reddivari, S., Rad, S., Bhowmik, T. et al. Visual requirements analytics: a framework and case study. Requirements Eng 19, 257–279 (2014). https://doi.org/10.1007/s00766-013-0194-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00766-013-0194-3

Keywords

Search

Navigation