Skip to main content

Software engineering involves a blend of non-technical as well as technical issues that often have to be taken into account in the design of empirical studies. In particular, the behavior of people is an integral part of software development and maintenance. This aspect of our subject presents complexities and challenges for the empirical researcher. In many other disciplines, qualitative research methods have been developed and are commonly used to handle the complexity of issues involving people performing tasks in their workplace. This chapter presents several qualitative methods for data collection and analysis and describes them in terms of how they might be incorporated into empirical studies of software engineering, in particular how they might be combined with quantitative methods. To illustrate this use of qualitative methods, examples from real software engineering studies are used throughout.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Barley SR (1990) The Alignment of Technology and Structure through Roles and Networks. Administrative Science Quarterly 35:61–103.

    Article  Google Scholar 

  • Brooks A, Roper M, Wood M, Daly J, Miller J (2007) Replication’s Role in Software Engineering, this volume.

    Google Scholar 

  • Creswell JW (1998) Qualitative Inquiry and Research Design: Choosing Among Five Traditions. Sage Publications, Thousand Oaks.

    Google Scholar 

  • Dey I (1993) Qualitative Analysis: A User-Friendly Guide. Routledge, New York.

    Google Scholar 

  • Eisenhardt KM (1989) Building Theories from Case Study Research. Academy of Management Review 14:532–550.

    Article  Google Scholar 

  • Gilgun JF (1992) Definitions, Methodologies, and Methods in Qualitative Family Research, in Qualitative Methods in Family Research. Sage Publications, Thousand Oaks.

    Google Scholar 

  • Glaser BG, Strauss AL (1967) The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Publishing Company, Somerset, NJ, USA.

    Google Scholar 

  • Guindon R, Krasner H, Curtis B (1987) Breakdowns and Processes During the Early Activities of Software Design by Professionals, in Empirical Studies of Programmers, second workshop, Gary Olsen, Sylvia Sheppard, and Elliot Soloway, eds., 65–82, Ablex Publishing, Greenwich, CT, USA.

    Google Scholar 

  • Hackos JT, Redish JD (1998) User and Task Analysis for Interface Design. Wiley, New York.

    Google Scholar 

  • Holsti OR (1969) Content Analysis for the Social Sciences and Humanities. Addison-Wesley, Menlo Park.

    Google Scholar 

  • Jick T (1979) Mixing Qualitative and Quantitative Methods: Triangulation in Action. Administrative Science Quarterly 24(4):602–611.

    Article  Google Scholar 

  • Judd CM, Smith ER, Kidder LH (1991) Research Methods in Social Relations, sixth edition. Harcourt Brace Jovanovich, Fort Worth.

    Google Scholar 

  • Kontio J, Bragge J, Lehtola L (2007) The Focus Group Method as an Empirical Tool in Software Engineering, this volume.

    Google Scholar 

  • Lethbridge T, Sim SE, Singer J (2005) Studying Software Engineers: Data Collection Techniques for Software Field Studies. Empirical Software Engineering: An International Journal 10(3):311–341.

    Article  Google Scholar 

  • Lincoln YS, Guba EG (1985) Naturalistic Inquiry. Sage Publishing, Thousand Oaks.

    Google Scholar 

  • Lutters WG, Seaman CB (2007) The Value of War Stories in Debunking the Myths of Documentation in Software Maintenance. Information and Software Technology 49(6):576–587.

    Article  Google Scholar 

  • Miles MB, Huberman AM (1994) Qualitative Data Analysis: An Expanded Sourcebook, second edition. Sage Publishing, Thousand Oaks.

    Google Scholar 

  • Orlikowski WJ (1993) CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development. MIS Quarterly 17(3):309–340.

    Article  Google Scholar 

  • Orlikowski WJ, Baroudi JJ (1991) Studying Information Technology in Organizations: Research Approaches and Assumptions. Information Systems Research 2(1):1–28.

    Article  Google Scholar 

  • Parra A, Seaman C, Basili V, Kraft S, Condon S, Burke S, Yakimovich D (1997) The Package-Based Development Process in the Flight Dynamics Division. Proceedings of the Twenty-second Software Engineering Workshop, NASA/Goddard Space Flight Center Software Engineering Laboratory (SEL), Greenbelt, MD, USA.

    Google Scholar 

  • Perry DE, Staudenmayer NA, Votta LG (1994) People, Organizations, and Process Improvement. IEEE Software 11(July): 36–45.

    Article  Google Scholar 

  • Rainer A, Hall T (2003) A Quantitative and Qualitative Analysis of Factors Affecting Software Processes. Journal of Systems and Software 66:7–21.

    Google Scholar 

  • Rainer A, Hall T, Baddoo N (2003) Persuading Developers to ‘Buy Into’ Software Process Improvement: Local Opinion and Empirical Evidence. Proceedings of the International Symposium on Empirical Software Engineering (ISESE), IEEE, Los Alamitos, CA, USA.

    Google Scholar 

  • Seaman CB (1999) Qualitative Methods in Empirical Studies of Software Engineering. IEEE Transactions on Software Engineering 25(4):557–572.

    Article  Google Scholar 

  • Seaman CB, Basili VR (1998) Communication and Organization: An Empirical Study of Discussion in Inspection Meetings. IEEE Transactions on Software Engineering 24(7):559–572.

    Article  Google Scholar 

  • Sharp H, Robinson H (2004) An Ethnographic Study of XP Practice. Empirical Software Engineering 9:353–375.

    Article  Google Scholar 

  • Shneiderman B (1998) Designing the User Interface: Strategies for Effective Human-Computer Interaction, third edition. Addison-Wesley, Reading, MA, USA.

    Google Scholar 

  • Singer J (1998) Practices of Software Maintenance. Proceedings of the International Conference on Software Maintenance, IEEE Computer Society Press, Los Alamitos, CA, pp. 139–145.

    Google Scholar 

  • Taylor SJ, Bogdan R (1984) Introduction to Qualitative Research Methods. Wiley, New York.

    Google Scholar 

  • von Mayrhauser A, Vans AM (1996) Identification of Dynamic Comprehension Processes During Large Scale Maintenance. IEEE Transactions on Software Engineering 22(6):424–437.

    Article  Google Scholar 

  • Whyte WF (1984) Learning from the Field: A Guide from Experience. Sage Publications, Beverly Hills.

    Google Scholar 

  • Yin RK (1994) Case Study Research: Design and Methods. Sage Publications, Newbury Park, CA, USA.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag London Limited

About this chapter

Cite this chapter

Seaman, C.B. (2008). Qualitative Methods. In: Shull, F., Singer, J., Sjøberg, D.I.K. (eds) Guide to Advanced Empirical Software Engineering. Springer, London. https://doi.org/10.1007/978-1-84800-044-5_2

Download citation

  • DOI: https://doi.org/10.1007/978-1-84800-044-5_2

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84800-043-8

  • Online ISBN: 978-1-84800-044-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics