Skip to main content
SpringerLink
Log in

Research Design

  • Chapter
  • First Online:
Improving Software Testing

Part of the book series: SpringerBriefs in Information Systems ((BRIEFSINORMAT))

  • 2511 Accesses

Abstract

Scientific research usually is conducted based on a set of explicit or implicit assumptions and by pursuing one or more methods. Basic philosophical assumptions and the chosen methods constitute the research design. The method should be chosen wisely in advance to achieve one’s aims. It is the only guarantee to obtain knowledge that is “valid, reliable and thus scientific”. The following sections explain the methods used, and sketch the research process. This research design “reflects decisions about the priority being given to a range of dimensions of the research”. It also is important as it enables other to understand, validate, or—if desired—reproduce and possibly falsify the research. A much longer discussion of the research’s philosophical underpinnings and the research design have been included in the author’s dissertation thesis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.95
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In the characterization of research disciplines chosen by March and Smith [16], computer science (CS) and mathematics can be attributed to the natural sciences.

  2. 2.

    The term, coined by Simon, first appeared in [20].

  3. 3.

    The reference was written in British English—thus artefact.

  4. 4.

    Translated from the German original by the author.

References

  1. Becker, J.; Holten, R.; Knackstedt, R.; Niehaves, B.: Forschungsmethodische positionierung in der Wirtschaftsinformatik-epistemologische, ontologische und linguistische Leitfragen. In: Becker, J., Grob, H., Klein, S., Kuchen, H., Müller-Funk, H., Vossen, G. (eds.) Arbeitsbericht Nr. 93. Institut für Wirtschaftsinformatik, WWU, Münster (2003)

    Google Scholar 

  2. Braun, R.: Forschungsdesign in der Wirtschaftsinformatik. WISU—Das Wirtschaftsstudium 36(1), S.61–S.66 (2007)

    Google Scholar 

  3. Williams, M., May, T.: Introduction to the Philosophy of Social Research. University College London Press, London (1996)

    Google Scholar 

  4. Bryman, A., Bell, E.: Business Research Methods. Oxford University Press, Oxford (2007)

    Google Scholar 

  5. Chalmers, A.F.: What is this Thing Called Science? 3rd edn. Hacket Publishing, Cambridge (1999)

    Google Scholar 

  6. Braun, R., Esswein, W.: Eine Methode zur Konzeption von Forschungsdesigns in der konzeptuellen Modellierungsforschung. In: Integration, Informationslogistik und Architektur Proceedings der DW2006 (2006)

    Google Scholar 

  7. Majchrzak, T.A.: Technical and organizational aspects of testing software. Ph.D. Thesis, University of Münster, Münster (2011)

    Google Scholar 

  8. Hevner, A., Chatterjee, S.: Design Research in Information Systems: Theory and Practice Integrated Series in Information Systems. Springer, Dordrecht (2010)

    Google Scholar 

  9. Burrell, G., Morgan, G.: Sociological Paradigms and Organizational Analysis: Elements of the Sociology of Corporate Life. Ashgate Publishing, London (1979)

    Google Scholar 

  10. Becker, J., Niehaves, B.: Epistemological perspectives on IS research—a framework for analyzing and systematizing epistemological assumptions. Inf. Syst. J. 17(2), 197–214 (2007)

    Article  Google Scholar 

  11. Hirschheim, R., Klein, H.K.: Four paradigms of information systems development. Commun. ACM 32(10), 1199–1216 (1989)

    Article  Google Scholar 

  12. Wilde, T., Hess, T.: Forschungsmethoden der Wirtschaftsinformatik. Wirtschaftsinformatik 49(4), 280–287 (2007)

    Article  Google Scholar 

  13. Frank, U.: Zur methodischen Fundierung der Forschung in der Wirtschaftsinformatik. In: Österle, H., Winter, R., Brenner, W. (eds.) Gestaltungsorientierte Wirtschaftsinformatik: Ein Plädoyer für Rigor und Relevanz, pp. 35–44. Infowerk, St. Gallen (2010)

    Google Scholar 

  14. Guba, E.G., Lincoln, Y.S.: Competing paradigms in qualitative research. In: Denzin, N.K., Lincoln, Y.S. (eds.) The Landscape of Qualitative Research, pp. 195–220. Sage Publications, Thousand Oaks (1998)

    Google Scholar 

  15. Applegate, L.: Rigor and relevance in MIS research: introduction. MIS Q. 23(1), 1–2 (1999)

    Article  Google Scholar 

  16. March, S.T., Smith, G.F.: Design and natural science research on information technology. Decis. Support Syst. 15(4), 251–266 (1995)

    Article  Google Scholar 

  17. Hevner, A.R., March, S.T., Park, J., Ram, S.: Design science in information systems research. MIS Q. 28(1), 75–105 (2004)

    Google Scholar 

  18. Simon, H.A.: The Sciences of the Artificial, 3rd edn. MIT Press, Cambridge (1996)

    Google Scholar 

  19. Purao, S.: Design research in the technology of information systems: truth or dare. GSU Department of CIS Working Paper, Atlanta (2002). http://iris.nyit.edu/~kkhoo/Spring2008/Topics/DS/000DesignSc_TechISResearch-2002.pdf

  20. Simon, H.A.: Rational choice and the structure of the environment. Psychol. Rev. 63(2), 129–138 (1956)

    Article  Google Scholar 

  21. Oates, B.J.: Researching Information Systems and Computing. Sage Publications, Thousand Oaks (2005)

    Google Scholar 

  22. Vaishnavi, V.K., Kuechler, W., Jr.: Design Science Research Methods and Patterns: Innovating Information and Communication Technology. Auerbach Publications, Boston (2007)

    Google Scholar 

  23. Doets, K.: From Logic to Logic Programming. MIT Press, Cambridge (1994)

    Google Scholar 

  24. Bramer, M.: Logic Programming with Prolog. Springer, Secaucus (2005)

    Google Scholar 

  25. Antoy, S., Hanus, M.: Functional logic programming. Commun. ACM 53(4), 74–85 (2010). http://doi.acm.org/10.1145/1721654.1721675

    Google Scholar 

  26. Hanus, M., Kuchen, H., Moreno-Navarro, J.: Curry: A Truly Functional Logic Language. In: Proceedings ILPS ’95, pp. 95–107 (1995)

    Google Scholar 

  27. Tsang, E.: Foundations of Constraint Satisfaction. Academic Press, London (1993)

    Google Scholar 

  28. López-Fraguas, F.J., Rodríguez-Artalejo, M., Vírseda, R.V.: Constraint functional logic programming revisited. Electr. Notes Theor. Comput. Sci. 117, 5–50 (2005). http://dx.doi.org/10.1016/j.entcs.2004.06.030

  29. Comon, H., Dincbas, M., Jouannaud, J.P., Kirchner, C.: A methodological view of constraint solving. Constraints 4(4), 337–361 (1999)

    Article  Google Scholar 

  30. Aho, A.V., Lam, M.S., Sethi, R., Ullman, J.D.: Compilers: Principles, Techniques, and Tools with Gradiance, 2nd edn. Addison-Wesley, Essex (2007)

    Google Scholar 

  31. Srikant, Y.N., Shankar , P. (eds.): The Compiler Design Handbook: Optimizations and Machine Code Generation. CRC Press, Boca Raton (2002)

    Google Scholar 

  32. Niehaves, B., Stahl, B.: Criticality, epistemology, and behaviour versus design—information systems research across different sets of paradigms. In: 14th European Conference on Information Systems (ECIS 2006). Gothberg, Sweden (2006)

    Google Scholar 

  33. Morrison, J., George, J.: Exploring the software engineering component in MIS research. Commun. ACM 38(7), 80–91 (1995)

    Article  Google Scholar 

  34. Hevner, A.R.: The three cycle view of design science. Scand. J. Inf. Syst. 19(2), 87–92 (2007)

    Google Scholar 

  35. Marcos, E.: Software engineering research versus software development. SIGSOFT Softw. Eng. Notes 30(4), 1–7 (2005)

    Article  Google Scholar 

  36. http://www.google.com/

  37. http://scholar.google.com/

  38. http://portal.acm.org/

  39. Greening, T., Kay, J.: Undergraduate research experience in computer science education. SIGCSE Bull. 34(3), 151–155 (2002)

    Article  Google Scholar 

  40. Clear, T.: Valuing computer science education research? In: Proceedings of the 6th Baltic Sea Conference on Computing Education Research: Koli Calling 2006, Baltic Sea ’06, pp. 8–18. ACM, New York (2006)

    Google Scholar 

  41. Hazzan, O., Dubinsky, Y., Eidelman, L., Sakhnini, V., Teif, M.: Qualitative research in computer science education. SIGCSE Bull. 38(1), 408–412 (2006)

    Article  Google Scholar 

  42. Gregg, D.G., Kulkarni, U.R., Vinzé, A.S.: Understanding the philosophical underpinnings of software engineering research in information systems. Inf. Syst. Front. 3(2), 169–183 (2001)

    Article  Google Scholar 

  43. Tichy, W.F., Lukowicz, P., Prechelt, L., Heinz, E.A.: Experimental evaluation in computer science: a quantitative study. J. Syst. Softw. 28(1), 9–18 (1995)

    Article  Google Scholar 

  44. Wainer, J., Novoa Barsottini, C.G., Lacerda, D., Magalhães de Marco, L.R.: Empirical evaluation in computer science research published by ACM. Inf. Softw. Technol. 51(6), 1081–1085 (2009)

    Article  Google Scholar 

  45. Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering: an Introduction. Kluwer, Norwell (2000)

    Book  Google Scholar 

  46. Mueller, R.A., Lembeck, C., Kuchen, H.: GlassTT—a symbolic java virtual machine using constraint solving techniques for glass-box test case generation. Technical Report, No. 102, Department of Information Systems, Arbeitsbericht Universitaet Muenster (2003)

    Google Scholar 

  47. Lembeck, C., Caballero, R., Mueller, R.A., Kuchen, H.: Constraint solving for generating glass-box test cases. In: Proceedings WFLP ’04, pp. 19–32 (2004)

    Google Scholar 

  48. Mueller, R.A., Lembeck, C., Kuchen, H.: Generating glass-box test cases using a symbolic virtual machine. In: Proceedings IASTED SE 2004 (2004)

    Google Scholar 

  49. Oracle: How to Write Doc Comments for the Javadoc Tool (2004). http://www.oracle.com/technetwork/java/javase/documentation/index-137868.html

  50. http://www.oracle.com/technetwork/java/javase/documentation/index-jsp-135444.html

  51. Bloch, J.: Effective Java, 2nd edn. Prentice Hall, Upper Saddle River (2008)

    Google Scholar 

  52. Dias-Neto, A.C., Travassos, G.H.: Model-based testing approaches selection for software projects. Inf. Softw. Technol. 51(11), 1487–1504 (2009)

    Article  Google Scholar 

  53. Dias Neto, A.C., Subramanyan, R., Vieira, M., Travassos, G.H.: A survey on model-based testing approaches: a systematic review. In: Proceedings of the 1st ACM international Workshop on Empirical Assessment of Software Engineering Languages and Technologies, WEASELTech ’07, pp. 31–36. ACM, New York (2007)

    Google Scholar 

  54. Pretschner, A., Prenninger, W., Wagner, S., Kühnel, C., Baumgartner, M., Sostawa, B., Zölch, R., Stauner, T.: One evaluation of model-based testing and its automation. In: Proceedings of the 27th International Conference on Software Engineering, ICSE ’05, pp. 392–401. ACM, New York (2005)

    Google Scholar 

  55. Utting, M., Legeard, B.: Practical Model-Based Testing: a Tools Approach. Morgan Kaufmann, San Francisco (2006)

    Google Scholar 

  56. Jääskeläinen, A., Katara, M., Kervinen, A., Heiskanen, H., Maunumaa, M., Pääkkönen, T.: Model-based testing service on the web. In: Proceedings of the 20th IFIP TC 6/WG 6.1 International Conference on Testing of Software and Communicating Systems: 8th International Workshop, TestCom ’08/FATES ’08, pp. 38–53. Springer, Berlin (2008)

    Google Scholar 

  57. Nguyen, D.H., Strooper, P., Suess, J.G.: Model-based testing of multiple GUI variants using the GUI test generator. In: Proceedings of the 5th Workshop on Automation of Software Test, AST ’10, pp. 24–30. ACM, New York (2010)

    Google Scholar 

  58. Conrad, M., Fey, I., Sadeghipour, S.: Systematic model-based testing of embedded automotive software. Electr. Notes Theor. Comput. Sci. 111, 13–26 (2005)

    Article  Google Scholar 

  59. Jacky, J., Veanes, M., Campbell, C., Schulte, W.: Model-Based Software Testing and Analysis with C#. Cambridge University Press, Cambridge (2007)

    Google Scholar 

  60. Bouquet, F., Grandpierre, C., Legeard, B., Peureux, F., Vacelet, N., Utting, M.: A subset of precise UML for model-based testing. In: Proceedings of the 3rd International Workshop on Advances in Model-based Testing, A-MOST ’07, pp. 95–104. ACM, New York (2007)

    Google Scholar 

  61. Utting, M.: The role of model-based testing. In: Meyer, B., Woodcock, J. (eds.) Verified Software: Theories, Tools, Experiments, pp. 510–517. Springer, Berlin (2008)

    Google Scholar 

  62. Santos-Neto, P., Resende, R.F., Pádua, C.: An evaluation of a model-based testing method for information systems. In: Proceedings of the 2008 ACM Symposium on Applied Computing, SAC ’08, pp. 770–776. ACM, New York (2008)

    Google Scholar 

  63. Sarma, M., Murthy, P.V.R., Jell, S., Ulrich, A.: Model-based testing in industry: a case study with two MBT tools. In: Proceedings of the 5th Workshop on Automation of Software Test, AST’10, pp. 87–90. ACM, New York (2010)

    Google Scholar 

  64. March, S.T., Vogus, T.J.: Design science in the management disciplines. In: Hevner, A., Chatterjee, S. (eds.) Design Research in Information Systems: Theory and Practice (Integrated Series in Information Systems). Springer, Heidelberg (2010)

    Google Scholar 

  65. Myers, M.D.: Qualitative research in information systems. MIS Q. 21(2), 241–242 (1997)

    Article  Google Scholar 

  66. Lamnek, S.: Qualitative Sozialforschung, 4th edn. Beltz, Weinheim (2005)

    Google Scholar 

  67. Bogner, A., Littig, B., Menz, W. (eds.): Das Experteninterview: Theorie, Methode, Anwendung, 2nd edn. VS Verlag für Sozialwissenschaften, Wiesbaden (2002)

    Google Scholar 

  68. Gläser, J., Laudel, G.: Experteninterviews und Qualitative Inhaltsanalyse, 3rd edn. VS Verlag, Wiesbaden (2009)

    Google Scholar 

  69. Majchrzak, T.A., Kuchen, H.: Handlungsempfehlungen für erfolgreiches Testen von Software in Unternehmen. In: Becker, J., Grob, H., Hellingrath, B., Klein, S., Kuchen, H., Müller-Funk, U., Vossen, G. (eds.) Arbeitsbericht Nr. 127. Institut für Wirtschaftsinformatik, WWU Münster, Münster (2010)

    Google Scholar 

  70. Veal, A.J.: Business Research Methods: a Managerial Approach, 2nd edn. Pearson Addison Wesley, South Melbourne (2005)

    Google Scholar 

  71. Pfadenhauer, M.: Auf gleicher Augenhöhe reden—Das Experteninterview—ein Gespräch zwischen Experte und Quasi-Experte. In: Bogner, A., Littig, B., Menz, W. (eds.) Das Experteninterview: Theorie, Methode, Anwendung, 2nd edn. VS Verlag für Sozialwissenschaften, Wiesbaden (2002)

    Google Scholar 

  72. Bogner, A., Merz, W.: Expertenwissen und Forschungspraxis: die modernisierungstheoretische und die methodische Debatte um die Experten. In: Bogner, A., Littig, B., Menz, W. (eds.) Das Experteninterview: Theorie, Methode, Anwendung, 2nd edn. VS Verlag für Sozialwissenschaften, Wiesbaden (2002)

    Google Scholar 

  73. Majchrzak, T.A., Kuchen, H.: IHK-Projekt Softwaretests: Auswertung. In: Working Papers, No. 2. Förderkreis der Angewandten Informatik an der Westfälischen Wilhelms-Universität Münster e.V., Münster (2010)

    Google Scholar 

  74. Majchrzak, T.A.: Technische Aspekte des erfolgreichen Testens von Software in Unternehmen. In: Knoop, J., Prantl, A. (eds.) Schriftenreihe des Instituts für Computersprachen, Bericht 2009-X-1: 15. Kolloquium Programmiersprachen und Grundlagen der Programmierung, pp. 193–207. Technische Universität Wien, Maria Taferl, Vienna (2009)

    Google Scholar 

  75. Majchrzak, T.A.: Best practices for the organizational implementation of software testing. In: Proceedings of the 43th Annual Hawaii International Conference on System Sciences (HICSS-43), pp. 1–10. IEEE Computer Society, Washington, DC (2010)

    Google Scholar 

  76. Majchrzak, T.A.: Improving the technical aspects of software testing in enterprises. Int. J. Adv. Comput. Sci. Appl. 1(4), 1–10 (2010)

    Google Scholar 

  77. Majchrzak, T.A.: Status quo of software testing—regional findings and global inductions. J. Inf. Sci. Technol. 7(2), S.72–S.84 (2010)

    Google Scholar 

  78. Crisp, G.: The e-Assessment Handbook. Continuum, London (2007)

    Google Scholar 

  79. Iskander, M.: Innovative Techniques in Instruction Technology, E-learning, E-assessment and Education. Springer, Heidelberg (2008)

    Book  Google Scholar 

  80. Gruttmann, S.: Formatives E-assessment in der Hochschullehre—Computerunterstützte Lernfortschrittskontrollen im informatikstudium. Ph.D. Thesis, University of Münster, Münster (2010)

    Google Scholar 

  81. Gruttmann, S., Böhm, D., Kuchen, H.: E-assessment of mathematical proofs: chances and challenges for students and tutors. In: Proceedings of the 2008 International Conference on Computer Science and Software Engineering, Volume 05, CSSE ’08, pp. 612–615. IEEE Computer Society, Washington, DC (2008)

    Google Scholar 

  82. Straub, D., Gefen, D., Boudreau, M.C.: The ISWorld Quantitative, Positivist Research Methods Website (2004). http://dstraub.cis.gsu.edu:88/quant/

  83. Creswell, J.W.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 3rd edn. Sage Publications, Thousand Oaks (2008)

    Google Scholar 

  84. Neuman, L.W.: Social Research Methods: Qualitative and Quantitative Approaches, 5th edn. Allyn & Bacon, Needham Heights (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut für Wirtschaftsinformatik, Westfälische Wilhelms-Universität, Leonardo Campus 3, 48149, Münster, Germany

    Tim A. Majchrzak

Authors
  1. Tim A. Majchrzak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tim A. Majchrzak .

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Majchrzak, T.A. (2012). Research Design. In: Improving Software Testing. SpringerBriefs in Information Systems. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27464-0_3

Download citation

Publish with us

Policies and ethics

Search

Navigation