Abstract
The purpose of this paper is to suggest recommendations for improving research quality and theory development by addressing four issues. Two of them concern hypotheses, their statements, and observed inconsistencies found in articles; the other two address issues related to theoretical perspectives and triangulation. We used a purposive sampling of scientific fields and articles that support and ground the ideas of this general review. This study clarifies inconsistent opposite relationships among variables found in theoretical models, discusses the usage of verbs in hypotheses, focuses on the cause-and-effect relationship between variables, identifies ways in which to rectify inconsistencies by including additional theoretical perspectives, and reminds the research community about triangulation. This paper concludes with the implications for research, practice, and society.
Similar content being viewed by others
References
Abdel-Hamid, T.K.: The economics of software quality assurance: A simulation-based case study. MIS Q. 12(3), 395–411 (1988)
Agag, G.M., El-Masry, A.A.: Why do consumers trust online travel websites? Drivers and outcomes of consumer trust toward online travel websites. J. Travel Res. 56(3), 347–369 (2017)
Alsajjan, B., Dennis, C.: Internet banking acceptance model: Cross-market examination. J. Bus. Res. 63(9–10), 957–963 (2010)
Bacher, J.: Association. In: Lewis-Beck, M., Bryman, A.E., Liao, T.F. (eds.) The Sage encyclopedia of social science research methods. Sage Publications, New York (2003)
Bachman, R.D., Schutt, R.K., Plass, P.S.: Fundamentals of research in criminology and criminal justice: With selected readings. Sage Publications, Thousand Oaks (2015)
Bell, E., Bryman, A., Harley, B.: Business research methods. Oxford University Press, Oxford (2019)
Benbasat, I., Barki, H.: Quo Vadis TAM? J. association Inform. Syst. 8(4), 211–218 (2007)
Bertalanffy, L.V.: General Systems Theory. George Braziller, New York (1968)
Bitner, M.J.: Evaluating service encounters: the effects of physical surroundings and employee responses. J. Mark. 54(2), 69–82 (1990)
Blaikie, N.W.: A critique of the use of triangulation in social research. Qual. Quantity. 25(2), 115–136 (1991)
Bolton, R.N., Drew, J.H.: A longitudinal analysis of the impact of service changes on customer attitudes. J. Mark. 55(1), 1–9 (1991a)
Bolton, R.N., Drew, J.H.: A multistage model of customers’ assessments of service quality and value. J. consumer Res. 17(4), 375–384 (1991b)
Bryman, A.: Integrating quantitative and qualitative research: how is it done? Qualitative Res. 6(1), 97–113 (2006)
Burton-Jones, A., McLean, E.R., Monod, E.: Theoretical perspectives in IS research: from variance and process to conceptual latitude and conceptual fit. Eur. J. Inform. Syst. 24(6), 664–679 (2015)
Campbell, D.T., Fiske, D.W.: Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol. Bull. 56(2), 81–105 (1959)
Carlos Roca, J., José García, J., José de la Vega, J.: The importance of perceived trust, security and privacy in online trading systems. Inform. Manage. Comput. Secur. 17(2), 96–113 (2009)
Chandra, S., Srivastava, S.C., Theng, Y.L.: Evaluating the role of trust in consumer adoption of mobile payment systems: An empirical analysis. Commun. Association Inform. Syst. 27(29), 561–588 (2010)
Chang, Y.S., Fang, S.R.: Antecedents and distinctions between online trust and distrust: Predicting high-and low-risk internet behaviors. J. Electron. Commer. Res. 14(2), 149 (2013)
Chen, Y.H., Barnes, S.: Initial trust and online buyer behaviour. Industrial Manage. data Syst. 107(1), 21–36 (2007)
Chircu, A.M., Davis, G.B., Kauffman, R.J.: Trust, expertise, and e-commerce intermediary adoption, in Proceedings of the Sixth Americas Conference on Information Systems. Long Beach, CA, August 3–5, 710–716 (2000)
Cochran, W.G.: Sampling techniques. John Wiley & Sons, New York (1977)
Cocosila, M., Archer, N.: Modeling Consumer Acceptance of Electronic Personal Health Records. J. Electron. Commer. Res. 19(2), 119–134 (2018)
Creswell, J.W., Creswell, J.D.: Qualitative, Quantitative, and Mixed Methods Approaches, Fifth edition. Sage Publications, Los Angeles (2018)
Cronin, J.J.J., Brady, M.K., Hult, G.T.M.: Assessing the effects of quality, value, and customer satisfaction on consumer behavioral intentions in service environments. J. retailing. 76(2), 193–218 (2000)
Cronin, J.J.J., Taylor, S.A.: Measuring service quality: a reexamination and extension. J. Mark. 56(3), 55–68 (1992)
David, P., Rundle-Thiele, S.: Social marketing theory measurement precision: a theory of planned behaviour illustration. J. Social Mark. 8(2), 182–201 (2018)
Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13(3), 319–340 (1989)
DeLone, W.H., McLean, E.R.: Information systems success: The quest for the dependent variable. Inform. Syst. Res. 3(1), 60–95 (1992)
DeLone, W.H., McLean, E.R.: The DeLone and McLean model of information systems success: a ten-year update. J. Manage. Inform. Syst. 19(4), 9–30 (2003)
Denzin, N.K.: Triangulation 2.0. J. mixed methods Res. 6(2), 80–88 (2012)
Denzin, N.K.: The research act: A theoretical introduction to sociological methods. McGraw-Hill, New York (1978)
Doyle, L., Brady, A.M., Byrne, G.: An overview of mixed methods research. J. Res. Nurs. 14(2), 175–185 (2009)
Fetters, M.D., Molina-Azorin, J.F.: The journal of mixed methods research starts a new decade: principles for bringing in the new and divesting of the old language of the field. J. Mixed Methods Res. 11(1), 3–10 (2017)
Fielding, N.G.: Triangulation and mixed methods designs: Data integration with new research technologies. J. mixed methods Res. 6(2), 124–136 (2012)
Flick, U.: Mantras and myths: The disenchantment of mixed-methods research and revisiting triangulation as a perspective. Qualitative Inq. 23(1), 46–57 (2017)
Gefen, D., Karahanna, E., Straub, D.W.: Trust and TAM in online shopping: An integrated model. MIS Q. 27(1), 51–90 (2003)
Gioia, D.A., Pitre, E.: Multiparadigm perspectives on theory building. Acad. Manage. Rev. 15(4), 584–602 (1990)
Goerres, A., Prinzen, K.: Using mixed methods for the analysis of individuals: a review of necessary and sufficient conditions and an application to welfare state attitudes. Qual. Quantity. 46(2), 415–450 (2012)
Greene, J.C., Caracelli, V.J., Graham, W.F.: Toward a conceptual framework for mixed-method evaluation designs. Educational evaluation and policy analysis. 11(3), 255–274 (1989)
Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E., Tatham, R.L.: Multivariate data analysis, 7th edn. Prentice-Hall, Upper Saddle River (2009)
Harrigan, M., Feddema, K., Wang, S., Harrigan, P., Diot, E.: How trust leads to online purchase intention founded in perceived usefulness and peer communication. J. Consumer Behav. 20(5), 1297–1312 (2021)
Heyvaert, M., Maes, B., Onghena, P.: Mixed methods research synthesis: definition, framework, and potential. Qual. Quantity. 47(2), 659–676 (2013)
Jaccard, J., Jacoby, J.: Theory construction and model-building skills: A practical guide for social scientists. Guilford Press, New York (2009)
Johns, G.: Level of analysis. In: Nicholson, N., Audia, P.G. (eds.) The Blackwell encyclopedia of management. Organizational behavior. Blackwell Publishing Ltd, Oxford (2021)
Knappertsbusch, F., Langfeldt, B., Kelle, U.: Mixed-methods and multimethod research. Soziologie-Sociology in the German-Speaking World. 261–272 (2021)
Koufaris, M., Hampton-Sosa, W.: The development of initial trust in an online company by new customers. Inf. Manag. 41(3), 377–397 (2004)
Langley, A.: Strategies for theorizing from process data. Acad. Manage. Rev. 24(4), 691–710 (1999)
Langley, A.N.N., Smallman, C., Tsoukas, H., Van de Ven, A.H.: Process studies of change in organization and management: Unveiling temporality, activity, and flow. Acad. Manage. J. 56(1), 1–13 (2013)
Lavuri, R.: Intrinsic factors affecting online impulsive shopping during the COVID-19 in emerging markets.International Journal of Emerging Markets. (2021)
Lee, A.S. (ed.): MIS Quarterly. 25(1), (2001)
Lee, M.C.: Predicting and explaining the adoption of online trading: An empirical study in Taiwan. Decis. Support Syst. 47(2), 133–142 (2009)
Lee, Y., Kozar, K.A., Larsen, K.R.: The technology acceptance model: Past, present, and future. Commun. Association Inform. Syst. 12(50), 752–780 (2003)
Liébana-Cabanillas, F., Sánchez-Fernández, J., Muñoz-Leiva, F.: Antecedents of the adoption of the new mobile payment systems: The moderating effect of age. Computers in Human Behavior. 35, 464–478 (2014)
Lindh, C., Rovira Nordman, E., Melén Hånell, S., Safari, A., Hadjikhani, A.: Digitalization and international online sales: Antecedents of purchase intent. J. Int. Consumer Mark. 32(4), 324–335 (2020)
Liu, Y.: Paradigmatic Compatibility Matters: A Critical Review of Qualitative-Quantitative Debate in Mixed Methods Research.SAGE Open.12(1), (2022)
Mathison, S.: Why triangulate?. Educational researcher. 17(2), 13–17 (1988)
Mohr, L.B.: Explaining organizational behavior. Jossey-Bass, San Francisco (1982)
Morgan, D.L.: Paradigms lost and pragmatism regained: Methodological implications of combining qualitative and quantitative methods. J. mixed methods Res. 1(1), 48–76 (2007)
Morgan, D.L.: Commentary—After triangulation, what next? J. Mixed Methods Res. 13(1), 6–11 (2019)
Morse, J.M.: Purposive sampling. In: Lewis-Beck, M., Bryman, A.E., Liao, T.F. (eds.) The Sage encyclopedia of social science research methods. Sage Publications., Thousand Oaks (2003)
Newman, M., Robey, D.: A social process model of user-analyst relationships. MIS Q. 16(2), 249–266 (1992)
Niederman, F., March, S.T.: An exposition of process theory and critique of Mohr’s (1982) conceptualization thereof. Philos. Manage. 17(3), 321–331 (2018)
Oleinik, A.: Mixing quantitative and qualitative content analysis: Triangulation at work. Qual. Quantity. 45(4), 859–873 (2011)
Olsen, S.O.: Comparative evaluation and the relationship between quality, satisfaction, and repurchase loyalty. J. Acad. Mark. Sci. 30(3), 240–249 (2002)
Ortiz de Guinea, A., Webster, J.: Combining variance and process in information systems research: Hybrid approaches. Inform. Organ. 27(3), 144–162 (2017)
Parasuraman, A., Zeithaml, V.A., Berry, L.L.: Reassessment of expectations as a comparison standard in measuring service quality: implications for further research. J. Mark. 58(1), 111–124 (1994)
Patton, M.Q.: Qualitative research and evaluation methods, 3rd edn. Sage Publications, Thousand Oakes (2002)
Pavlou, P.A.: Consumer acceptance of electronic commerce: Integrating trust and risk with the technology acceptance model. Int. J. Electron. Commer. 7(3), 101–134 (2003)
Pearl, J.: Graphs, causality, and structural equation models. Sociol. Methods Res. 27(2), 226–284 (1998)
Pettigrew, A.M.: Contextualist research and the study of organizational change processes. Res. methods Inform. Syst. 1, 53–78 (1985)
Poole, M.S., Van de Ven, A.H., Dooley, K., Holmes, M.E.: Organizational change and innovation processes: Theory and methods for research. Oxford University Press, New York (2000)
Poole, M.S.: Central issues in the study of change and innovation. In: Poole, M.S., Van de Ven, A.H. (eds.) Handbook of organizational change and innovation. Oxford University Press, New York (2004)
Ribbink, D., Van Riel, A.C., Liljander, V., Streukens, S.: Comfort your online customer: quality, trust and loyalty on the internet. Managing Service Quality: An International Journal. 14(6), 446–456 (2004)
Sale, J.E., Lohfeld, L.H., Brazil, K.: Revisiting the quantitative-qualitative debate: Implications for mixed-methods research. Qual. Quantity. 36(1), 43–53 (2002)
Sarkar, S., Chauhan, S., Khare, A.: A meta-analysis of antecedents and consequences of trust in mobile commerce. Int. J. Inform. Manage. 50, 286–301 (2020)
Sarstedt, M., Bengart, P., Shaltoni, A.M., Lehmann, S.: The use of sampling methods in advertising research: A gap between theory and practice. Int. J. Advertising. 37(4), 650–663 (2018)
Sawyer, R.K.: Social emergence: Societies as complex systems. Cambridge University Press, New York (2005)
Seddon, P.B.: A respecification and extension of the DeLone and McLean model of IS success. Inform. Syst. Res. 8(3), 240–253 (1997)
Shaw, T., Jarvenpaa, S.: Process models in information systems. In: Lee, A.S., Liebenau, J. (eds.) Information systems and qualitative research. Springer, Boston (1997)
Sutton, R.I., Staw, B.M.: What theory is not. Administrative Sci. Q. 40(3), 371–384 (1995)
Tzagkarakis, S.I., Kritas, D.: Mixed research methods in political science and governance: approaches and applications.Quality & Quantity.1–15(2022)
Van de Ven, A.H., Poole, M.S.: Alternative approaches for studying organizational change. Organ. Stud. 26(9), 1377–1404 (2005)
Van Gigch, J.P., Le Moigne, J.L.: A paradigmatic approach to the discipline of information systems. Behav. Sci. 34(2), 128–147 (1989)
Venkatesh, V., Brown, S.A., Bala, H.: Bridging the qualitative-quantitative divide: Guidelines for conducting mixed methods research in information systems.MIS quarterly.21–54(2013)
Venkatesh, V., Brown, S.A., Sullivan, Y.: Guidelines for conducting mixed-methods research: An extension and illustration. J. AIS. 17(7), 435–495 (2016)
Wang, W., Benbasat, I.: Trust in and adoption of online recommendation agents. J. association Inform. Syst. 6(3), 72–101 (2005)
Webb, E.J., Campbell, D.T., Schwartz, R.D., Sechrest, L.: Unobtrusive measures. Rand McNally & Company, Chicago (1966)
Weick, K.E.: What theory is not, theorizing is. Adm. Sci. Q. 40(3), 385–390 (1995)
Weick, K.: Definition of theory, In. Nigel Nicholson, Pino G. Audia, and Madan M. Pillutla (Eds.) The Blackwell encyclopedia of management. Organizational behavior. Blackwell Publishing Ltd., Oxford, (2021)
Whetten, D.A.: What constitutes a theoretical contribution? Acad. Manage. Rev. 14(4), 490–495 (1989)
Willmott, T., Rundle-Thiele, S.: Are we speaking the same language? Call for action to improve theory application and reporting in behaviour change research. BMC Public. Health. 21(1), 1–8 (2021)
Statements & Declarations
Funding
The author declares that no funds, grants, or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing Interests
The author has no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Stamenkov, G. Recommendations for improving research quality: relationships among constructs, verbs in hypotheses, theoretical perspectives, and triangulation. Qual Quant 57, 2923–2946 (2023). https://doi.org/10.1007/s11135-022-01461-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-022-01461-2