Journal of International Business Studies

, Volume 41, Issue 9, pp 1581–1588

Effect sizes and the interpretation of research results in international business

  • Paul D Ellis
Research Note

DOI: 10.1057/jibs.2010.39

Cite this article as:
Ellis, P. J Int Bus Stud (2010) 41: 1581. doi:10.1057/jibs.2010.39

Abstract

Journal editors and academy presidents are increasingly calling on researchers to evaluate the substantive, as opposed to the statistical, significance of their results. To measure the extent to which these calls have been heeded, I aggregated the meta-analytically derived effect size estimates obtained from 965 individual samples. I then surveyed 204 studies published in the Journal of International Business Studies. I found that the average effect size in international business research is small, and that most published studies lack the statistical power to detect such effects reliably. I also found that many authors confuse statistical with substantive significance when interpreting their research results. These practices have likely led to unacceptably high Type II error rates and invalid inferences regarding real-world effects. By emphasizing p values over their effect size estimates, researchers are under-selling their results and settling for contributions that are less than what they really have to offer. In view of this, I offer four recommendations for improving research and reporting practices.

Keywords

evaluation of current empirical approaches theory–method intersection meta-analysis statistical power effect size 

Copyright information

© Academy of International Business 2010

Authors and Affiliations

  • Paul D Ellis
    • 1
  1. 1.Department of Management & MarketingHong Kong Polytechnic UniversityKowloonHong Kong