Comparison of methods for constructing confidence intervals of standardized indirect effects
 Mike W. L. Cheung
 … show all 1 hide
Abstract
Mediation models are often used as a means to explain the psychological mechanisms between an independent and a dependent variable in the behavioral and social sciences. A major limitation of the unstandardized indirect effect calculated from raw scores is that it cannot be interpreted as an effectsize measure. In contrast, the standardized indirect effect calculated from standardized scores can be a good candidate as a measure of effect size because it is scale invariant. In the present article, 11 methods for constructing the confidence intervals (CIs) of the standardized indirect effects were evaluated via a computer simulation. These included six Wald CIs, three bootstrap CIs, one likelihoodbased CI, and the PRODCLIN CI. The results consistently showed that the percentile bootstrap, the biascorrected bootstrap, and the likelihoodbased approaches had the best coverage probability. Mplus, LISREL, and Mx syntax were included to facilitate the use of these preferred methods in applied settings. Future issues on the use of the standardized indirect effects are discussed.
 Alwin, D. F., Hauser, R. M. (1975) The decomposition of effects in path analysis. American Sociological Review 40: pp. 3747 CrossRef
 Publication manual of the American Psychological Association. American Psychological Association, Washington, DC
 Aroian, L. A. (1944) The probability function of the product of two normally distributed variables. Annals of Mathematical Statistics 18: pp. 265271 CrossRef
 Baron, R. M., Kenny, D. A. (1986) The moderator—mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality & Social Psychology 51: pp. 11731182 CrossRef
 Bauer, D. J., Preacher, K. J., Gil, K. M. (2006) Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: New procedures and recommendations. Psychological Methods 11: pp. 142163 CrossRef
 Bentler, P. M. (2007) Can scientifically useful hypotheses be tested with correlations?. American Psychologist 62: pp. 772782 CrossRef
 Bentler, P. M., Lee, S. Y. (1983) Covariance structures under polynomial constraints: Applications to correlation and alphatype structural models. Journal of Educational Statistics 8: pp. 207222 CrossRef
 Bobko, P., Rieck, A. (1980) Large sample estimators for standard errors of functions of correlation coefficients. Applied Psychological Measurement 4: pp. 385398 CrossRef
 Bollen, K. A. (1989) Structural equations with latent variables. Wiley, New York
 Bollen, K. A., Stine, R. (1990) Direct and indirect effects: Classical and bootstrap estimates of variability. Sociological Methodology 20: pp. 115140 CrossRef
 Cheung, G. W., Lau, R. S. (2008) Testing mediation and suppression effects of latent variables: Bootstrapping with structural equation models. Organizational Research Methods 11: pp. 296325 CrossRef
 Cheung, M. W.L. (2007) Comparison of approaches to constructing confidence intervals for mediating effects using structural equation models. Structural Equation Modeling 14: pp. 227246
 Cheung, M. W.L. (2009) Constructing approximate confidence intervals for parameters with structural equation models. Structural Equation Modeling 16: pp. 267294 CrossRef
 Cheung, M. W.L., Chan, W. (2005) Metaanalytic structural equation modeling: A twostage approach. Psychological Methods 10: pp. 4064 CrossRef
 Cheung, M. W.L., Chan, W. (2009) A twostage approach to synthesizing covariance matrices in metaanalytic structural equation modeling. Structural Equation Modeling 16: pp. 2853 CrossRef
 Cohen, J. (1988) Statistical power analysis for the behavioral sciences. Erlbaum, Hillsdale, NJ
 Cohen, J. (1994) The world is round ( p < .05). American Psychologist 49: pp. 9971003 CrossRef
 Cohen, J., Cohen, P., West, S. G., Aiken, L. S. (2003) Applied multiple regression/correlation analysis for the behavioral sciences. Erlbaum, Mahwah, NJ
 Cudeck, R. (1989) Analysis of correlation matrices using covariance structure models. Psychological Bulletin 105: pp. 317327 CrossRef
 Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A. (2007) Statistical reform in psychology: Is anything changing?. Psychological Science 18: pp. 230232 CrossRef
 Davison, A. C., Hinkley, D. V. (1997) Bootstrap methods and their application. Cambridge University Press, New York
 Edwards, J. R., Lambert, L. S. (2007) Methods for integrating moderation and mediation: A general analytical framework using moderated path analysis. Psychological Methods 12: pp. 122 CrossRef
 Fritz, M. S., MacKinnon, D. P. (2007) Required sample size to detect the mediated effect. Psychological Science 18: pp. 233239 CrossRef
 Goodman, L. A. (1960) On the exact variance of products. Journal of the American Statistical Association 55: pp. 708713 CrossRef
 Harlow, L. L., Mulaik, S. A., Steiger, J. H. (1997) What if there were no significance tests?. Erlbaum, Mahwah, NJ
 Hedges, L. V., Olkin, I. (1985) Statistical methods for metaanalysis. Academic Press, Orlando, FL
 Hedges, L. V., Vevea, J. L. (1998) Fixed and randomeffects models in metaanalysis. Psychological Methods 3: pp. 486504 CrossRef
 Hoyle, R. H., Kenny, D. A. Sample size, reliability, and tests of statistical mediation. In: Hoyle, R. H. eds. (1999) Statistical strategies for small sample research. Sage, Thousand Oakes, CA, pp. 195222
 Hunter, J. E., Hamilton, M. A. (2002) The advantages of using standardized scores in causal analysis. Human Communication Research 28: pp. 552561 CrossRef
 Hunter, J. E., Schmidt, F. L. (2004) Methods of metaanalysis: Correcting error and bias in research findings. Sage, Thousand Oaks, CA
 James, L. R., Brett, J. M. (1984) Mediators, moderators, and tests for mediation. Journal of Applied Psychology 69: pp. 307321 CrossRef
 James, L. R., Mulaik, S. A., Brett, J. M. (2006) A tale of two methods. Organizational Research Methods 9: pp. 233244 CrossRef
 Jöreskog, K. G. (1999) How large can a standardized coefficient be?. Scientific Software International, Lincolnwood, IL
 Jöreskog, K. G., Sörbom, D. (1996) LISREL 8: A user’s reference guide. Scientific Software International, Chicago
 Jöreskog, K. G., Sörbom, D., Toit, S., Toit, M. (1999) LISREL 8: New Statistical Features. Scientific Software International, Chicago
 Judd, C. M., Kenny, D. A. (1981) Process analysis: Estimating mediation in treatment evaluations. Evaluation Review 5: pp. 602619 CrossRef
 Kirk, R. E. (1996) Practical significance: A concept whose time has come. Educational & Psychological Measurement 56: pp. 746759 CrossRef
 Kline, R. B. (2004) Beyond significance testing: Reforming data analysis methods in behavioral research. American Psychological Association, Washington, DC CrossRef
 MacKinnon, D. P. Contrasts in multiple mediator models. In: Rose, J. S., Chassin, L., Presson, C. C., Sherman, S. J. eds. (2000) Multivariate applications in substance use research: New methods for new questions. Erlbaum, Mahwah, NJ, pp. 141160
 MacKinnon, D. P. (2008) Introduction to statistical mediation analysis. Erlbaum, Mahwah, NJ
 MacKinnon, D. P., Fairchild, A. J., Fritz, M. S. (2007) Mediation analysis. Annual Review of Psychology 58: pp. 593614 CrossRef
 MacKinnon, D. P., Fritz, M. S., Williams, J., Lockwood, C. M. (2007) Distribution of the product confidence limits for the indirect effect: Program PRODLIN. Behavior Research Methods 39: pp. 384389 CrossRef
 MacKinnon, D. P., Krull, J. L., Lockwood, C. M. (2000) Equivalence of the mediation, confounding, and suppression effect. Prevention Science 1: pp. 173181 CrossRef
 MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., Sheets, V. (2002) A comparison of methods to test the significance of the mediated effect. Psychological Methods 7: pp. 83104 CrossRef
 MacKinnon, D. P., Lockwood, C. M., Williams, J. (2004) Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivariate Behavioral Research 39: pp. 99128 CrossRef
 MacKinnon, D. P., Warsi, G., Dwyer, J. H. (1995) A simulation study of mediated effect measures. Multivariate Behavioral Research 30: pp. 4162 CrossRef
 MorganLopez, A. A., MacKinnon, D. P. (2006) Demonstration and evaluation of a method for assessing mediated moderation. Behavior Research Methods 38: pp. 7787 CrossRef
 Muthén, L. K., Muthén, B. O. (2007) Mplus user’s guide. Muthén & Muthén, Los Angeles
 Neale, M. C., Boker, S. M., Xie, G., Maes, H. H. (2005) Mx: Statistical modeling. Virginia Commonwealth University, Department of Psychiatry, Richmond, VA
 Neale, M. C., Miller, M. B. (1997) The use of likelihoodbased confidence intervals in genetic models. Behavior Genetics 27: pp. 113120 CrossRef
 Olkin, I., Finn, J. D. (1995) Correlation redux. Psychological Bulletin 118: pp. 155164 CrossRef
 Olkin, I., Siotani, M. Asymptotic distribution of functions of a correlation matrix. In: Ideka, S. eds. (1976) Essays in probability and statistics. Shinko Tsusho, Tokyo, pp. 235251
 Pituch, K. A., Whittaker, T. A., Stapleton, L. M. (2005) A comparison of methods to test for mediation in multisite experiments. Multivariate Behavioral Research 40: pp. 123 CrossRef
 Preacher, K. J., Hayes, A. F. (2004) SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers 36: pp. 717731 CrossRef
 Preacher, K. J., Hayes, A. F. (2008) Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods 40: pp. 879891 CrossRef
 Preacher, K. J., Hayes, A. F. Contemporary approaches to assessing mediation in communication research. In: Hayes, A. F., Slater, M. D., Snyder, L. B. eds. (2008) The Sage sourcebook of advanced data analysis methods for communication research. Sage, Thousand Oaks, CA, pp. 1354
 Preacher, K. J., Rucker, D. D., Hayes, A. F. (2007) Addressing moderated mediation hypothesis: Theory, methods, and prescriptions. Multivariate Behavioral Research 42: pp. 185227
 QuinonesVidal, E., LopezGarcia, J. J., PenarandaOrtega, M., TortosaGil, F. (2004) The nature of social and personality psychology as reflected in JPSP, 1965–2000. Journal of Personality & Social Psychology 86: pp. 435452 CrossRef
 Raykov, T., Brennan, M., Reinhardt, J. P., Horowitz, A. (2008) Comparison of mediated effects: A correlation structure modeling approach. Structural Equation Modeling 15: pp. 603626 CrossRef
 Raykov, T., Shrout, P. E. (2002) Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach. Structural Equation Modeling 9: pp. 195212 CrossRef
 R Development Core Team (2008). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Available at www.rproject.org.
 Rindskopf, D. (1984) Using phantom and imaginary latent variables to parameterize constraints in linear structural models. Psychometrika 49: pp. 3747 CrossRef
 Shrout, P. E., Bolger, N. (2002) Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods 7: pp. 422445 CrossRef
 Sobel, M. E. (1982) Asymptotic confidence intervals for indirect effects in structural equation models. Sociological Methodology 13: pp. 290312 CrossRef
 Sobel, M. E. (1986) Some new results on indirect effects and their standard errors in covariance structural models. Sociological Methodology 16: pp. 159186 CrossRef
 Stuart, A., Ord, J. K. (1994) Kendall’s advanced theory of statistics: Vol. 1. Distribution theory. Oxford University Press, New York
 Tamhane, A. C., Dunlop, D. D. (2000) Statistics and data analysis: From elementary to intermediate. Prentice Hall, Upper Saddle River, NJ
 Taylor, A. B., MacKinnon, D. P., Tein, J. (2008) Tests of the threepath mediated effect. Organizational Research Methods 11: pp. 241269 CrossRef
 Wansbeek, T., Meijer, E. (2000) Measurement error and latent variables in econometrics. Elsevier, New York
 Wilkinson, L. (1999) Statistical methods in psychology journals: Guidelines and explanations. American Psychologists 54: pp. 594604 CrossRef
 Williams, J., MacKinnon, D. P. (2008) Resampling and distribution of the product methods for testing indirect effects in complex models. Structural Equation Modeling 15: pp. 2351
 Yung, Y.F. (2008, July). Testing and contrasting mediation or indirect effects in SEM: An analytic approach and its implementation. Paper presented at the 73rd Annual Meeting of the Psychometric Society, Durham, NH.
 Title
 Comparison of methods for constructing confidence intervals of standardized indirect effects
 Journal

Behavior Research Methods
Volume 41, Issue 2 , pp 425438
 Cover Date
 20090501
 DOI
 10.3758/BRM.41.2.425
 Print ISSN
 1554351X
 Online ISSN
 15543528
 Publisher
 SpringerVerlag
 Additional Links
 Topics
 Industry Sectors
 Authors

 Mike W. L. Cheung ^{(1)}
 Author Affiliations

 1. Department of Psychology, Faculty of Arts and Social Sciences, National University of Singapore, Block AS4, Level 2, 9 Arts Link, 117570, Singapore