Abstract
A growing number of studies have supported the use of unidimensional psychometric test instruments administered via the Internet; however, support for the use of multidimensional scales is weak. The present study compares paper and Internet administrations of the Multidimensional Health Locus of Control (MHLC) Scale (Wallston & Wallston, 1981). In terms of reliabilities and factor structures, the Internet data were found to be at least as good as the paper data. MHLC scores were comparable for paper and Internet administrations, although the Internet sample scored significantly lower on the Powerful Others subscale. Overall, the results show that administration of the MHLC Scale via the Internet can produce data comparable to that obtained by pen-and-paper methods. However, it is concluded that generalization of these findings beyond the psychometric test instrument and sampling procedures used here is not warranted.
Article PDF
Similar content being viewed by others
References
Anderson, G., Kaldo-Sandström, V., Ström, L., &Strömgren, T. (2003). Internet administration of the Hospital Anxiety and Depression Scale in a sample of tinnitus patients.Journal of Psychosomatic Research,55, 259–262.
Bailey, R., Foote, W., &Throckmorton, B. (2000). Human sexual behavior: A comparison of college and Internet surveys. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 146–168). San Diego: Academic Press.
Barbeite, F. G., &Weiss, E. M. (2004). Computer self-efficacy and anxiety scales for an Internet sample: Testing measurement equivalence of existing measures and development of new scales.Computers in Human Behavior,20, 1–15.
Bentler, P. M. (1995).EQS structural equations program manual. Encino, CA: Multivariate Software.
Best, S. J., Krueger, B., Hubbard, C., &Smith, A. (2001). An assessment of the generalizability of Internet surveys.Social Science Computer Review,19, 131–145.
Birnbaum, M. H. (1999). Testing critical properties of decision-making on the Internet.Psychological Science,10, 399–407.
Birnbaum, M. H. (Ed.) (2000).Psychological experiments on the Internet. San Diego: Academic Press.
Birnbaum, M. H. (2001). A Web-based program of research and decision making. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 23–55). Lengerich, Germany: Pabst.
Birnbaum, M. H. (2002). Wahrscheinlichkeitslehren. In D. Janetzko, M. Hildebrandt, & H. A. Meyer (Eds.),Das experimentalpsychologische Praktikum im Labor und WWW (pp. 141–151). Göttingen: Hogrefe. English translation retrieved August 24, 2004, from http:// psych.fullerton.edu/mbirnbaum/papers/probLearn5.doc.
Birnbaum, M. H. (2004). Human research and data collection via the Internet.Annual Review of Psychology,55, 803–832.
Bollen, K. A. (1990). Overall fit in covariance structure models: Two types of sample size effects.Psychological Bulletin,107, 256–259.
Bordia, P. (1996). Studying verbal interaction on the Internet: The case of rumor transmission research.Behavior Research Methods, Instruments, & Computers,28, 149–151.
Browndyke, J. N., Santa Maria, M. P., Pinkston, J., & Gouvier, W. (1998).A survey of general head injury and prevention knowledge between professionals and non-professionals. Retrieved August 12, 2004, from www.premier.net/%7Ecogito/project/onp1_poster.html.
Buchanan, T. (2000). Internet research: Self-monitoring and judgments of attractiveness.Behavior Research Methods, Instruments, & Computers,32, 521–527.
Buchanan, T. (2001). Online personality assessment. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 57–74). Lengerich, Germany: Pabst.
Buchanan, T., &Smith, J. L. (1999). Using the Internet for psychological research: Personality testing on the World Wide Web.British Journal of Psychology,90, 125–144.
Buckley, M., & Vogel, C. (2003, November).Improving Internet research methods: A Web laboratory. Paper presented at IADIS International Conference WWW/Internet, Algarve, Portugal.
Chaplin, W. F., Davidson, K., Sparrow, V., Stuhr, J., van Roosmalen, E., &Wallston, K. A. (2001). A structural evaluation of the expanded Multidimensional Health Locus of Control Scale with a diverse sample of Caucasian/European, native and black Canadian women.Journal of Health Psychology,6, 447–455.
Cohen, J. (1988).Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Coomber, R. (1997). Using the Internet for survey research.Sociological Research Online,2(2). Retrieved April 1, 2004, from http://www .socresonline.org.uk/2/2/2.htm.
Corley, M., &Scheepers, C. (2002). Syntactic priming in English sentence production: Categorical and latency evidence from an Internetbased study.Psychonomic Bulletin & Review,9, 126–131.
Cronk, B. C., &West, J. L. (2002). Personality research on the Internet: A comparison of Web-based and traditional instruments in take-home and in-class settings.Behavior Research Methods, Instruments, & Computers,34, 177–180.
Davis, R. N. (1999). Web-based administration of a personality questionnaire: Comparison with traditional methods.Behavior Research Methods, Instruments, & Computers,31, 572–577.
Eichstaedt, J. (2002). Measuring differences in preactivation on the Internet: The content category superiority effect.Experimental Psychology,49, 283–291.
Epstein, J., Klinkenberg, W. D., Wiley, D., &McKinley, L. (2001). Insuring sample equivalence across Internet and paper-and-pencil assessments.Computers in Human Behavior,17, 339–346.
Erdfelder, E., Faul, F., &Buchner, A. (1996). GPOWER: A general power analysis program.Behavior Research Methods, Instruments, & Computers,28, 1–11.
Fouladi, R. T., McCarthy, C. J., &Moller, N. (2002). Paper-andpencil or online? Evaluating mode effects on measures of emotional functioning and attachment.Assessment,9, 204–215.
Herrero, J., & Meneses, J. (in press). Short Web-based versions of the perceived stress (PSS) and Center for Epidemiological Studies-Depression (CESD) Scales: A comparison to pencil and paper responses among Internet users.Computers in Human Behavior.
Hewson, C. [M.] (2003). Conducting psychological research on the Internet.The Psychologist,16, 290–292.
Hewson, C. M., Laurent, D., &Vogel, C. M. (1996). Proper methodologies for psychological and sociological studies conducted via the Internet.Behavior Research Methods, Instruments, & Computers,32, 186–191.
Hewson, C. M., Yule, P., Laurent, D., &Vogel, C. M. (2003).Internet research methods: A practical guide for the social and behavioural sciences. London: Sage.
Huang, H.-M. (2006). Do print and Web surveys provide the same results?Computers in Human Behavior,22, 334–350.
Im, E.-O., &Chee, W. (2004). Issues in an Internet survey among midlife Asian women.Health Care for Women International,25, 150–164.
ISC (2004).Internet software consortium, Internet domain survey. Retrieved August 10, 2004, from http://www.isc.org/index.pl?/ops/ds/.
Johnson, J. A. (2000, March).Web-based personality assessment. Poster session presented at the 71st Annual Meeting of the Eastern Psychological Association, Baltimore.
Joinson, A. [N.] (1999). Social desirability, anonymity, and Internetbased questionnaires.Behavior Research Methods, Instruments, & Computers,31, 433–438.
Joinson, A. N. (2001). Knowing me, knowing you: Reciprocal selfdisclosure in Internet-based surveys.CyberPsychology & Behavior,4, 587–591.
Kaye, B. K., &Johnson, T. J. (1999). Taming the cyber frontier: Techniques for improving online surveys.Social Science Computer Review,17, 323–337.
Kline, P. (1993).Personality. London: Routledge.
Knapp, H., &Kirk, S. A. (2003). Using pencil and paper, Internet and touch-tone phones for self-administration surveys: Does methodology matter?Computers in Human Behavior,19, 117–134.
Krantz, J. H. (2001). Stimulus delivery on the Web: What can be presented when calibration isn’t possible. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 113–130). Lengerich, Germany: Pabst.
Krantz, J. H., Ballard, J., &Scher, J. (1997). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness.Behavior Research Methods, Instruments, & Computers,29, 264–269.
Krantz, J. H., &Dalal, R. (2000). Validity of Web-based psychological research. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 35–60). San Diego: Academic Press.
Laugwitz, B. (2001). A Web experiment on colour harmony principles applied to computer user interface design. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 131–145). Lengerich, Germany: Pabst.
Linnman, C., Carlbring, P., Åhman, Å., Andersson, H., &Andersson, G. (2006). The Stroop effect on the Internet.Computers in Human Behavior,22, 448–455.
Mann, C., &Stewart, F. (2000).Internet communication and qualitative research: A handbook for researching online. London: Sage.
Metzger, M. M., Kristof, V. L., &Yoest, D. J., Jr. (2003). The world wide web and the laboratory: A comparison using face recognition.CyberPsychology & Behavior,6, 613–621.
Meyerson, P., &Tryon, W. W. (2003). Validating Internet research: A test of the psychometric equivalence of Internet and in-person samples.Behavior Research Methods, Instruments, & Computers,35, 614–620.
Musch, J., &Reips, U.-D. (2000). A brief history of Web experimenting. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 61–87). San Diego: Academic Press.
NUA (2002).NUA Internet surveys: How many online? Retrieved August 10, 2004, from www.nua.com/surveys/how-many-online/index. html.
Pohl, R. F., Bender, M., &Lachmann, G. (2002). Hindsight bias around the world.Experimental Psychology,49, 270–282.
Raykov, T. (1998). On the use of confirmatory factor analysis in personality research.Personality & Individual Differences,24, 291–293.
Reips, U.-D. (2000). The Web experiment method: Advantages, disadvantages and solutions. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 89–117). San Diego: Academic Press.
Reips, U.-D. (2002). Standards for Internet-based experimenting.Experimental Psychology,49, 243–256.
Riva, G., Teruzzi, T., &Anolli, L. (2003). The use of the Internet in psychology research: Comparison of online and offline questionnaires.CyberPsychology & Behavior,6, 73–80.
Salgado, J. F., &Moscoso, S. (2003). Internet-based personality testing: Equivalence of measures and assessees’ perceptions and reactions.International Journal of Selection & Assessment,11, 194–205.
Schmidt, W. C. (1997). World-Wide Web survey research: Benefits, potential problems, and solutions.Behavior Research Methods, Instruments, & Computers,29, 274–279.
Senior, C., Barnes, J., Jenkins, R., Landau, S., Phillips, M. L., &David, A. S. (1999). Attribution of social dominance and maleness to schematic faces.Social Behavior & Personality,27, 331–338.
Shavit, T., Sonsino, D., &Benzion, U. (2001). A comparative study of lotteries: Evaluation in class and on the Web.Journal of Economic Psychology,22, 483–491.
Smart, R. (1966). Subject selection bias in psychological research.Canadian Psychologist,7, 115–121.
Smith, M. A., &Leigh, B. (1997). Virtual subjects: Using the Internet as an alternative source of subjects and research environment.Behavior Research Methods, Instruments, & Computers,29, 496–505.
Smither, J. W., Walker, A. G., &Yap, M. K. T. (2004). An examination of the equivalence of Web-based versus paper-and-pencil upward feedback ratings: Rater- and ratee-level analyses.Educational & Psychological Measurement,64, 40–61.
Stanton, J. M. (1998). An empirical assessment of data collection using the Internet.Personnel Psychology,51, 709–725.
Szabo, A., Frenkl, R., &Caputo, A. (1996). Deprivation feelings, anxiety, and commitments in various forms of physical activity: A cross-sectional study on the Internet.Psychologia,39, 223–230.
Truell, A. D., Bartlett, J. E., II, &Alexander, M. W. (2002). Response rate, speed, and completeness: A comparison of Internet-based and mail surveys.Behavior Research Methods, Instruments, & Computers,34, 46–49.
Ullman, J. B. (2001). Structural equation modeling. In B. G. Tabachnick & L. S. Fidell (Eds.),Using multivariate statistics (4th ed.). Boston: Allyn & Bacon.
Voracek, M., Steiger, S., &Gindl, A. (2001). Online replication of evolutionary psychology evidence: Sex differences in sexual jealousy in imagined scenarios of mates’ sexual vs. emotional infidelity. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 91–112). Lengerich, Germany: Pabst.
Wallston, K. A., &Wallston, B. S. (1981). Health locus of control scales. In H. M. Lefcourt (Ed.),Research with the locus of control construct: Vol. 1. Assessment methods (pp. 189–243). New York: Academic Press.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hewson, C., Charlton, J.P. Measuring health beliefs on the Internet: A comparison of paper and Internet administrations of the Multidimensional Health Locus of Control Scale. Behavior Research Methods 37, 691–702 (2005). https://doi.org/10.3758/BF03192742
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03192742