Skip to main content

Measuring health beliefs on the Internet: A comparison of paper and Internet administrations of the Multidimensional Health Locus of Control Scale

Abstract

A growing number of studies have supported the use of unidimensional psychometric test instruments administered via the Internet; however, support for the use of multidimensional scales is weak. The present study compares paper and Internet administrations of the Multidimensional Health Locus of Control (MHLC) Scale (Wallston & Wallston, 1981). In terms of reliabilities and factor structures, the Internet data were found to be at least as good as the paper data. MHLC scores were comparable for paper and Internet administrations, although the Internet sample scored significantly lower on the Powerful Others subscale. Overall, the results show that administration of the MHLC Scale via the Internet can produce data comparable to that obtained by pen-and-paper methods. However, it is concluded that generalization of these findings beyond the psychometric test instrument and sampling procedures used here is not warranted.

References

  • Anderson, G., Kaldo-Sandström, V., Ström, L., &Strömgren, T. (2003). Internet administration of the Hospital Anxiety and Depression Scale in a sample of tinnitus patients.Journal of Psychosomatic Research,55, 259–262.

    Article  Google Scholar 

  • Bailey, R., Foote, W., &Throckmorton, B. (2000). Human sexual behavior: A comparison of college and Internet surveys. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 146–168). San Diego: Academic Press.

    Google Scholar 

  • Barbeite, F. G., &Weiss, E. M. (2004). Computer self-efficacy and anxiety scales for an Internet sample: Testing measurement equivalence of existing measures and development of new scales.Computers in Human Behavior,20, 1–15.

    Article  Google Scholar 

  • Bentler, P. M. (1995).EQS structural equations program manual. Encino, CA: Multivariate Software.

    Google Scholar 

  • Best, S. J., Krueger, B., Hubbard, C., &Smith, A. (2001). An assessment of the generalizability of Internet surveys.Social Science Computer Review,19, 131–145.

    Article  Google Scholar 

  • Birnbaum, M. H. (1999). Testing critical properties of decision-making on the Internet.Psychological Science,10, 399–407.

    Article  Google Scholar 

  • Birnbaum, M. H. (Ed.) (2000).Psychological experiments on the Internet. San Diego: Academic Press.

    Google Scholar 

  • Birnbaum, M. H. (2001). A Web-based program of research and decision making. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 23–55). Lengerich, Germany: Pabst.

    Google Scholar 

  • Birnbaum, M. H. (2002). Wahrscheinlichkeitslehren. In D. Janetzko, M. Hildebrandt, & H. A. Meyer (Eds.),Das experimentalpsychologische Praktikum im Labor und WWW (pp. 141–151). Göttingen: Hogrefe. English translation retrieved August 24, 2004, from http:// psych.fullerton.edu/mbirnbaum/papers/probLearn5.doc.

    Google Scholar 

  • Birnbaum, M. H. (2004). Human research and data collection via the Internet.Annual Review of Psychology,55, 803–832.

    Article  PubMed  Google Scholar 

  • Bollen, K. A. (1990). Overall fit in covariance structure models: Two types of sample size effects.Psychological Bulletin,107, 256–259.

    Article  Google Scholar 

  • Bordia, P. (1996). Studying verbal interaction on the Internet: The case of rumor transmission research.Behavior Research Methods, Instruments, & Computers,28, 149–151.

    Article  Google Scholar 

  • Browndyke, J. N., Santa Maria, M. P., Pinkston, J., & Gouvier, W. (1998).A survey of general head injury and prevention knowledge between professionals and non-professionals. Retrieved August 12, 2004, from www.premier.net/%7Ecogito/project/onp1_poster.html.

  • Buchanan, T. (2000). Internet research: Self-monitoring and judgments of attractiveness.Behavior Research Methods, Instruments, & Computers,32, 521–527.

    Article  Google Scholar 

  • Buchanan, T. (2001). Online personality assessment. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 57–74). Lengerich, Germany: Pabst.

    Google Scholar 

  • Buchanan, T., &Smith, J. L. (1999). Using the Internet for psychological research: Personality testing on the World Wide Web.British Journal of Psychology,90, 125–144.

    Article  PubMed  Google Scholar 

  • Buckley, M., & Vogel, C. (2003, November).Improving Internet research methods: A Web laboratory. Paper presented at IADIS International Conference WWW/Internet, Algarve, Portugal.

  • Chaplin, W. F., Davidson, K., Sparrow, V., Stuhr, J., van Roosmalen, E., &Wallston, K. A. (2001). A structural evaluation of the expanded Multidimensional Health Locus of Control Scale with a diverse sample of Caucasian/European, native and black Canadian women.Journal of Health Psychology,6, 447–455.

    Article  Google Scholar 

  • Cohen, J. (1988).Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Coomber, R. (1997). Using the Internet for survey research.Sociological Research Online,2(2). Retrieved April 1, 2004, from http://www .socresonline.org.uk/2/2/2.htm.

  • Corley, M., &Scheepers, C. (2002). Syntactic priming in English sentence production: Categorical and latency evidence from an Internetbased study.Psychonomic Bulletin & Review,9, 126–131.

    Article  Google Scholar 

  • Cronk, B. C., &West, J. L. (2002). Personality research on the Internet: A comparison of Web-based and traditional instruments in take-home and in-class settings.Behavior Research Methods, Instruments, & Computers,34, 177–180.

    Article  Google Scholar 

  • Davis, R. N. (1999). Web-based administration of a personality questionnaire: Comparison with traditional methods.Behavior Research Methods, Instruments, & Computers,31, 572–577.

    Article  Google Scholar 

  • Eichstaedt, J. (2002). Measuring differences in preactivation on the Internet: The content category superiority effect.Experimental Psychology,49, 283–291.

    PubMed  Google Scholar 

  • Epstein, J., Klinkenberg, W. D., Wiley, D., &McKinley, L. (2001). Insuring sample equivalence across Internet and paper-and-pencil assessments.Computers in Human Behavior,17, 339–346.

    Article  Google Scholar 

  • Erdfelder, E., Faul, F., &Buchner, A. (1996). GPOWER: A general power analysis program.Behavior Research Methods, Instruments, & Computers,28, 1–11.

    Article  Google Scholar 

  • Fouladi, R. T., McCarthy, C. J., &Moller, N. (2002). Paper-andpencil or online? Evaluating mode effects on measures of emotional functioning and attachment.Assessment,9, 204–215.

    Article  PubMed  Google Scholar 

  • Herrero, J., & Meneses, J. (in press). Short Web-based versions of the perceived stress (PSS) and Center for Epidemiological Studies-Depression (CESD) Scales: A comparison to pencil and paper responses among Internet users.Computers in Human Behavior.

  • Hewson, C. [M.] (2003). Conducting psychological research on the Internet.The Psychologist,16, 290–292.

    Google Scholar 

  • Hewson, C. M., Laurent, D., &Vogel, C. M. (1996). Proper methodologies for psychological and sociological studies conducted via the Internet.Behavior Research Methods, Instruments, & Computers,32, 186–191.

    Article  Google Scholar 

  • Hewson, C. M., Yule, P., Laurent, D., &Vogel, C. M. (2003).Internet research methods: A practical guide for the social and behavioural sciences. London: Sage.

    Google Scholar 

  • Huang, H.-M. (2006). Do print and Web surveys provide the same results?Computers in Human Behavior,22, 334–350.

    Article  Google Scholar 

  • Im, E.-O., &Chee, W. (2004). Issues in an Internet survey among midlife Asian women.Health Care for Women International,25, 150–164.

    Article  PubMed  Google Scholar 

  • ISC (2004).Internet software consortium, Internet domain survey. Retrieved August 10, 2004, from http://www.isc.org/index.pl?/ops/ds/.

  • Johnson, J. A. (2000, March).Web-based personality assessment. Poster session presented at the 71st Annual Meeting of the Eastern Psychological Association, Baltimore.

  • Joinson, A. [N.] (1999). Social desirability, anonymity, and Internetbased questionnaires.Behavior Research Methods, Instruments, & Computers,31, 433–438.

    Article  Google Scholar 

  • Joinson, A. N. (2001). Knowing me, knowing you: Reciprocal selfdisclosure in Internet-based surveys.CyberPsychology & Behavior,4, 587–591.

    Article  Google Scholar 

  • Kaye, B. K., &Johnson, T. J. (1999). Taming the cyber frontier: Techniques for improving online surveys.Social Science Computer Review,17, 323–337.

    Article  Google Scholar 

  • Kline, P. (1993).Personality. London: Routledge.

    Google Scholar 

  • Knapp, H., &Kirk, S. A. (2003). Using pencil and paper, Internet and touch-tone phones for self-administration surveys: Does methodology matter?Computers in Human Behavior,19, 117–134.

    Article  Google Scholar 

  • Krantz, J. H. (2001). Stimulus delivery on the Web: What can be presented when calibration isn’t possible. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 113–130). Lengerich, Germany: Pabst.

    Google Scholar 

  • Krantz, J. H., Ballard, J., &Scher, J. (1997). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness.Behavior Research Methods, Instruments, & Computers,29, 264–269.

    Article  Google Scholar 

  • Krantz, J. H., &Dalal, R. (2000). Validity of Web-based psychological research. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 35–60). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Laugwitz, B. (2001). A Web experiment on colour harmony principles applied to computer user interface design. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 131–145). Lengerich, Germany: Pabst.

    Google Scholar 

  • Linnman, C., Carlbring, P., Åhman, Å., Andersson, H., &Andersson, G. (2006). The Stroop effect on the Internet.Computers in Human Behavior,22, 448–455.

    Article  Google Scholar 

  • Mann, C., &Stewart, F. (2000).Internet communication and qualitative research: A handbook for researching online. London: Sage.

    Google Scholar 

  • Metzger, M. M., Kristof, V. L., &Yoest, D. J., Jr. (2003). The world wide web and the laboratory: A comparison using face recognition.CyberPsychology & Behavior,6, 613–621.

    Article  Google Scholar 

  • Meyerson, P., &Tryon, W. W. (2003). Validating Internet research: A test of the psychometric equivalence of Internet and in-person samples.Behavior Research Methods, Instruments, & Computers,35, 614–620.

    Article  Google Scholar 

  • Musch, J., &Reips, U.-D. (2000). A brief history of Web experimenting. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 61–87). San Diego: Academic Press.

    Chapter  Google Scholar 

  • NUA (2002).NUA Internet surveys: How many online? Retrieved August 10, 2004, from www.nua.com/surveys/how-many-online/index. html.

  • Pohl, R. F., Bender, M., &Lachmann, G. (2002). Hindsight bias around the world.Experimental Psychology,49, 270–282.

    PubMed  Google Scholar 

  • Raykov, T. (1998). On the use of confirmatory factor analysis in personality research.Personality & Individual Differences,24, 291–293.

    Article  Google Scholar 

  • Reips, U.-D. (2000). The Web experiment method: Advantages, disadvantages and solutions. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 89–117). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Reips, U.-D. (2002). Standards for Internet-based experimenting.Experimental Psychology,49, 243–256.

    PubMed  Google Scholar 

  • Riva, G., Teruzzi, T., &Anolli, L. (2003). The use of the Internet in psychology research: Comparison of online and offline questionnaires.CyberPsychology & Behavior,6, 73–80.

    Article  Google Scholar 

  • Salgado, J. F., &Moscoso, S. (2003). Internet-based personality testing: Equivalence of measures and assessees’ perceptions and reactions.International Journal of Selection & Assessment,11, 194–205.

    Article  Google Scholar 

  • Schmidt, W. C. (1997). World-Wide Web survey research: Benefits, potential problems, and solutions.Behavior Research Methods, Instruments, & Computers,29, 274–279.

    Article  Google Scholar 

  • Senior, C., Barnes, J., Jenkins, R., Landau, S., Phillips, M. L., &David, A. S. (1999). Attribution of social dominance and maleness to schematic faces.Social Behavior & Personality,27, 331–338.

    Article  Google Scholar 

  • Shavit, T., Sonsino, D., &Benzion, U. (2001). A comparative study of lotteries: Evaluation in class and on the Web.Journal of Economic Psychology,22, 483–491.

    Article  Google Scholar 

  • Smart, R. (1966). Subject selection bias in psychological research.Canadian Psychologist,7, 115–121.

    Article  Google Scholar 

  • Smith, M. A., &Leigh, B. (1997). Virtual subjects: Using the Internet as an alternative source of subjects and research environment.Behavior Research Methods, Instruments, & Computers,29, 496–505.

    Article  Google Scholar 

  • Smither, J. W., Walker, A. G., &Yap, M. K. T. (2004). An examination of the equivalence of Web-based versus paper-and-pencil upward feedback ratings: Rater- and ratee-level analyses.Educational & Psychological Measurement,64, 40–61.

    Article  Google Scholar 

  • Stanton, J. M. (1998). An empirical assessment of data collection using the Internet.Personnel Psychology,51, 709–725.

    Article  Google Scholar 

  • Szabo, A., Frenkl, R., &Caputo, A. (1996). Deprivation feelings, anxiety, and commitments in various forms of physical activity: A cross-sectional study on the Internet.Psychologia,39, 223–230.

    Google Scholar 

  • Truell, A. D., Bartlett, J. E., II, &Alexander, M. W. (2002). Response rate, speed, and completeness: A comparison of Internet-based and mail surveys.Behavior Research Methods, Instruments, & Computers,34, 46–49.

    Article  Google Scholar 

  • Ullman, J. B. (2001). Structural equation modeling. In B. G. Tabachnick & L. S. Fidell (Eds.),Using multivariate statistics (4th ed.). Boston: Allyn & Bacon.

    Google Scholar 

  • Voracek, M., Steiger, S., &Gindl, A. (2001). Online replication of evolutionary psychology evidence: Sex differences in sexual jealousy in imagined scenarios of mates’ sexual vs. emotional infidelity. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 91–112). Lengerich, Germany: Pabst.

    Google Scholar 

  • Wallston, K. A., &Wallston, B. S. (1981). Health locus of control scales. In H. M. Lefcourt (Ed.),Research with the locus of control construct: Vol. 1. Assessment methods (pp. 189–243). New York: Academic Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Claire Hewson.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Hewson, C., Charlton, J.P. Measuring health beliefs on the Internet: A comparison of paper and Internet administrations of the Multidimensional Health Locus of Control Scale. Behavior Research Methods 37, 691–702 (2005). https://doi.org/10.3758/BF03192742

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.3758/BF03192742

Keywords

  • Behavior Research Method
  • Multidimensional Scale
  • Paper Data
  • Internet Data
  • Internet Sample