Skip to main content
Download PDF

The Web Experimental Psychology Lab: Five years of data collection on the Internet

Behavior Research Methods, Instruments, & Computers volume 33, pages 201–211 (2001)Cite this article

Abstract

In fall 1995, the worldwide-accessible Web Experimental Psychology Lab (http://www.genpsylab. unizh.ch) opened its doors to Web surfers and Web experimenters. It offers a frequently visited place at which to conduct true experiments over the Internet. Data from 5 years of laboratory running time are presented, along with recommendations for setting up and maintaining a virtual laboratory, including sections on the history of the Web laboratory and of Web experimenting, the laboratory’s structure and design, visitor demographics, the Kids’ Experimental Psychology Lab, access statistics, administration, software and hardware, marketing, other Web laboratories, data security, and data quality. It is concluded that experimental data collection via the Internet has proven to be an enrichment to science. Consequently, the Web Experimental Psychology Lab will continue and extend its services to the scientific community.

References

  • American Psychological Association (1992).Ethical principles of psychologists and code of conduct [on-line document]. Available: http://www.apa.org/ethics/code.html. [Retrieved April 6, 2001]

  • Anderson, N. H. (1982).Methods of information integration theory. New York: Academic Press.

    Google Scholar 

  • Birnbaum, M. H. (1999). How to show that 9 > 221: Collect judgments in a between-subjects design.Psychological Methods,4, 243–249.

    Article  Google Scholar 

  • Birnbaum, M. H. (2000).Psychological experiments on the Internet. San Diego: Academic Press.

    Google Scholar 

  • Booth-Kewley, S., Edwards, J., &Rosenfeld, P. (1992). Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference?Journal of Applied Psychology,77, 562–566.

    Article  Google Scholar 

  • Buchanan, T., &Smith, J. L. (1999). Using the Internet for psychological research: Personality testing on the World Wide Web.British Journal of Psychology,90, 125–144.

    Article  PubMed  Google Scholar 

  • Connes, B. (1972). The use of electronic desk computers in psychological experiments.Journal of Structural Learning,3, 51–72.

    Google Scholar 

  • Dickey, C. E. (1999).Web page hacker arrested, government sites becoming more secure [On-line document]. Available: http://www.dtic.mil/armylink/news/Sep1999/a19990901hacker.html. [Retrieved April 6, 2001]

  • Eichstaedt, J. (2001). An inaccurate-timing filter for reaction time measurement by JAVA applets implementing Internet-based experiments.Behavior Research Methods, Instruments, & Computers,33, 179–186.

    Google Scholar 

  • Extreme Digytal (2001).Extreme tracking [On-line document]. Available: http://www.extreme-dm.com/tracking/. [Retrieved April 6, 2001]

  • Francis, G., Neath, I., &Surprenant, A. (2000). The Cognitive Psychology Online Laboratory. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 267–283). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Frick, A., Bächtiger, M. T., &Reips, U.-D. (2001). Financial incentives, personal information, and drop out in online studies. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 209–220). Lengerich: Pabst.

    Google Scholar 

  • Fx Web Web Technologies (1999).Webtracker version 2 [On-line document]. Available: http://www.fxWeb.com/tracker/. [Retrieved April 6, 2001]

  • Graphics, Visualization, and Usability Center (1999).GVU’s WWW user surveys [on-line document]. Available: http://www.cc. gatech.edu/gvu/user_surveys. [Retrieved April 6, 2001]

  • Hänze, M., &Meyer, H. A. (1997). Feldexperimente und nicht-reaktive Messung im World Wide Web [Field experiments and nonreactive measurement on the World-Wide Web]. In D. Janetzko, B. Batinic, D. Schoder, M. Mattingley-Scott, & G. Strube (Eds.),CAW-97. Beiträge zum Workshop “Cognition & Web” (pp. 141–148). Freiburg, Germany: LIG-Berichte 1/97.

    Google Scholar 

  • Hewson, C. M., Laurent, D., &Vogel, G. M. (1996). Proper methodologies for psychological and sociological studies conducted via the Internet.Behavior Research Methods, Instruments, & Computers,28, 186–191.

    Google Scholar 

  • Hoffman, R., &MacDonald, J. (1993). Using HyperCard and Apple events in a network environment: Collecting data from simultaneous experimental sessions.Behavior Research Methods, Instruments, & Computers,25, 114–126.

    Google Scholar 

  • Hoggatt, A. C. (1977). On the uses of computers for experimental control and data acquisition.American Behavioral Scientist,20, 347–365.

    Article  Google Scholar 

  • Jäger, A. O., Süss, H.-M., &Beauducel, A. (1997).Berliner Intelligenzstruktur-Test (BIS-Test): Form 4 [The Berlin Intelligence Structure Test: Form 4]. Göttingen: Hogrefe.

    Google Scholar 

  • Janetzko, D. (1999).Statistische Anwendungen im Internet [Statistical applications for the Internet]. Munich: Addison-Wesley.

    Google Scholar 

  • Kieley, J. M. (1996). CGI scripts: Gateways to World-Wide Web power.Behavior Research Methods, Instruments, & Computers,28, 165–169.

    Google Scholar 

  • Krantz, J. H., Ballard, J., &Scher, J. (1997). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness.Behavior Research Methods, Instruments, & Computers,29, 264–269.

    Google Scholar 

  • Krist, H., & Reips, U.-D. (2001).Length estimation in the archimedic spiral: Studying information integration on the Internet. Manuscript in preparation.

  • McGraw, K. O., Tew, M. D., &Williams, J. E. (2000). An online psychology laboratory. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 219–233). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Morrow, R. H., &McKee, A. J. (1998). CGI scripts: A strategy for between-subjects experimental group assignment on the World-Wide Web.Behavior Research Methods, Instruments, & Computers,30, 306–308.

    Google Scholar 

  • Musch, J., &Reips, U.-D. (2000). A brief history of Web experimenting. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 61–85). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Psycoloquy (2000). [On-line document]. Available: http://www. princeton. edu/~harnad/psyc.html. [Retrieved April 6, 2001]

  • Reips, U.-D. (1995).The Web experiment method [On-line document]. Available: http://www.genpsy.unizh.ch/Ulf/Lab/WWWExpMethod. html. [Retrieved April 6, 2001]

  • Reips, U.-D. (1996a, April). Experimentieren im World-Wide Web [Experimenting in the World-Wide Web] [Abstract].Experimentelle Psychologie: Tagung experimentell arbeitender Psychologen [Proceedings of the Experimental Psychologist’s Conference],38, 256–257.

    Google Scholar 

  • Reips, U.-D. (1996b, October).Experimenting in the World Wide Web. Paper presented at the 1996 Society for Computers in Psychology Conference, Chicago. Available: http://www.genpsy.unizh.ch/reips/slides/scipchicago96.html. [Retrieved April 6, 2001]

  • Reips, U.-D. (1997a). Forschen im Jahr 2007: Integration von Web-Experimentieren, Online-Publizieren und Multimedia-Kommunikation [Science in the year 2007: Integration of Web experimenting, online publishing, and multimedia communication]. In D. Janetzko, B. Batinic, D. Schoder, M. Mattingley-Scott, & G. Strube (Eds.),CAW-97: Beiträge zum. Workshop “Cognition & Web” (pp. 141–148). Freiburg, Germany: IIG-Berichte 1/97.

    Google Scholar 

  • Reips, U.-D. (1997b). Das psychologische Experimentieren im Internet [Psychological experimenting on the Internet], In B. Batinic (Ed.),Internet für Psychologen (pp. 245–265). Göttingen: Hogrefe.

    Google Scholar 

  • Reips, U.-D. (1999). Online research with children [On-line book]. In U.-D. Reips, B. Batinic, W Bandilla, M. Bosnjak, L. Gräf, K. Moser, & A. Werner (Eds.),Current Internet Science—trends, techniques, results/Aktuelle Online Forschung—Trends, Techniken, Ergebnisse. Zurich: Online Press. Available: http://dgof.de/tband99/. [Retrieved April 6, 2001]

    Google Scholar 

  • Reips, U.-D. (2000). The Web experiment method: Advantages, disadvantages, and solutions. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 89–114). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Reips, U.-D. (in press-a). Context effects in Web surveys. In B. Batinic, U.-D. Reips, & M. Bosnjak (Eds.),Online social sciences. Seattle: Hogrefe & Huber.

  • Reips, U.-D. (in press-b). Theory and techniques of Web experimenting. In B. Batinic, U.-D. Reips, & M. Bosnjak (Eds.),Online social sciences. Seattle: Hogrefe & Huber.

  • Reips, U.-D., Morger, V., & Meier, B. (2000). Fünfegerade sein lassen: Listenkontexte [Letting five be equal: List contexts]. Manuscript submitted for publication.

  • Schmidt, W. C. (2000). The server-side of psychology Web experiments. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 285–310). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Schwarz, S., &Reips, U.-D. (2001). CGI versus JavaScript: A Web experiment on the reversed hindsight bias. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 75–90). Lengerich: Pabst.

    Google Scholar 

  • Sullivan, D. (2000, July 7).Search engine sizes [On-line], Available: http://searchenginewatch.com. [Retrieved April 6, 2001]

  • Wason, P. C. (1968). Reasoning about a rule.Quarterly Journal of Experimental Psychology,20, 273–281.

    Article  PubMed  Google Scholar 

  • Wilkening, F. (1979). Combining of stimulus dimensions in children’s and adults’ judgments of area: An information integration analysis.Developmental Psychology,15, 25–33.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Allgemeine und Entwicklungspsychologie, Universität Zürich, Attenhoferstr. 9, CH-8032, Zürich, Switzerland

    Ulf-Dietrich Reips

Authors
  1. Ulf-Dietrich Reips
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ulf-Dietrich Reips.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Reips, UD. The Web Experimental Psychology Lab: Five years of data collection on the Internet. Behavior Research Methods, Instruments, & Computers 33, 201–211 (2001). https://doi.org/10.3758/BF03195366

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.3758/BF03195366

Keywords

  • Behavior Research Method
  • Online Laboratory
  • Experimental Data Collection
  • Entry Page
  • Unix Server